To solve the problem of poor stereo matching effect owing to numerous shadows and disparity step regions in urban satellite remote sensing images, a stereo matching algorithm suitable for urban remote sensing image pairs was proposed. The matching cost function, cost aggregation method, disparity, and optimization method used by the algorithm were investigated. First, the matching cost function was improved and the multi-order weighted census algorithm was used to reduce the influence of noise and other factors. Subsequently, the constraints of the building edge information were added to the cost aggregation. Finally, regarding disparity refinement, the disparity map was optimized by fully considering the characteristics of urban building morphology. The experimental results show that on the Middlebury dataset, the accuracy of this algorithm is 4.54% higher than that of the classic SGM algorithm. On the WorldView-2 stereo image pair in the urban area, the variance of the building roof elevation is 0.71. The requirements to obtain high-precision disparity maps are met based on urban satellite remote sensing images and good conditions for urban three-dimensional reconstruction are provided.
WANG Y Q , LI H Y . Three-dimensional reconstruction of mapping satellite-1 imagery using semi-global matching algorithm based on mutual information [J]. Forest Resources Management , 2016 ( 4 ): 134 - 139 . (in Chinese) . doi: 10.13466/j.cnki.lyzygl.2016.04.024 http://dx.doi.org/10.13466/j.cnki.lyzygl.2016.04.024
SCHARSTEIN D , SZELISKI R , ZABIH R . A taxonomy and evaluation of dense two-frame stereo correspondence algorithms [J]. Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001 ), 2001: 131 - 140 .
HAMZAH R A , IBRAHIM H . Literature survey on stereo vision disparity map algorithms [J]. Journal of Sensors , 2016 , 2016 : 1 - 23 . doi: 10.1155/2016/8742920 http://dx.doi.org/10.1155/2016/8742920
ZABIH R , WOODFILL J . Non-parametric local transforms for computing visual correspondence [C]. Computer Vision-ECCV '94 , 1994 : 151 - 158 . doi: 10.1007/bfb0028345 http://dx.doi.org/10.1007/bfb0028345
LI H CH , LI Y , GU ZH . Stereo matching method for lunar rover using the plane constraint [J]. Opt. Precision Eng. , 2019 , 27 ( 2 ): 433 - 439 . (in Chinese) . doi: 10.3788/ope.20192702.0433 http://dx.doi.org/10.3788/ope.20192702.0433
TATAR N , AREFI H . Evaluation of selected cost aggregation methods on high resolution satellite stereo images [J]. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences , 2019 , XLII-4/W 18 : 1045 - 1050 . doi: 10.5194/isprs-archives-xlii-4-w18-1045-2019 http://dx.doi.org/10.5194/isprs-archives-xlii-4-w18-1045-2019
HIRSCHMULLER H . Stereo processing by semiglobal matching and mutual information [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2008 , 30 ( 2 ): 328 - 341 . doi: 10.1109/tpami.2007.1166 http://dx.doi.org/10.1109/tpami.2007.1166
EINECKE N , EGGERT J . A two-stage correlation method for stereoscopic depth estimation [J]. 2010 International Conference on Digital Image Computing: Techniques and Applications , 2010 : 227 - 234 . doi: 10.1109/dicta.2010.49 http://dx.doi.org/10.1109/dicta.2010.49
GUO S Y . Research on Three-dimensinoal Reconstruction Technology Based on Satellite Remote Sensing Images [D]. Harbin : Harbin Engineering University , 2018 . (in Chinese) . doi: 10.3808/jei.201800394 http://dx.doi.org/10.3808/jei.201800394
ZHAO L , LIU Y M , MEN C G , et al . Double propagation stereo matching for urban 3-D reconstruction from satellite imagery [J]. IEEE Transactions on Geoscience and Remote Sensing , 8144 , PP( 99 ): 1 - 17 .
DUAN L Y , LAFARGE F . Towards large-scale city reconstruction from satellites [C]. Computer Vision-ECCV 2016 , 2016 : 89 - 104 . doi: 10.1007/978-3-319-46454-1_6 http://dx.doi.org/10.1007/978-3-319-46454-1_6
HIRSCHMULLER H , SCHARSTEIN D . Evaluation of cost functions for stereo matching [C]. 2007 IEEE Conference on Computer Vision and Pattern Recognition . 1722,2007 , Minneapolis , MN , USA . IEEE , 2007 : 1 - 8 . doi: 10.1109/cvpr.2007.383248 http://dx.doi.org/10.1109/cvpr.2007.383248
QIU M J . Research on Stereo Matching And Three-dimensional Reconstruction of Urban Remote Sensing Image Pairs [D]. Harbin : Harbin Institute of Technology , 2015 . (in Chinese) . doi: 10.1109/igarss.2015.7326830 http://dx.doi.org/10.1109/igarss.2015.7326830
DARE P M . Shadow analysis in high-resolution satellite imagery of urban areas [J]. Photogrammetric Engineering & Remote Sensing , 2005 , 71 ( 2 ): 169 - 177 . doi: 10.14358/pers.71.2.169 http://dx.doi.org/10.14358/pers.71.2.169
YAMAZAKI F , LIU W , TAKASAKI M . Characteristics of shadow and removal of its effects for remote sensing imagery [C]. 2009 IEEE International Geoscience and Remote Sensing Symposium . 1217,2009 , Cape Town , South Africa . IEEE , 2009 : IV-426. doi: 10.1109/igarss.2009.5417404 http://dx.doi.org/10.1109/igarss.2009.5417404
TRIPODI S , DUAN L , TRASTOUR F , et al . Automated chain for large-scale 3d reconstruction of urban scenes from satellite images [J]. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences , 2019 , XLII-2/W 16 : 243 - 250 . doi: 10.5194/isprs-archives-xlii-2-w16-243-2019 http://dx.doi.org/10.5194/isprs-archives-xlii-2-w16-243-2019
JIAN J F , HU Y , LI X T . Digital elevation model with large scale and high precision based on image of TH-01 mapping satellite [J]. Opt. Precision Eng. , 2017 , 25 ( 12 z): 152 - 159 . (in Chinese)