On diagram-based three-dimensional reconstruction of UAV image

LI Jin-peng; JIANG Ting; XIAO Da; WANG Jun-chao

doi:10.3788/OPE.20162406.1501

您当前的位置：

首页 >

文章列表页 >

On diagram-based three-dimensional reconstruction of UAV image

Information Sciences | 更新时间：2020-08-13

- On diagram-based three-dimensional reconstruction of UAV image
- Optics and Precision Engineering Vol. 24, Issue 6, Pages: 1501-1509(2016)
- 作者机构：
  
  1. 信息工程大学,河南郑州,450002
  2. 中国天绘卫星中心北京,102102
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20162406.1501
  CLC： TP242.6
- Received：26 March 2016，
  
  Revised：25 April 2016，
  
  Published：25 June 2016
- 稿件说明：
移动端阅览
李劲澎, 姜挺, 肖达等. 基于关系图的无人机影像三维重建[J]. 光学精密工程, 2016,24(6): 1501-1509

LI Jin-peng, JIANG Ting, XIAO Da etc. On diagram-based three-dimensional reconstruction of UAV image[J]. Editorial Office of Optics and Precision Engineering, 2016,24(6): 1501-1509
李劲澎, 姜挺, 肖达等. 基于关系图的无人机影像三维重建[J]. 光学精密工程, 2016,24(6): 1501-1509 DOI： 10.3788/OPE.20162406.1501.

LI Jin-peng, JIANG Ting, XIAO Da etc. On diagram-based three-dimensional reconstruction of UAV image[J]. Editorial Office of Optics and Precision Engineering, 2016,24(6): 1501-1509 DOI： 10.3788/OPE.20162406.1501.

摘要

针对增量式运动恢复结构算法在无人机影像三维重建中运行效率低的问题，提出了一种基于关系图的无人机影像批处理重建方法。利用无人机低精度的位置姿态测量系统数据概略估算影像间的重叠关系，在关联影像之间进行尺度不变特征变换匹配，使用随机抽取一致性算法和三视图约束进一步剔除弱关联的影像连接关系，再通过深度优先搜索得到最终参加重建的影像集连通分量，构建出强关联的稳健影像关系图。然后，根据影像相对位姿参数，由最小二乘法解算全局一致性旋转参数，利用三视几何约束和线性规划求解全局一致位置参数，最后进行一次光束法平差优化。实验结果表明：与经典的增量式重建Bundler算法相比，该方法运行速度至少提高了2.6倍，且生成的三维点数量增加了76.5%，更真实地恢复出场景的几何形态。该算法在改善重建效果的同时提高了处理效率，能够满足无人机快速响应应用的需求。

Abstract

In response to low operation efficiency of the incremental algorithm for structure recovery from motion in three-dimensional reconstruction of UAV (Unmanned Aerial Vehicle) image

a diagram-based method for reconstruction of UAV image was proposed. In this method

data obtained from low-precision position and orientation system of UAV was adopted to roughly estimate the overlapping relationship between images

SIFT matching was conducted between related images

random sample consensus algorithm and three views constraint were used to weed out the connected relation between weakly-related images

depth-first search was applied to obtain the connected component of the images finally involved in reconstruction

and then a steady diagram for strongly-related images was designed. Then based on the relative position and attitude parameter of the images

the least square method was adopted to work out the consistency rotation parameter

the three views constraint and linear programming were used to solve the consistency location parameter

and then a bundle method-based adjustment optimization was conducted. It indicates that the operating speed of this method is at least 2.6 times faster than that of the typical incremental Bundler algorithm

the three-dimensional points increased by 76.5%

and it can more closely recover the original geometry form. This method

while perfecting the reconstruction effect

improves the treatment efficiency and can meet the requirement for quick response of UAV.

关键词

Keywords

references

李德仁, 李明. 无人机遥感系统的研究进展与应用前景[J]. 武汉大学学报·信息科学版,2014,39(5):505-513. LI D R, LI M. Research advance and application prospect of unmanned aerial vehicle remote sensing system [J]. Geomatics and Information Science of Wuhan University, 2014, 39(5): 505-513. (in Chinese)

XIANG H T, TIAN L. Method for automatic georeferencing aerial remote sensing images from an unmanned aerial vehicle (UAV) platform [J]. Biosystem Engineering, 2011, 108(2): 104-113.

王欣,袁坤,于晓,等. 基于运动恢复的双目视觉三维重建系统设计[J]. 光学精密工程,2014,22(5):1379-1387. WANG X, YUAN K, YU X, et al.. Design of binocular vision 3D reconstruction system based on motion recovery [J]. Opt. Precision Eng., 2014, 22(5):1379-1387. (in Chinese)

林义闽,吕乃光,娄小平,等. 用于弱纹理场景三维重建的机器人视觉系统[J]. 光学精密工程,2015,23(2):540-549. LIN Y M, LV N G, LOU X P, et al.. Robot vision system for 3D reconstruction in low texture environment [J]. Opt. Precision Eng., 2015, 23(2):540-549. (in Chinese)

张来刚,魏仲慧,何昕,等. 面向低纹理图像的快速立体匹配[J]. 液晶与显示,2013,28(3):450-458. ZHANG L G, WEI ZH H, HE X, et al.. New stereo matching method based edge extraction [J]. Chinese Journal of Liquid Crystals and Displays, 2013, 28(3):450-458. (in Chinese)

AGARWAL S, FURUKAWA Y, SNAVELY N, et al.. Building rome in a day [J]. Communications of the ACM, 2011, 54(10): 105-112.

KERSTEN T P, LINDSTAEDT M. Potential of automatic 3D object reconstruction from multiple images for applications in architecture, cultural heritage and archaeology [J]. International Journal of Heritage in the Digital Era, 2012, 1(3):399-420.

TURNER D, LUCIEER A. Using a micro Unmanned Aerial Vehicle (UAV) for ultra high resolution mapping and monitoring of landslide dynamics [C]. Proceedings of 2013 IEEE International Geoscience and Remote Sensing Symposium, Melbourne, Australia: IEEE, 2013: 3883-3886.

SHUM H Y, KE Q F, ZHANG Z Y. Efficient bundle adjustment with virtual key frames: a hierarchical approach to multi-frame structure from motion [C]. Proceedings of 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Fort Collins, CO, USA: IEEE, 1999: 538-543.

GHERARDI R, FARENZENA M, FUSIELLO A. Improving the efficiency of hierarchical structure-and-motion [C]. Proceedings of 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA: IEEE, 2010: 1594-1600.

卢俊,张保明,欧小平,等. 利用凝聚层次聚类的多视影像重建算法[J]. 测绘科学技术学报,2015,32(2):157-163. LU J, ZHANG B M, OU X P, et al.. A reconstruction algorithm of multi-view images using agglomerative hierarchical clustering [J]. Journal of Geomatics Science and Technology, 2015, 32(2): 157-163. (in Chinese)

许志华,吴立新,刘军,等. 顾及影像拓扑的SfM算法改进及其在灾场三维重建中的应用[J]. 武汉大学学报·信息科学版,2015,40(5):599-606. XU ZH H, WU L X, LIU J, et al.. Modification of SfM algorithm referring to image topology and its application in 3-Dimension reconstruction of disaster area [J]. Geomatics and Information Science of Wuhan University, 2015,40(5): 599-606. (in Chinese)

曹雪峰,王庆贺,谢理想. 融合低精度GPS/IMU参数的无人机影像批处理三维重建方法[J]. 系统仿真学报,2015,27(10):2409-2415,2421. CAO X F, WANG Q H, XIE L X. Batched 3D reconstruction of UAV images fused low precision and orientation parameters [J]. Journal of System Simulation, 2015, 27(10):2409-2415,2421. (in Chinese)

王向军,万子敬,王鑫,等. 无人机地面目标实时自主视觉定位[J]. 红外与激光工程,2014,43(2):615-619. WANG X J, WAN Z J, WANG X, et al.. Ground targets location of UAV using vision location method [J]. Infrared and Laser Engineering, 2014, 43(2): 615-619. (in Chinese)

HONG H Y, FAN Y, DENG Z Y, et al.. Three-dimension deblurring algorithm for multiple observed images of moving object [J]. Infrared and Laser Engineering, 2016, 45(2): 1-8.

宋悦铭,孙敬辉,王帅. 基于GPS基准点的航空吊舱垂直下视目标定位方法研究[J]. 液晶与显示,2012,27(5):713-717. SONG Y M, SUN J H, WANG SH. Air pod target location method research using GPS datum mark in vertical down of view [J].Chinese Journal of Liquid Crystals and Displays, 2012, 27(5): 713-717. (in Chinese)

Views

533

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Polarized light/MIMU integrated navigation SHKF attitude solving algorithm for motion acceleration suppression

UAV target positioning integrating multi-dimensional attitude adaptive sensing

Adaptive octree 3D image reconstruction based on plane patch

Multi-target geo-location based on airborne optoelectronic platform

Three-dimensional reconstruction of large-scale scene based on depth camera

Related Author

ZHANG Ran

LIU Chen

ZHOU Zijian

PEI Sen

JIN Rencheng

HUANG Daqing

LING Zhicheng

LEI Zhongkui

Related Institution

Key Laboratory for Micro/Nano Technology and System of Liaoning Province ofDalian University of Technology

College of Astronautics， Nanjing University of Aeronautics and Astronautics

Nanjing Changkong Technology Co.， Ltd.

Unmanned Aerial Vehicles Research Institute， Nanjing University of Aeronautics and Astronautics

College of Electronic Information Engineering， Nanjing University of Aeronautics and Astronautics

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰