Automatic correction of geometric distortion in aerial zoom squint imaging

ZHOU Qian-fei; LIU Jing-hong; WANG Xuan; SUN Ming-chao

doi:10.3788/OPE.20152310.2927

您当前的位置：

首页 >

文章列表页 >

Automatic correction of geometric distortion in aerial zoom squint imaging

Information Sciences | 更新时间：2020-08-13

- Automatic correction of geometric distortion in aerial zoom squint imaging
- Optics and Precision Engineering Vol. 23, Issue 10, Pages: 2927-2942(2015)
- 作者机构：
  
  1. 中国科学院大学北京,中国,100049
  2. 中国科学院长春光学精密机械与物理研究所中国科学院航空光学成像与测量重点实验室,吉林长春,130033
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20152310.2927
  CLC： V248.3;TP391
- Received：07 November 2014，
  
  Revised：22 December 2014，
  
  Published：25 October 2015
- 稿件说明：
移动端阅览
周前飞, 刘晶红, 王宣等. 航空变焦距斜视成像几何畸变的自动校正[J]. 光学精密工程, 2015,23(10): 2927-2942

ZHOU Qian-fei, LIU Jing-hong, WANG Xuan etc. Automatic correction of geometric distortion in aerial zoom squint imaging[J]. Editorial Office of Optics and Precision Engineering, 2015,23(10): 2927-2942
周前飞, 刘晶红, 王宣等. 航空变焦距斜视成像几何畸变的自动校正[J]. 光学精密工程, 2015,23(10): 2927-2942 DOI： 10.3788/OPE.20152310.2927.

ZHOU Qian-fei, LIU Jing-hong, WANG Xuan etc. Automatic correction of geometric distortion in aerial zoom squint imaging[J]. Editorial Office of Optics and Precision Engineering, 2015,23(10): 2927-2942 DOI： 10.3788/OPE.20152310.2927.

摘要

针对变焦距航空摄像机斜视成像产生的几何变形

提出一种同时校正斜视梯形失真和变焦距镜头非线性畸变的自动校正方法。根据直线透视投影不变性原理

利用单参数除式模型通过变步长优化搜索方法得到不同焦距对应的镜头畸变系数和畸变中心坐标;研究了焦距变化对畸变的影响规律

校正了镜头畸变使其满足针孔成像模型;引入飞机位置、姿态和摄像机视轴指向方位等因素

将航空图像重投影到地图坐标系中

对坐标变换后的像素亮度值进行重采样得到校正斜视变形和镜头畸变后的正射投影图像。对不同焦距和位置姿态下拍摄的地面靶标畸变图像和实际航空变焦距斜视图像进行了校正。结果表明

该方法能够有效准确地校正图像的几何变形

当飞行高度为2 500 m时

在文中给定的位置姿态精度下的图像几何校正均方误差约为2 m

较好地满足了后续图像拼接需求。该方法效率高

便于自动化实现

对提高图像拼接精度和实现目标精确定位与实时稳定跟踪具有重要意义。

Abstract

For geometric distortion caused by squint imaging of a zoom aerial camera

an automatic simultaneously correction method for both squint trapezoidal distortion and nonlinear distortion of the zoom lens was proposed. Based on the same geometric type between straight line and its ideal projection image

the one-parameter division model was adopted to estimate the distortion coefficient and the distortion center coordinates at different focal lengths by an optimization searching method of variant step length. The effects of focal distance change on the distortion coefficient and distortion center coordinates were researched

then the lens's distortion was corrected to satisfy the ideal pinhole imaging model. By introducing the position and attitude of airplane and the pointing azimuth of the optical axis for the camera

the oblique aerial images specified in the camera frame were georectified into the mapping frame. The pixel intensity after coordinate transformation was resampled to obtain orthorectified images without the lens distortion and squint distortion. The correction experiments were performed for the distortion patterns captured under various focal lengths

positions and attitudes and the actual aerial zoom oblique images

and the results show that this method effectively and accurately corrects the geometric distortion of images. The Root Mean Square Error (RMSE) of image geometric correction is about 2 m when the flight height is 2 500 m with the position and attitude measurement precision given in this article.The precision satisfies the requirements of the follow-up image mosaicing. It concludes that the method is more efficient

easy to realize in automation and has great signifiance for promoting aerial image mosaicing precision

implementing fast positioning and real-time tracking of moving objects.

关键词

Keywords

references

田铁印,王红. 长焦距大口径连续变焦距光学系统[J]. 光学精密工程,2014,22(9):2369-2374. TIAN T Y, WANG H. Optical zoom system with long focal length and large aperture[J].Opt. Precision Eng.,2014, 22(9):2369-2374.(in Chinese)

兰海滨,王平,龙腾. 图像拼接中相机镜头非线性畸变的校正[J]. 光学精密工程,2009,17(5):1197-1201. LAN H B, WANG P, LONG T. Nonlinear aberration correction of lens in image mosaic [J]. Opt. Precision Eng., 2009, 17(5):1197-1201. (in Chinese)

李静宇,王延杰. 基于子空间的目标跟踪算法研究[J]. 液晶与显示,2014,29(4):617-619. LI J Y, WANG Y J. Subspace based target tracking algorithm[J].Chinese Journal of Liquid Crystals and Displays, 2014, 29(4): 617-619.(in Chinese)

朱倩,李霞,李少峰. 基于有理函数模型和多项式模型的天绘一号影像几何校正精度评估[J]. 中国科学技术大学学报,2013,43(2):111-114. ZHU Q, LI X, LI SH F. Accuracy assessment of TH-1 satellite image geometric correction using rational function model and polynomial model[J].Journal of University of Science and Technology of China, 2013, 43(2):111-114.(in Chinese)

厍向阳,李崇贵,姚顽强. 遥感图像几何校正的支持向量机算法研究[J]. 西安电子科技大学学报:自然科学版,2011,38(5):121-128. SHE X Y, LI CH G, YAO W Q. Research on the geometric correction algorithm for the remote sensing image by a support vector machine [J].Journal of Xidian University, 2011, 38(5):121-128.(in Chinese)

张谦,贾永红,吴晓良,等. 一种带几何约束的大幅面遥感影像自动快速配准方法[J]. 武汉大学学报:信息科学版,2014,39(1):17-21. ZHANG Q, JIA Y H, WU X L, et al.. A rapid image registration method based on restricted geometry constraints for large-size remote sensing image[J].Geomatics and Information Science of Wuhan University, 2014, 39(1):17-21. (in Chinese)

ZHOU G Q. Near real-time orthorectification and mosaic of small UAV video flow for time-critical event response [J]. IEEE Trans. on Geoscience and Remote Sensing, 2009, 47(3):739-746.

胡春晖,颜昌翔,邵建兵. 指向镜低频正弦振动下遥感器图像的畸变及校正[J]. 光学学报,2013,33(4):0428002. HU CH H, YAN CH X, SHAO J B. Pointingmirror low frequency sineoscillation inducedremotesensor Image distortion and correction[J]. Acta Optica Sinica, 2013, 33(4):0428002. (in Chinese)

张峰,江桦,闫镔,等. 锥束CT圆轨迹半覆盖扫描的几何校正[J]. 光学精密工程,2013,21(7):1659-1665. ZHANG F, JIANG H, YAN B, et al.. Geometric calibration for half-cover scanning incircular cone-beam CT [J]. Opt. Precision Eng., 2013, 21(7):1659-1665.(in Chinese)

TSAI R Y. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses[J]. IEEE Journal of Robotics and Automation, 1987, 3(4): 323-344.

ZHANG Z Y. A flexible new technique for camera calibration[J]. IEEE Trans. on Pattern Analysis and Machine Intelligence, 2000, 11(22): 1330-1334.

徐芳,刘晶红,王宣. 基于标定的CCD图像畸变校正方法研究[J]. 液晶与显示,2013,33(9):2623-2626. XU F, LIU J H, WANG X. The study on distortion correction method for CCD image based on calibration[J]. Chinese Journal of Liquid Crystals and Displays,2013,33(9):2623-2626.(in Chinese)

XIANG H T, TIAN L. Method for automatic georeferencing aerial remote sensing (RS) images from an unmanned aerial vehicle (UAV) platform[J]. Biosystems Engineering,2011,108:104-113.

陈天飞,马孜,吴翔,等. 摄像机镜头畸变的鲁棒校正方法[J]. 控制与决策,2013,28(3):461-465. CHEN T F, MA Z, WU X, et al.. Robust correction method for camera lens distortion[J].Control and Decision, 2013, 28(3):461-465. (in Chinese)

刘超,李醒飞,郭敬滨,等. 基于共线点的镜头畸变校正方法[J]. 计算机应用,2013,33(12) : 3555-3558. LIU CH, LI X F, GUO J B, et al.. Lens distortion correction method based on collinear points [J]. Journal of Computer Applications, 2013, 33(12) : 3555-3558.(in Chinese)

AI S J, WANG X, MA M CH, et al.. A method for correcting non-linear geometric distortion in ultra-wide-angle imaging system[J]. Optik, 2013 (124) :7014-7021.

张艳珍,欧宗瑛,薛斌党. 一种基于斜率的摄像机畸变校正方法[J]. 小型微型计算机系统,2002, 23(5): 625-627. ZHANG Y ZH, OU Z Y, XUE B D. Error correction method based on slope for camera radial distortion [J]. Mini-micro System, 2002, 23(5):625-627. (in Chinese)

刘丹,刘学军,王美珍. 由灭点进行径向畸变的自动校正[J]. 中国图象图形学报, 2014, 19(3):407-413. LIU D, LIU X J, WANG M ZH. Automatic approach of lens radial distortion correction based on vanishing points[J].Journal of Image and Graphics, 2014, 19(3):407-413. (in Chinese)

徐嵩,孙秀霞,刘树光,等. 摄像机畸变标定的模型参考逼近方法[J]. 光学学报,2013,33(7):231-242. XU S, SUN X X, LIU SH G, et al.. Model reference approaching method of camera distortion calibration [J]. Acta Optica Sinica, 2013, 33(7):231-242. (in Chinese)

苏成志,王恩国,郝江涛,等. 平面几何测量中的图像畸变校正[J]. 光学精密工程,2011,19(1):161-167. SU CH ZH, WANG EN G, HAO J T, et al.. Distortion correction for images in planar metrology [J]. Opt. Precision Eng., 2011, 19(1):161-167. (in Chinese)

胡浩,梁晋,唐正宗,等. 显微立体视觉小尺度测量系统的标定[J]. 光学精密工程,2014,22(8):1985-1994. HU H, LIANG J, TANG ZH Z, et al.. Calibration of stereo microscope measurement systems [J]. Opt. Precision Eng., 2014, 22(8):1985-1994.(in Chinese)

FAISAL B, MATTHEW N D. Automatic radial distortion estimation from a single image[J]. J. Math Imaging Vis, 2013, 45:31-45.

FITZGIBBON A W. Simultaneous linear estimation of multiple view geometry and lens distortion[C].Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2001:125-132.

CAI J H, STAN M. Automatic curve selection for lens distortion correction using Hough transform energy[C].2013 IEEE Workshop on Applications of Computer Vision (WACV), Tampa, FL, 455-460

GOLJAN M, FRIDRICH J. Estimation of lens distortion correction from single images[C]. Proc. SPIE 9028, Media Watermarking, Security, and Forensics 2014, 90280N.

MICHAEL S B, YAU C T. Geometric and shading correction for images of printed materials using boundary[J]. IEEE Trans. on Image Processing, 2006, 15(6): 1544-1554.

PARK J H,BYUN S CH,LEE B U.Lens distortion using iudeal image coordinates[J].IEEE Trans. on Consumer Electronics, 2009, 55(3):987-991.

汪贵平,王会峰,刘盼芝,等. 特征平行直线的成像畸变现场校正[J]. 光子学报,2014,43(1):0111001. WANG G P, WANG H F, LIU P ZH, et al.. A distortion field-calibrating method based on feature parallel lines of image [J]. Acta Photonica Sinica, 2014, 43(1): 0111001. (in Chinese)

Views

700

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Fast calibration for single camera space coordinate measuring system with large field of view

High precision calibration of vision measurement system in large FOV based on virtual 3D target

Application of the nonlinear mapping method in the foot scanner's automatic camera calibration

Calibration of lens distortion parameters based on two view geometry of translation motion

Calibration of binocular vision measurement system

Related Author

Xiang-Jun WANG

Zi-xian DENG

Yu CAO

Feng LIU

Dong-qin CHENG

Wei LI

Xi ZHANG

CHEN Shuo

Related Institution

State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University

Key Laboratory of MOEMS of the Ministry of Education, Tianjin University

School of Mechatronic Engineering and Automation, Shanghai University

北京信息科技大学仪器科学与光电工程学院

School of Mechanical Engineering, Dalian University of Technology

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰