Turbulence distorted image correction using affine transformation and multilevel B-spline registration

ZHANG Jiao; LI Jun-shan; YANG Ya-wei

doi:10.3788/OPE.20152303.0846

您当前的位置：

首页 >

文章列表页 >

Turbulence distorted image correction using affine transformation and multilevel B-spline registration

更新时间：2020-08-13

- Turbulence distorted image correction using affine transformation and multilevel B-spline registration
- Optics and Precision Engineering Vol. 23, Issue 3, Pages: 846-854(2015)
- 作者机构：
  
  1. 第二炮兵工程大学信息工程系,陕西西安,710025
  2. 96215部队,广西柳州,545616
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20152303.0846
  CLC： TN919.8;TP391
- Received：05 November 2014，
  
  Revised：31 December 2014，
  
  Published：25 March 2015
- 稿件说明：
移动端阅览
张姣, 李俊山, 杨亚威. 结合仿射变换和多层B样条配准的湍流畸变图像校正[J]. 光学精密工程, 2015,23(3): 846-854

ZHANG Jiao, LI Jun-shan, YANG Ya-wei. Turbulence distorted image correction using affine transformation and multilevel B-spline registration[J]. Editorial Office of Optics and Precision Engineering, 2015,23(3): 846-854
张姣, 李俊山, 杨亚威. 结合仿射变换和多层B样条配准的湍流畸变图像校正[J]. 光学精密工程, 2015,23(3): 846-854 DOI： 10.3788/OPE.20152303.0846.

ZHANG Jiao, LI Jun-shan, YANG Ya-wei. Turbulence distorted image correction using affine transformation and multilevel B-spline registration[J]. Editorial Office of Optics and Precision Engineering, 2015,23(3): 846-854 DOI： 10.3788/OPE.20152303.0846.

摘要

为解决大气湍流引起的图像抖动和图像偏移问题

提出了一种结合仿射变换和多层B样条配准的图像校正方法。由于湍流像素偏移具有非线性和随机性

且序列中常伴有成像系统运动引起目标全局运动

该方法将像素校正分为整体运动校正和局部非刚性配准两部分。采用仿射变换描述目标整体运动;引入多分辨率策略处理像素偏移

利用多层B样条对湍流引起的局部形变进行非刚性配准。基于对称约束的代价函数

通过梯度判定感兴趣区域

进一步细化控制点网格提高B样条配准精度。最后

采用有限内存拟牛顿法优化代价函数

得到像素偏移量

实现畸变图像的像素校正。对真实图像和实际序列图像分别进行了实验

结果表明:该方法能够有效降低湍流造成像素偏移畸变

在噪声和模糊干扰下校正结果依然理想。

Abstract

A correction method for distortion sequences was proposed based on affine transform and multilevel B-spline registration to overcome the image distortion and pixel deviation from the atmospheric turbulence. As the pixel deviation caused by turbulence is nonlinear and random

and the global motion caused by the imaging system movement might exist in practice

the correction method divided the pixel into two parts

the global motion estimation and the local non-rigid registration. The affine transformation was adopted to eliminate the global motion. The multi-resolution strategy was introduced to process pixel distortion and the multilevel B-spline was adopted to register the local motion. On the basis of the symmetry constraint cost function

the control point gridding was fined further to improve the B-spline accuracy by evaluating the regions of interest with the gradient method. Finally

limited-memory Broyden-Fletcher-Glodfarb-Shanno (L-BFGS) algorithm was used to minimize the cost function to obtain the pixel deviation and to complement the correction of image distortion. Experiments demonstrate that the proposed method effectively reduces the pixel distortion from the atmospheric turbulence even for noisy and blurred conditions.

关键词

Keywords

references

殷兴良. 气动光学原理 [M]. 北京:中国宇航出版社, 2003. YIN X L. Principle of Aero-optics [M]. Beijing:China Astronautics Press, 2003. (in Chinese)

LI D, SIMSKE S. Atmospheric turbulence degraded-image restoration by kurtosis minimization [J]. IEEE Geoscience and Remote Sensing Letters, 2009, 6(2):244-247.

洪汉玉, 张天序. 基于多分辨率盲目去卷积的气动光学效应退化图像复原算法 [J]. 计算机学报, 2004, 27 (7):952-963. HONG H Y, ZHANG T X. Investigation of restoration algorithm for degraded images caused by aero-optics effects using multi-resolution blind deconvolution [J]. Chinese Journal of Computers, 2004, 27 (7):952-963. (in Chinese)

张士杰, 李俊山, 杨亚威, 等. 湍流退化红外图像降晰函数辨识 [J]. 光学精密工程, 2013, 21(2):514-521. ZHANG SH J, LI J SH, YANG Y W, et al.. Blur identification of turbulence-degraded IR images [J]. Opt. Precision Eng., 2013, 21(2):514-521. (in Chinese)

罗林, 樊敏, 王黎, 等. 空间扩展目标对准误差图像的高分辨率复原 [J]. 红外与毫米波学报, 2007, 26(5):372-376. LUO L, FAN M, WANG L, et al.. High resolution restoration of the space extended object images with collimate fault [J]. Journal of Infrared and Millimeter Waves, 2007, 26(5):372-376. (in Chinese)

耿则勋, 魏小峰, 沈忱. 结合参数估计的天文图像极大似然恢复 [J]. 光学精密工程, 2013, 21(11):2943-2950. GENG Z X, WEI X F, SHEN CH. Astronomical image restoration based on maximum-likelihood incorporated parameter estimation [J]. Opt. Precision Eng., 2013, 21(11):2943-2950. (in Chinese)

HONG H Y, LI L C, ZHANG X Y. Blind restoration of real turbulence-degraded image with complicated backgrounds using anisotropic regularization [J]. Optics Communications, 2012, 285(24):4977-4986.

黄建明, 沈忙作. 基于噪声特征的大气湍流退化图像多帧盲反卷积复原 [J]. 光学学报, 2008, 28(9):1686-1690. HUANG J M, SHEN M Z. Blind deconvolution restoration of atmospheric turbulence-degraded images based on noise characteristic [J]. Acta Optical Sinica, 2008, 28(9):1686-1690. (in Chinese)

LI D, MERSEREAU R M, SIMSKE S. Atmospheric turbulence-degraded image restoration using principal components analysis [J]. IEEE Geoscience and Remote Sensing Letters, 2007, 4(3):340-344.

ZHU X, MILANFAR P. Removing atmospheric turbulence via space-invariant deconvolution [J]. IEEE Transaction on Pattern Analysis and Machine Intelligence, 2013:35(1):157-170.

刘纯胜, 卢晓芬, 洪汉玉, 等. 基于特征点配准的气动光学图像校正方法研究 [J]. 系统工程与电子技术, 2006, 28(10):1468-1469. LIU CH SH, LU X F, HONG H Y, et al.. Investigation on the correction method of distorted image caused by aero-optic effects based on matching of feature points [J]. Systems Engineering and Electronics, 2006, 28(10):1468-1469. (in Chinese)

卢晓芬, 张天序, 洪汉玉. 气动光学效应像素偏移图像校正方法研究 [J]. 红外与激光工程, 2007, 36(5):758-761. LU X F, ZHANG T X, HONG H Y. Image correction method with pixel deviation caused by aero-optics effects [J]. Infrared and Laser Engineering, 2007, 36(5):758-761. (in Chinese)

MAO Y, GILLES J, ESEDOGLU S. Non-rigid geometric distortions correction-application to atmospheric turbulence stabilization [J]. Inverse Problems and Imaging, 2012, 6:531-546.

SHIMIZU M, YOSHIMURA S, TANAKA M, et al.. Super-resolution from image sequence under influence of hot-air optical turbulence [C]. IEEE Conference on Computer Vision and Pattern Recognition, Alaska, USA:IEEE press, 2008:1-8.

MODAT M, RIDGWAY G R, TAYLOR Z A, et al.. Fast free-form deformation using graphics processing units [J]. Computer Methods and Programs in Biomedicine, 2010, 98(3):278-284.

SZELISKI R, COUGHLAN J. Spline-based image registration [J]. International Journal of Computer Vision, 1997, 22(93):199-218.

RUECKERT D, SONODA L. Non-rigid registration using free-form deformation:application to breast MR images [J]. IEEE Transactions on Medical Image, 1999, 8(18):713-715.

LEE S, WOLBERG G, SHIN S Y. Scattered data interpolation with multilevel B-splines [J]. IEEE Transactions on Visualization and Computer Graphics, 1997, 3(3):228-244.

ZITOVA B, FLUSSER J. Image registration methods:a survey [J]. Image and Vision Computing, 2003, 21(11):977-1000.

王敏尤, 胡海波, 秦斌杰. 基于光流和多层次B样条自由形变的医学图像鲁棒形变配准 [J]. 上海交通大学学报, 2008, 42(10):1661-1664. WANG M Y, HU H B, QIN B J. Robust deformable medical image registration using optical flow and multilevel free form deformation [J]. Journal of Shanghai Jiaotong University, 2008, 42(10):1661-1664. (in Chinese)

ZHU C, BYRD R H, LU P, et al.. Algorithm 778:L-BFGS-B:Fortran subroutines for large-scale bound constrained optimization [J]. ACM Transactions on Mathematical Software, 1997, 23(4):550-560.

MOEALES J L, NOCEDAL J. Remark on “algorithm 778:L-BFGS-B:Fortran subroutines for large-scale bound constrained optimization” [J]. ACM Transactions on Mathematical Software, 2011, 38(1):7.

丁辉, 张兴敢, 唐岚. 基于有限内存Broyden-Fletcher-Glodfarb-Shanno优化算法的图像非刚性配准方法 [J]. 南京大学学报:自然科学版, 2011, 47(4):432-437. DING H, ZHANG X G, TANG L. Non-rigid registration based on Basic-spline free form deform and limited memory Broyden-Fletcher-Glodfarb-Shanno optimal algorithm [J]. Journal of Nanjing University:Natural sciences, 2011, 47(4):432-437. (in Chinese)

Views

763

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Image correction for high speed scanning confocal laser endomicroscopy

Improved distortion correction method for spacial large aperture tracking cameras

Simulation system of high accuracy star images based on star sensor

Camera nonlinear distortion correction based on coplanar points

Correction of distortion in microscopic imaging with resonant scanning

Related Author

Bao-teng XU

Xi-bin YANG

Jia-lin LIU

Wei ZHOU

Hao-ran TIAN

Da-xi XIONG

Xiao-yan LI

Yu-jun TANG

Related Institution

Center of Optics and Health, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences

University of Chinese Academy of Sciences,, Chin

Key Laboratory of Intelligent Infrared Perception, Chinese Academy of Sciences

Key Laboratory of Photoelectronic Imaging Technology and System of the Ministry of Education, Beijing Institute of Technology

School of Optics and Electronics, Beijing Institute of Technology

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰