Sub-pixel image registration based on super resolution reconstruction

Fang-biao LI; Xin HE; Zhong-hui WEI; Xin MA

doi:10.3788/OPE.20172402.0477

您当前的位置：

首页 >

文章列表页 >

Sub-pixel image registration based on super resolution reconstruction

Information Sciences | 更新时间：2020-07-07

- Sub-pixel image registration based on super resolution reconstruction
- Optics and Precision Engineering Vol. 25, Issue 2, Pages: 477-484(2017)
- 作者机构：
  
  1.中国科学院长春光学精密机械与物理研究所, 吉林长春 130033
  2.中国科学院大学, 北京 100049
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20172402.0477
  CLC： TP391.4
- Received：21 July 2016，
  
  Accepted：20 September 2016，
  
  Published：25 February 2017
- 稿件说明：
移动端阅览
Fang-biao LI, Xin HE, Zhong-hui WEI, et al. Sub-pixel image registration based on super resolution reconstruction[J]. Optics and precision engineering, 2017, 25(2): 477-484.
DOI：

Fang-biao LI, Xin HE, Zhong-hui WEI, et al. Sub-pixel image registration based on super resolution reconstruction[J]. Optics and precision engineering, 2017, 25(2): 477-484. DOI： 10.3788/OPE.20172402.0477.

摘要

针对低分辨率图像在配准过程中精度较低的问题，提出了一种基于超分辨率重建的亚像素图像配准方法。首先，对具有1至9像素位移的图像序列进行10倍降采样，获取具有0.1至0.9亚像素位移的图像序列。然后，根据图像的获取过程建立数学模型，以Bayes理论为基础，使用最大后验概率法（MAP）对亚像素位移低分辨率图像进行超分辨率重建，获取高分辨率图像。最后，使用具有亚像素配准精度的扩展相位相关法对图像进行配准。配准实验与噪声实验表明，所提方法的最大配准误差为0.03 pixel，能实现对低分辨率图像的亚像素级配准，具有配准精度高、噪声抗干扰能力强等特点，可同时满足可见光图像与红外图像的高精度配准要求。

Abstract

Considering the low precision of low-resolution image used for the registration process

a sub-pixel image registration method based on super resolution reconstruction was put forward. Firstly

10 times down-sampling was carried out in the image sequence with 1~9 pixel displacement to obtain an image sequence with 0.1~0.9 sub-pixel displacement; then

a mathematical model was built in accordance with the image acquisition process

and Maximum A-Posteriori (MAP) method was used to carry out super resolution reconstruction in low-resolution image of the sub-pixel displacement to obtain high-resolution image based on the Bayes Theory; finally

the extended phase correlation method with sub-pixel registration accuracy was applied to conduct image registration. The registration and noise experiments inclicate that the maximum registration error is 0.03 pixel. The proposed method has high registration accuracy and strong anti-noise ability. It can realize the sub-pixel registration for low-resolution image

at the same time

it can meet the requirements for high-accuracy registration of visible image and infrared image.

关键词

Keywords

references

李英杰, 张俊举, 常本康, 等.远距离多波段红外图像融合系统及配准方法[J].红外与激光工程, 2016, 45(5):(0526002)1-7.

LI Y J, ZHANG J J, CHANG B K, et al.. Remote multiband infrared image fusion system and registration method[J]. Infrared and Laser Engineering, 2016, 45(5):(0526002)1-7. (in Chinese)

LAHIRI B B, BAGAVATHIPPAN S, JAYAKUMAR T, et al.. Medical applications of infrared thermography:a review[J]. Infrared Physics and Technology, 2012, 55(4):221-235.

翟海天, 李辉, 李彬.基于区域划分的红外超分辨率重建[J].光学精密工程, 2015, 23(10):2989-2996.

ZHAI H T, LI H, LI B. Infrared super resolution reconstruction based on region division[J].Opt. Precision Eng., 2015, 23(10):2989-2996. (in Chinese)

PARK S W, CHANG J, CHOI J, et al.. Construction of super resolution imaging system considering spatially varying sub-pixel registration[C]. Photoelectronic Technology Committee Conferences, 2010, 772361-772367.

王志强, 程红, 杨桄, 等.全局图像配准的目标快速定位方法[J].红外与激光工程, 2015, 44(S):225-229.

WANG ZH Q, CHENG H, YANG G, et al.. Fast target location method of global image registration[J]. Infrared and Laser Engineering, 2015, 44(S):225-229. (in Chinese)

王运, 颜昌翔.光谱仪图像的亚像素配准[J].光学精密工程, 2012, 20(3):661-667.

WANG Y, YAN C X. Sub-pixel image registration of spectrometer images[J].Opt. Precision Eng., 2012, 20(3):661-667. (in Chinese)

郭萌, 赵岩, 王世刚, 等.基于区域选择的红外弱小目标超分辨率复原算法[J].液晶与显示, 2016, 31(4):415-420.

GUO M, ZHAO Y, WANG SH G, et al.. Infrared dim-small target super-resolution restoration algorithm based on region selection[J]. Chinese Journal of Liquid Crystals and Displays, 2016, 31(4):415-420. (in Chinese)

ZHOU F, YANG W, LIAO Q. A coarse-to-fine subpixel registration method to recover local perspective deformation in the application of image super-resolution[J]. IEEE Transactions on Image Processing, 2012, 21(1):53-66.

刘卫光, 崔江涛, 周利华.插值和相位相关的图像亚像素配准方法[J].计算机辅助设计与图形学学报, 2005, 17(6):1273-1277.

LIU W G, CUI J T, ZHOU L H. Subpixel registration based on interpolation and extension phase correlation[J].Journal of Computer-Aided Design & Computer Graphics, 2005, 17(6):1273-1277. (in Chinese)

REN J CH, JIANG J M, VLACHOS T. High-accuracy sub-pixel motion estimation from noise image in fourier domain[J]. IEEE Transactions on Image Processing, 2010, 19(5):1379-1384.

XU X, ZHONG Y F, ZHANG L P, et al.. Sub-pixel mapping based on a MAP model with multiple shifted hyperspectral imagery[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2013, 6(2s):580-593.

李含伦, 张爱武, 孟宪刚, 等.一种利用Fourier-Mellin变换和曲线拟合的遥感图像亚像素配准方法[J].小型微型计算机系统, 2015, 36(12):2763-2768.

LI H L, ZHANG A W, MENG X G, et al.. A remote sensing image sub-pixel registration method based on curve fitting and improved Fourier-Mellin transform[J].Journal of Chinese Computer Systems, 2015, 36(12):2763-2768. (in Chinese)

FOROOSH H, ZERUBIA J, BERTHOD M. Extension of phase correlation to sub-pixel registration[J]. IEEE Trans. Image Processing, 2002, 11(3):188-120.

BALCI M, FOROOSH H. Subpixel registration directly from the phase difference[J]. EURASIP Journal on Applied Signal Processing Volume, 2006:60796.

张振东, 陈建, 王伟国, 等.基于SSIM_NCCDFT的超分辨率复原评价方法研究[J].液晶与显示, 2015, 30(4):713-721.

ZHANG ZH D, CHEN J, WANG W G, et al.. Evaluation method of super-resolution restoration based on SSIM_NCCDFT[J]. Chinese Journal of Liquid Crystals and Displays, 2015, 30(4):713-721. (in Chinese)

彭羊平, 宁贝佳, 高新波.基于非负邻域嵌入和非局部正则化的单帧图像超分辨率重建算法[J].计算机科学, 2015, 42(11):104-107, 143.

PENG Y P, NING B J, GAO X B. Single-frame image super-resolution reconstruction algorithm based on nonnegative neighbor embedding and non-local means regularization[J]. Computer Science, 2015, 11(42):104-107, 143. (in Chinese)

卜莎莎, 章毓晋.基于局部约束线性编码的单帧和多帧图像超分辨率重建[J].吉林大学学报 (工学版), 2013, 43(S3), 365-370.

BU SH SH, ZHANG Y J. Single-frame and multi-frame image super-resolution reconstruction based on locality-constrained linear coding[J]. Journal of Jilin University (Engineering and Technology Edition), 2013, 43(S3), 365-370. (in Chinese)

邓承志, 田伟, 汪胜前, 等.近似稀疏正则化的红外图像超分辨率重建[J].光学精密工程, 2014, 22(6):1648-1654.

DENG CH ZH, TIAN W, WANG SH Q, et al..Super-resolution reconstruction of approximate sparsity regularized infrared images[J]. Opt. Precision Eng., 2014, 22(6):1648-1654. (in Chinese)

龚卫国, 潘飞宇, 李进明.用双层重建法实现单幅图像的超分辨率重建[J].光学精密工程, 2014, 22(3):720-729.

GONG W G, PEN F Y, LI J M. Single-image super-resolution reconstruction via double layer reconstructing[J]. Opt. Precision Eng., 2014, 22(3):720-729. (in Chinese)

李展, 陈清亮, 彭青玉, 等.基于MAP的单帧字符图像超分辨率重建[J].电子学报, 2015, 43(1):191-197.

LI ZH, CHEN Q L, PENG Q Y, et al..MAP-based single-frame super-resolution reconstruction for character image[J]. Acta Electronica Sinica, 2015, 43(1):191-197. (in Chinese)

LI Y J, JI M, HE J F, et al..Improvement of sub-pixel global motion estimation in UAV image stabilization[C]. Photoelectronic Technology-Committee Conferences, 2015.

Views

119

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Infrared super resolution reconstruction based on region division

Sub-pixel image registration of spectrometer images

Improved phase correlation and clustering ideas for Micro-LED chip microscopic image stitching

Infrared-visible remote sensing image registration method based on Kullback-Leibler divergence using variational approximation

Multispectral image fusion method for surface defect detection of IC devices

Related Author

ZHAI Hai-tian

LI Hui

LI Bin

WANG Yun

YAN Chang-xiang

LIN Jianpu

WANG Tingyu

CAI Bipeng

Related Institution

School of Electronics and Information, Northwestern Polytechnical University

Graduate University of Chinese Academy of Sciences

School of Physics and Information Engineering，Fuzhou University

School of Advanced Manufacturing，Fuzhou University

China Fujian Photoelectric Information Science and Technology Innovation Laboratory

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰