Corrected fast SIFT image stitching method by combining projection error

Yan ZHAO; Yue CHEN; Shi-gang WANG

doi:10.3788/OPE.20172506.1645

您当前的位置：

首页 >

文章列表页 >

Corrected fast SIFT image stitching method by combining projection error

Information Sciences | 更新时间：2020-07-07

- Corrected fast SIFT image stitching method by combining projection error
- Optics and Precision Engineering Vol. 25, Issue 6, Pages: 1645-1651(2017)
- 作者机构：
  
  吉林大学通信工程学院, 吉林长春 130012
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20172506.1645
  CLC： TP391.4
- Received：05 December 2016，
  
  Accepted：01 February 2017，
  
  Published：25 June 2017
- 稿件说明：
移动端阅览
Yan ZHAO, Yue CHEN, Shi-gang WANG. Corrected fast SIFT image stitching method by combining projection error[J]. Optics and precision engineering, 2017, 25(6): 1645-1651.
DOI：

Yan ZHAO, Yue CHEN, Shi-gang WANG. Corrected fast SIFT image stitching method by combining projection error[J]. Optics and precision engineering, 2017, 25(6): 1645-1651. DOI： 10.3788/OPE.20172506.1645.

摘要

针对现有图像拼接方法实时性受限的问题，提出了一种通过对图像拼接中重叠区域部分图像特征检测和投影误差校正两部分相结合的快速图像拼接方法。首先，该方法特征检测范围仅集中在待拼接图像重叠区域的部分图像块，从中获取尺度不变特征变换（SIFT）的特征点信息。然后，在特征匹配后应用投影误差校正方法，达到充分利用有限匹配点对计算出高精度投影变换矩阵的目的，避免了不必要的特征检测和匹配搜索，继而大大加快了图像拼接速度。最后，结合图像拼接的质量评价方法对图像拼接结果做出质量分析，以反映改进方法的性能。实验结果表明：对比文献所提出的快速图像拼接方法，本文方法在保证图像拼接质量的前提下显著降低了拼接时间；在所给的3组实验图像中，拼接速度平均提升了54%左右，证明了本文方法的可行性和有效性。

Abstract

Aiming at the problems of limited instantaneity in current image stitching methods

a fast image stitching method through combining feature points detection on part of image with correction of projection error in the overlapping area in the process of image stitching was proposed. Firstly

the scope of the feature detection for the method only focused on part of image blocks in the overlapping area of the image which were needed to be stitched for obtaining information of feature points for Scale Invariant Feature Transform (SIFT). Secondly

after the feature matching

the correction method was used for projection error to make full use of limited matching points to figure out high-precision projection transformation matrix

in order to avoid unnecessary feature detections and matching searching for greatly accelerating the speed to stitch images. Finally

combining with quality evaluation method for image stitching

quality analysis was made on image stitching result for reflecting the performance of the improved method. The result of the experiment shows: compared with the fast image stitching method mentioned in references

on the premise of maintaining the stitching quality of the image

the method in the thesis significantly reduces the time for the stitching process. Among three experimental images

the average stitching speed is increased approximately by 54%

which shows the feasibility and effectiveness of the proposed method.

关键词

Keywords

references

张宝龙, 李洪蕊, 李丹, 等.一种针对车载全景系统的图像拼接算法的仿真[J].电子与信息学报, 2015, 37(5): 1149-1153.

ZHANG B L, LI H R, LI D, et al.. A simulation of image mosaic algorithm based on vehicle panorama system [J]. Journal of Electronics & Information Technology, 2015, 37(5): 1149-1153. (in Chinese)

余淮, 杨文.一种无人机航拍影像快速特征提取与匹配算法[J].电子与信息学报, 2016, 38(3): 509-516.

YU H, YANG W. A fast feature extraction and matching algorithm for unmanned aerial vehicle images [J]. Journal of Electronics & Information Technology, 2016, 38(3): 509-516. (in Chinese)

杨磊, 任龙, 刘庆, 等.基于FPGA的大视场图像实时拼接技术的研究与实现[J].红外与激光工程, 2015, 44(6):1929-1935.

YANG L, REN L, LIU Q, et al.. Research and implementation of large field image real-time mosaic technology based on FPGA [J]. Infrared and Laser Engineering, 2015, 44(6): 1929-1935. (in Chinese)

ANNIS F, KARTHIK R, VAIDEHI V. Image stitching with combined moment invariants and SIFT features [J]. Procedia Computer Science, 2013, 19: 420-427.

杨磊, 曹剑中, 唐利孬, 等.全景图像自动拼接算法的优化设计[J].红外与激光工程, 2015, 44(3):985-990.

YANG L, CAO J Z, TANG L N, et al.. Optimized design of automatic panoramic images mosaic [J]. Infrared and Laser Engineering, 2015, 44(3): 985-990. (in Chinese)

LOWE D G. Distinctive image features from scale-invariant keypoints [J]. International Journal of Computer Vision, 2004, 60(2):91-110.

BROWN M, LOWE D G. Automatic panoramic image stitching using invariant features [J]. International Journal of Computer Vision, 2007, 74(1): 59-73.

曾峦, 王元钦, 谭久彬.改进的SIFT特征提取和匹配算法[J].光学精密工程, 2011, 19(6): 1391-1397.

ZENG L, WANG Y Q, TAN J B. Improved algorithm for SIFT feature extraction and matching [J].Opt. Precision Eng., 2011, 19(6): 1391-1397.(in Chinese)

刘洋, 韩广良, 史春蕾.基于SIFT算法的多表情人脸识别[J].液晶与显示, 2016, 31(12): 1156-1160.

LIU Y, HAN G L, SHI C L. Recognition of expression-variant faces based on SIFT method [J]. Chinese Journal of Liquid Crystals and Displays, 2016, 31(12): 1156-1160. (in Chinese)

王睿, 朱正丹.融合全局颜色信息的尺度不变特征变换[J].光学精密工程, 2015, 23(1): 295-301.

WANG R, ZHU ZH D. SIFT matching with color invariant characteristics and global context [J]. Opt. Precision Eng., 2015, 23(1): 295-301. (in Chinese)

何宾, 陶丹, 彭勃.高实时性F-SIFT图像拼接算法[J].红外与激光工程, 2013, 42(S2): 440-444.

HE B, TAO D, PENG B. High real F-SIFT image stitching algorithm [J]. Infrared and Laser Engineering, 2013, 42(S2): 440-444. (in Chinese)

YANG X, CHENG K T. Local difference binary for ultrafast and distinctive feature description [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 36(1): 188-194.

李丹, 孙海涛, 王海莉.一种改进的SIFT图像立体匹配算法[J].西南交通大学学报, 2015, 50(3):490-495.

LI D, SUN H T, WANG H L. An improved SIFT algorithm for image stereo matching [J]. Journal of Southwest Jiao tong University, 2015, 50(3):490-495. (in Chinese)

赵爱罡, 王宏力, 杨小冈, 等.融合几何特征的压缩感知SIFT描述子[J].红外与激光工程, 2015, 44(3): 1085-1091.

ZHAO A G, WANG H L, YANG X G, et al.. Compressed sense SIFT descriptor mixed with geometrical feature [J]. Infrared and Laser Engineering, 2015, 44(3): 1085-1091. (in Chinese)

DELLINGER F, DELON J, GOUSSEAU Y, et al..SAR-SIFT: a SIFT-like algorithm for SAR image [J].IEEE Transactions on Geoscience and Remote Sensing, 2015, 53(1): 453-466.

李玉峰, 李广泽, 谷绍湖, 等.基于区域分块与尺度不变特征变换的图像拼接算法[J].光学精密工程, 2016, 24(5):1197-1205.

LI Y F, LI G Z, GU S H, et al.. Image mosaic algorithm based on area blocking and SIFT [J]. Opt. Precision Eng., 2016, 24(5): 1197-1205. (in Chinese)

陈月, 赵岩, 王世刚.图像局部特征自适应的快速SIFT图像拼接方法[J].中国光学, 2016, 9(4): 415-422.

CHEN Y, ZHAO Y, WANG S G. Fast image stitching method based on SIFT with adaptive local image feature [J]. Chinese Optics, 2016, 9(4): 415-422. (in Chinese)

郭汉洲, 郭立红, 吕游.结合MSER与HSOG的目标局部特征提取[J].液晶与显示, 2016, 31(11): 1070-1078.

GUO H Z, GUO L H, LV Y. Target local feature extraction combined MSER and HSOG [J]. Chinese Journal of Liquid Crystals and Displays, 2016, 31(11): 1070-1078. (in Chinese)

CHEN Y, SHANG L. Improved SIFT image registration algorithm on characteristic statistical distributions and consistency constraint [J]. Optik-International Journal for Light and Electron Optics, 2016, 127(2): 900-911.

PENG G, CAI Y L, HONG W. An Improvement of image registration based on phase correlation [J]. Optik-International Journal for Light and Electron Optics, 2014, 125(22): 6709-6712.

万国挺, 王俊平, 李锦, 等.图像拼接质量评价方法[J].通信学报, 2013, 34(8):76-81.

WAN G T, WANG J P, LI J, et al.. Method for quality assessment of image mosaic [J]. Journal on Communications, 2013, 34(8):76-81. (in Chinese)

Views

130

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Improved phase correlation and clustering ideas for Micro-LED chip microscopic image stitching

Improved fast Image registration algorithm based on ORB and RANSAC fusion

Design of optical system with wide spectrum and large field of view

Three projective transformations for image stitching

Related Author

WU Chaoxing

LE Jianbi

LIN Zhixian

LIN Shanling

MEI Ting

ZHANG Jianhao

CAI Bipeng

WANG Tingyu

Related Institution

School of Advanced Manufacturing，Fuzhou University

China Fujian Photoelectric Information Science and Technology Innovation Laboratory

School of Physics and Information Engineering，Fuzhou University

School of Geosciences, China University of Petroleum

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰