Fusion of infrared and visible images  based on multi-features

YANG Guang; TONG Tao; LU Song-yan; LI Zi-yang; ZHENG Yue

doi:10.3788/OPE.20142202.0489

您当前的位置：

首页 >

文章列表页 >

Fusion of infrared and visible images based on multi-features

Information Sciences | 更新时间：2020-08-13

- Fusion of infrared and visible images based on multi-features
- Optics and Precision Engineering Vol. 22, Issue 2, Pages: 489-496(2014)
- 作者机构：
  
  1. 空军航空大学,吉林长春,130022
  2. 中国人民解放军93010部队,辽宁沈阳,110000
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20142202.0489
  CLC： TP751
- Received：22 April 2013，
  
  Published：20 February 2014
- 稿件说明：
移动端阅览
杨桄,童涛,陆松岩等. 基于多特征的红外与可见光图像融合[J]. 光学精密工程, 2014,22(2): 489-496

YANG Guang, TONG Tao, LU Song-yan etc. Fusion of infrared and visible images based on multi-features[J]. Editorial Office of Optics and Precision Engineering, 2014,22(2): 489-496
杨桄,童涛,陆松岩等. 基于多特征的红外与可见光图像融合[J]. 光学精密工程, 2014,22(2): 489-496 DOI： 10.3788/OPE.20142202.0489.

YANG Guang, TONG Tao, LU Song-yan etc. Fusion of infrared and visible images based on multi-features[J]. Editorial Office of Optics and Precision Engineering, 2014,22(2): 489-496 DOI： 10.3788/OPE.20142202.0489.

摘要

针对传统图像融合方法易导致融合图像整体对比度低及细节反差小的问题

提出一种多特征加权多分辨率图像融合方法。首先

对多尺度分解后的低频系数进行边缘特征、平均梯度特征的提取

同时对高频系数进行相关信号强度比特征的提取。然后

通过边缘特征级融合指导像素级图像融合得到高频系数;针对合成模块中简单加权法易引起边缘或纹理局部模糊的问题

提出分两种情况分别合成同一位置的多尺度分解系数。最后

通过平均梯度特征自适应加权得到融合图像的低频系数

并对低频和高频系数进行多尺度逆变换得到融合图像。实验表明

本文方法的融合性能优于经典的融合方法

其融合质量评价指标中的标准差、空间频率、信息熵和平均梯度分别提高了15.12%、4.30%、6.15%和3.44%。

Abstract

In allusion to the lower overall contrast and smaller detail contrast of a fused image from the conventional fusion methods

an effective multi-feature weighted multi-resolution image fusion algorithm was proposed. Firstly

the edge features and average gradient features were extracted from a low frequency coefficient after multi scalar decompose

while the correlated signal intensity ratio feature was extracted from a high frequency coefficient. Then

the high frequency coefficient of the fused image was obtained from the pixel-level weighted average image fusion conducted by the edge feature fusion. Furthermore

a novel combination map was proposed to process the frequency coefficient from the same place with two patterns to solve the problem that the simple weighted method is not effective for retaining the edge and texture information. Finally

the low frequency coefficient of the fused image was obtained by adaptive weighted method based on regional average gradient and the target image was obtained by inversing multi-scale transformation for low frequency and high frequency coefficients. The experiments on fusing infrared and visible images show that the proposed algorithm is better than the classical methods. And the fusion quality indexes

such as standard deviation

spatial frequency

information entropy and average gradient have increased by 15.12%

4.30%

6.15% and 3.44%

respectively.

关键词

Keywords

references

PIELLA G. A general framework for multiresolution image fusion: from pixels to regions[J]. Information Fusion,2003,4(4):259-280.

ZHANG Z, BLUM R S. A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application [J].Proceedings of IEEE, 1999, 87(8):1315-1326.

LI H,MANJUNATH B S,MITRA S K. Multisensor image fusion using the wavelet transform[J]. Graphical Models and Image Processing, 1995,57(3):235-245.

童涛,杨桄,谭海峰,等.基于NSCT变换的多传感器图像融合算法[J].地理与地理信息科学,2013,29(2):22-25.

TONG T,YANG G,TAN H F, et al.. Multi-sensor image fusion algorithm based on NSCT[J]. Geography and Geo-Information Science, 2013,29 (2):22-25. (in Chinese)

LALLIER E,FAROQ M. A real time pixel-level based image fusion via adaptive weight averaging [C]. Proceeding of the 3rd International Conference on Information Fusion, 2000,2:214-217.

邵眀省,杜广朝.基于量子克隆多宇宙算法的图像融合研究[J].液晶与显示,2012,27(6):837-841.

SHAO M SH, DU G CH. Image fusion processing based on multi-universe quantum cloning algorithm [J]. Chinese Journal of Liquid Crystals and Displays, 2012,27(6):837-841. (in Chinese)

李光鑫,徐抒岩,吴伟平,等.Piella像素级多分辨率图像融合框架的扩展及其算法[J].光学精密工程,2012,20(12):2773-2779.

LI G X, XU SH Y, WU W P, et al.. Extension of Piella pixel-level multiresolution image fusion framework and its algorithm[J]. Opt. Precision Eng., 2012,20(12):2773-2779. (in Chinese)

PU T,NI G Q. Contrast-based image fusion using the discrete wavelet transform [J]. Optical Engineering, 2000,39(8):2075-2082.

PETROVIC V. Multi-level image fusion [J]. SPIE Proceedings,2003,5099:928-933.

BURT P J, KOLCZYNSKI R J. Enhanced image capture through fusion [C]. The 4th International Conference on Computer Vision, Philadelphia, USA, 1993:173-182.

郭明,符拯,奚晓梁.基于局部能量的NSCT域红外与可见光图像融合算法[J].红外与激光工程,2012,41(8):2229-2235.

GUO M, FU ZH, XI X L. Novel fusion algorithm for infrared and visible images based on local energy in NSCT domain [J]. Infrared and Laser Engineering, 2012,41(8):2229-2235. (in Chinese)

CANGA E F, NIKOLOV S G, CANAGARAJAH C N, et al.. Characterisation of image fusion quality metrics for surveillance applications over bandlimited channels[C]. 2005 8th International Conference on Information Fusion, Philadelphia, USA, 2005:483-490.

Views

382

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Infrared and visible image fusion based on target enhancement and butterfly optimization

Fusion of infrared and visible images combined with NSDTCT and sparse representation

Fusion of infrared and visible images based on target segmentation and compressed sensing

Fusion of infrared and visual images based on non-sampled Contourlet transform and region classification

Fusion of infrared and visible images based on compressive sensing

Related Author

HAO Shuai

LI Tong

MA Xu

HE Tian

SUN Xizi

LI Jiahao

Ming YIN

Pu-hong* DUAN

Related Institution

College of Electrical and Control Engineering， Xi'an University of Science and Technology

School of Mathematics, Hefei University of Technology

School of Computer Science & Engineering, Changchun University of Technology

College of Communication Engineering, Jilin University

Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰