Detail preserving multi-exposure image fusion

Wei-zhong LI; Ben-shun YI; Kang QIU; Hong PENG

doi:10.3788/OPE.20162409.2283

您当前的位置：

首页 >

文章列表页 >

Detail preserving multi-exposure image fusion

Information Sciences | 更新时间：2020-07-07

- Detail preserving multi-exposure image fusion
- Optics and Precision Engineering Vol. 24, Issue 9, Pages: 2283-2292(2016)
- 作者机构：
  
  1.武汉大学电子信息学院, 湖北武汉 430072
  2.湖北工程学院物理与电子信息工程学院, 湖北孝感 432000
  3.地球空间信息技术协同创新中心, 湖北武汉 430079
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20162409.2283
  CLC： TP391.4
- Received：04 May 2016，
  
  Accepted：02 July 2016，
  
  Published：2016-09
- 稿件说明：
移动端阅览
Wei-zhong LI, Ben-shun YI, Kang QIU, et al. Detail preserving multi-exposure image fusion[J]. Optics and precision engineering, 2016, 24(9): 2283-2292.
DOI：

Wei-zhong LI, Ben-shun YI, Kang QIU, et al. Detail preserving multi-exposure image fusion[J]. Optics and precision engineering, 2016, 24(9): 2283-2292. DOI： 10.3788/OPE.20162409.2283.

摘要

针对传统的多曝光图像融合算法存在的细节丟失严重和鬼影现象，提出了一种细节保留的多曝光图像融合算法。该算法首先计算曝光序列的3个特征指标：图像细节、曝光亮度和色彩信息，其中图像细节通过引导滤波计算，曝光亮度的权值由高斯方程分配，而曝光序列的色彩信息用色彩饱和度表示。然后，利用差分图和邻域相关系数检测多曝光序列中运动物体，利用3个特征指标和运动目标检测结果分别计算静态场景和动态场景的融合权值图。为了消除噪声的影响，采用递归滤波器来修正融合权值图。最后，采取加权融合的方式得到融合图像。选取10组不同的曝光序列，分别从主观和客观两方面与6种传统的融合算法进行了比较。实验结果表明，本文算法保留了丰富的细节信息，呈现出了更加生动自然的现实场景，并且有效去除了由运动物体产生的鬼影现象，效果优于其他比较算法，在静态场景和动态场景的曝光融合中都取得了好的效果。

Abstract

A detail preserving multi-exposure image fusion algorithm was proposed to address the problem of the loss of visual details and ghost artifacts in traditional multi-exposure images. Firstly

three image features

image details

exposure brightness and color information

were calculated. In which

the image details were obtained by using a guided filter

the each exposure intensity was weighted by a Gaussian function and the color information was measured by color saturation. Then

the difference maps and correlation coefficients were used to detect the motion objects in dynamic scenes and the focused weight map of static and dynamic scenes were calculated respectively by using feature indexes and detection results. In order to remove the noise effect

a recursive filter was used to correct the focused weight image

and the focused image was obtained by a pixel-by-pixel weighted sum of the input images. Ten kinds of multi-exposure image sequences were tested in the experiments and obtained results were compared with that of six kinds of traditional methods. The experimental results demonstrate that the proposed algorithm exhibits good visual appearance and preserves more details. It also effectively removes ghost artifacts in dynamic scenes. It concludes that the proposed algorithm is better than 6 classical methods and it produces desirable images in both static scenes and dynamic scenes.

关键词

Keywords

references

CHAURASIYA R K, RAMAKRISHNAN K R. High dynamic range imaging[C]. IEEE International Conference on Communication Systems and Network Technologies (CSNT), 2013:83-89.

QIAN X, YU H, CHEN S, et al.. A high dynamic range CMOS image sensor with dual-exposure charge subtraction scheme[J]. IEEE Sensors Journal, 2015, 15(2):661-662.

武星星, 刘金国, 周怀得, 等.制冷对电子倍增CCD相机成像质量的影响[J].光学精密工程, 2015, 23(10增):528-532.

WU X X, LIU J G, ZHOU H D, et al.. Influence of cooling on imaging quality of EMCCD camera[J]. Opt. Precision Eng., 2015, 23(10Suppl.):528-532. (in Chinese)

刘慧, 刘学斌, 陈小来, 等.基于驱动时序控制CCD曝光时间的设计与实现[J].红外与激光工程, 2015, 44(S1):199-204.

LIU H, LIU X B, CHEN X L, et al.. Design and implementation of CCD exposure time control based on driver timing[J]. Infrared and Laser Engineering, 2015, 44(S1):199-204. (in Chinese)

WANG T H, CHIU C W, WU W C, et al.. Pseudo multiple exposure based tone fusion with local region adjustment[J]. IEEE Transactions on Multimedia, 2015, 17(4):470-484.

吕伟振, 刘伟奇, 魏忠伦, 等.基于DMD的高动态范围成像光学系统设计[J].红外与激光工程, 2014, 43(4):1167-1171.

LV W ZH, LIU W Q, WEI ZH L, et al.. Design of high dynamic range imaging optical system based on DMD[J]. Infrared and Laser Engineering, 2014, 43(4):1167-1171. (in Chinese)

周晓波, 程海龙, 贾琦.图像分块融合算法速度优化处理研究[J].北京交通大学学报, 2014, 38(5):33-36.

ZHOU X B, CHENG H L; JIA Q. Optimization of image block fusion algorithm in speed[J].Journal of Beijing Jiaotong University, 2014, 38(5):33-36.(in Chinese)

付争方, 朱虹, 薛杉, 等.基于Sigmoid函数拟合的多曝光图像直接融合算法[J].仪器仪表学报, 2015, 36(10):2321-2329.

FU ZH F, ZHU H, XUE SH, et al..Direct fusion algorithm for multi exposed images based on Sigmoid function fitting[J]. Chinese Journal of Scientific Instrument, 2015, 36(10):2321-2329.(in Chinese)

MERTENS T, KAUTZ J, VANREETH F. Exposure fusion:a simple and practical alternative to high dynamic range photography[J].Computer Graphics Forum, 2009, 28(1):161-171.

SHEN J B, ZHAO Y, YAN S C, et al.. Exposure fusion using boosting Laplacian pyramid[J]. IEEE T. Cybernetics, 2014, 44(9):1579-1590.

BRUCE N D B. ExpoBlend:information preserving exposure blending based on normalized log-domain entropy[J]. Computers & Graphics, 2014, 39:12-23.

VANMALI A V, DESHMUKH S S, GADRE V M. Low complexity detail preserving multi-exposure image fusion for images with balanced exposure[C]. IEEE National Conference on Communications, 2013:1-5.

GALLO O, GELFAND N, CHEN W C, et al.. Artifact-free high dynamic range imaging[C]. IEEE International Conference on Computational Photography (ICCP), 2009:1-7.

LI S, KANG X. Fast multi-exposure image fusion with median filter and recursive filter[J]. IEEE Transactions on Consumer Electronics, 2012, 58(2):626-632.

OH T H, LEE J Y, TAI Y W, et al.. Robust high dynamic range imaging by rank minimization[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(6):1219-1232.

LIU Y, WANG Z. Dense SIFT for ghost-free multi-exposure fusion[J].Journal of Visual Communication and Image Representation, 2015, 31(8):208-224.

HE K, SUN J, TANG X. Guided image filtering[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(6):1397-1409.

JINNO T, OKUDA M. Multiple exposure fusion for high dynamic range image acquisition[J]. IEEE Transactions on Image Processing, 2012, 21(1):358-365.

GASTAL E S L, OLIVEIRA M M. Domain transform for edge-aware image and video processing[J]. ACM Transactions on Graphics, 2011, 30(4):1-11.

金伟其, 贾晓婷, 高绍姝, 等.彩色融合图像的质量主观评价[J].光学精密工程, 2015, 23(12):3465-3471.

JIN W Q, JIA X T, GAO SH SH, et al.. Subjective evaluation of quality for color fusion images[J]. Opt. Precision Eng., 2015, 23(12):3465-3471. (in Chinese)

Views

233

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Infrared and visible image fusion using guided filter and convolutional sparse representation

Polarized image feature fusion in power inspection

Infrared and visible image fusion based on multi-scale spatial attention complementary

Adaptive color compensation and multi-scale fusion for underwater image enhancement

X-ray image fusion for ancient bronze mirror based on intuitionistic fuzzy set entropy measure and salient feature detection

Related Author

Xian-hong LIU

Meng-ze QIN

NI Mengyao

PENG Yuanlong

HU Shang

YAN Longchuan

ZHENG Jinkun

CAO Danhua

Related Institution

Department of Electronics and Optics Engineering, Army Engineering University

. 32181 Troop, Chinese People's Liberation Army, Shijiazhuang

School of Optical and Electronic Information， Huazhong University of Science and Technology

State Grid Information & Telecommunication Branch

State Grid JiangXi Electric Power Supply Co

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰