A novel image coloration fusion method in oRGB color space is presented for the enhancement of thermal infrared and visible night-vision images. We chose to construct a pseudo-color image and to execute color transfer in the same oRGB color space because this new space is reasonably simple
has intuitive axes
and is well-suited for computational applications. In order to preserve detail information from the source images in the final coloration image
the luminance component of the pseudo-color image is assigned to the fused image by a multi-scale top-hat transform. The two color components of the pseudo-color image are constructed according to the differences between the dual-band images and the color statistics of the reference image. To avoid gray-scale compression or over-saturation that can be easily caused by the linear color transfer method
we applied histogram matching rather than linear transformation to the two color components in the color transfer process. Experiments show that our method produces a coloration image with a more natural color distribution. Furthermore
visual features such as salient features and overall brightness and contrast are superior to those produced by other methods.
关键词
Keywords
references
LI Y F, JIANG Y, GAO L, et al.. Fast mutual modulation fusion for multi-sensor images[J]. Optik-International Journal for Light and Electron Optics 2015, 126(1):107-111.
GAO W, ZHU M, HAO ZH CH. Survey of color night vision technology. Chinese Journal of Liquid Crystals and Displays, 2016, 31(12):1168-1179.(in Chinese)
WAXMAN A M, FAY D A. Color night vision:fusion of intensified visible and thermal IR imagery[J]. Proc. SPIE, 1995, 2463:58-68.
TOET A, WALRAVEN J. New false color mapping for image fusion[J]. Optical Engineering, 1996, 35(3):650-658.
HUANG G, NI G, ZHANG B. Visual and infrared dual-band false color image fusion method motivated by Land's experiment[J]. Optical Engineering, 2007, 46(2):27001-27010.
JANG J H, RA J B. Pseudo-color image fusion based on intensity-hue-saturation color space[C]. IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems , 2008: 366-371. https://ieeexplore.ieee.org/document/4648093
LUO Y, ZHANG K, JI M. Color image fusion method for enhancing situation awareness of ICA[J]. Infrared and Laser Engineering, 2016, 45(S1):200-206.(in Chinese)
REINHARD E, ADHIKHMIN M, GOOCH B, et al.. Color transfer between images[J]. IEEE Computer Graphics and Applications, 2001, 21(5):34-41.
TOET A. Color the Night: Applying Daytime Colors to Nighttime Imagery[C]. Pro . SPIE , 2003, 5081: 168-176. http://adsabs.harvard.edu/abs/2003spie.5081..168t
TOET A. Natural colour mapping for multiband nightvision imagery[J]. Information Fusion, 2003, 4(3):155-166.
HOGERVORST M A, TOET A. Presenting nighttime imagery in daytime colours[C]. 11 th International Conference on Information Fusion , 2008: 1-8. https://ieeexplore.ieee.org/document/4632280
HOGERVORST M A, TOET A. Method for applying daytime colors to nighttime imagery in realtime[C]. Proc . SPIE , 2008, 6974: 1-9. https://www.mendeley.com/catalogue/method-applying-daytime-colors-nighttime-imagery-realtime/
TOET A, HOGERVORST M A. Towards an optimal color representation for multiband nightvision systems[C]. 12 th International Conference on Information Fusion , 2009: 1417-1423. https://ieeexplore.ieee.org/document/5203711
HOGERVORSTM A, TOET A. Evaluation of a color fused dual-band NVG[C]. 12 th International Conference on Information Fusion , 2009: 1432-1438. http://adsabs.harvard.edu/abs/2009SPIE.7345E..02H
HOGERVORSTM A, TOET A. Fast natural color mapping for night-time imagery[J]. Information Fusion, 2010, 11(2):69-77.
TOETA, HOGERVORST M A. Progress in color night vision[J]. Optical Engineering, 2012, 51(1):1-19.
LI G X, XU SH Y, DONG J H.Architecture optimized version color transfer based fusion method[J]. Acta Electronica Sinica, 2011, 39(1):213-218.(in Chinese)
MARGARITA B, SOLOMON B, PETER S. oRGB:a practical opponent color space for computer graphics[J]. IEEE Computer Graphics and Applications, 2009, 29(1):42-55.
LI Y F, FENG X Y, XU W M.Infrared and visible image features enhancement and fusion using multi-scale top-hat decomposition[J]. Infrared and Laser Engineering, 2012, 41(10):2824-2832.(in Chinese)
BURT P J, ADELSON E H. Merging images through pattern decomposition[J]. Proc.SPIE, 1985, 575:173-181.
ZHAO K, WU J. Improved image fusion algorithm based on regional gradient and regional energy[J]. Chinese Journal of Liquid Crystals and Displays, 2016, 31(3):331-337.(in Chinese)
XU W M, LI Y F, CHEN N N, et al.. Coloration of the low light level and infrared image using multi-scale fusion and nonlinear color transfer technique[J]. Infrared Technology, 2012, 34(12):722-728.(in Chinese)