共光轴实时彩色融合系统

何炳阳; 张智诠; 蒋晓瑜; 金伟其; 李强

doi:10.3788/OPE.20182611.2854

您当前的位置：

首页 >

文章列表页 >

共光轴实时彩色融合系统

信息科学 | 更新时间：2020-07-05

- 共光轴实时彩色融合系统
- Real-time coaxial color fusion system
- 光学精密工程 2018年26卷第11期页码：2854-2862
- 作者机构：
  
  1.陆军装甲兵学院兵器与控制系, 北京 100072
  2.陆军装甲兵学院信息工程系, 北京 100072
  3.北京理工大学光电学院光电成像技术与系统教育部重点实验室, 北京 100081
- 作者简介：
  
  [ "何炳阳(1989-), 男, 陕西宝鸡人, 博士研究生, 2012年于长春理工大学获得学士学位, 2015年于装甲兵工程学院获得硕士学位, 主要从事目标探测与识别方面的研究。E-mail:hebingyangsh@sohu.com" ]
  张智诠(1959-), 男, 云南昆明人, 教授, 博士生导师, 1993年于北京理工大学获得博士学位, 主要从事光电成像与检测等方面的研究。E-mail:zhangzhq123@sina.com ZHANG Zhi-quan, E-mail:zhangzhq123@sina.com
- 基金信息：
  
  陆装十三五基金资助项目(6140414050327)
- DOI：10.3788/OPE.20182611.2854
  中图分类号： TP391
- 收稿日期：2018-04-02，
  
  录用日期：2018-5-23，
  
  纸质出版日期：2018-11-25
- 稿件说明：
移动端阅览
何炳阳, 张智诠, 蒋晓瑜, 等. 共光轴实时彩色融合系统[J]. 光学精密工程, 2018,26(11):2854-2862.

Bing-yang HE, Zhi-quan ZHANG, Xiao-yu JIANG, et al. Real-time coaxial color fusion system[J]. Optics and precision engineering, 2018, 26(11): 2854-2862.
何炳阳, 张智诠, 蒋晓瑜, 等. 共光轴实时彩色融合系统[J]. 光学精密工程, 2018,26(11):2854-2862. DOI： 10.3788/OPE.20182611.2854.

Bing-yang HE, Zhi-quan ZHANG, Xiao-yu JIANG, et al. Real-time coaxial color fusion system[J]. Optics and precision engineering, 2018, 26(11): 2854-2862. DOI： 10.3788/OPE.20182611.2854.

摘要

长波红外与可见光图像的自然感彩色融合有助于观察者快速感知环境和发现目标，而共光轴结构对于提高融合图像质量和简化配准算法具有独特的优势。为满足战场侦查、监视等需求，设计了一种基于TMS320DM642数字信号处理器和ATmega32单片机的共光轴实时彩色融合系统。融合系统的长波红外和可见光成像系统平行放置，利用分光镜和反射镜实现光路分离，通过视场匹配和光轴校准实现双波段视频图像完全配准。图像处理程序基于DSP/BIOS嵌入式操作系统开发，根据视频图像的特点，采用基于CbCr查找表的自然感彩色融合算法。针对硬件特点，对融合算法进行优化，使720 pixel×576 pixel的单帧图像融合时间为9.18 ms，满足25 frame/s的实时融合要求；融合图像呈现自然色彩，场景中的热目标易于辨识。文中对共光轴融合系统设计、实现过程中相关问题的研究具有参考借鉴价值。

Abstract

Natural color fusion of long-wave infrared and visible images is helpful to observers for quick perception of the environment and discovery of targets. The coaxial optical structure enjoys the unique advantages in terms of improving the quality of the fused image and simplifying the registration algorithm. According to the requirements in battlefield detection

surveillance

and so on

a real-time coaxial color fusion system based on TMS320DM642 DSP and ATmega32 MCU was designed in the present work. In the fusion system

the long-wave infrared imaging system is combined in parallel with the visible imaging system. The optical path was separated by a beam splitter and a mirror. The dual-band images were absolutely registered using field-of-view matching and optical-axis calibration. The image processing program was developed based on a DSP/BIOS embedded operating system. A natural color fusion algorithm based on a CbCr look-up table was adopted according to the features of the video image. The fusion algorithm was optimized according to the hardware features. The fusion time of a single-frame image with resolution of 720 pixel×576 pixel is 9.18 ms

which satisfies the real-time fusion requirements of 25 frames per second. The fusion image exhibits a natural color

and the hot targets in the scene can be readily identified. The research on related problems presented in this paper can provide references to the design and implementation of a coaxial image fusion system.

关键词

Keywords

references

MCDANIEL R V, SCRIBNER D A, WARREN P R.Image fusion for tactical applications[C]. Infrared Technology and Applications ⅩⅩⅣ. International Society for Optics and Photonics , 1998: 685-695. https://www.researchgate.net/publication/2510884_Image_Fusion_for_Tactical_Applications

TOET A, WALRAVEN J.New false color mapping for image fusion[J]. Optical Engineering , 1996, 35(3):650-658.

WAXMAN A M, GOVE A N, FAY D A, et al ..Color night vision:opponent processing in the fusion of visible and IR imagery[J]. Neural Networks , 1997, 10(1):1-6.

TOET A.Natural colour mapping for multiband nightvision imagery[J]. Information Fusion , 2003, 4(3):155-166.

HOGERVORST M A, TOET A.Method for applying daytime colors to nighttime imagery in realtime[C]. Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2008. International Society for Optics and Photonics , 2008: 697403. https://www.researchgate.net/publication/224883232_Method_for_applying_daytime_colors_to_nighttime_imagery_in_realtime

朱进, 李力, 金伟其, 等.低照度夜视成像的自然感彩色化及增强方法[J].光子学报, 2018, 47(4):165-174.

ZHU J, LI L, JIN W Q, et al ..Natural-appearance colorization and enhancement for the low-light-level night vision imaging[J]. Acta Photonica Sinica , 2018, 47(4):165-174.(in Chinese)

HOGERVORST M A, TOET A.Improved color mapping methods for multiband nighttime image fusion[J]. Journal of Imaging , 2017, 3(36):1-25.

刘佳妮, 金伟其, 李力, 等.自适应参考图像的可见光与热红外彩色图像融合算法[J].光谱学与光谱分析, 2016, 36(12):3907-3914.

LIU J N, JIN W Q, LI L, et al ..Visible and infrared thermal image fusion algorithm based on self-adaptive reference image[J]. Spectroscopy and Spectral Analysis , 2016, 36(12):3907-3914.(in Chinese)

李成立, 石俊生, 魏利, 等.基于颜色传递和目标增强的夜视图像彩色融合[J].激光与红外, 2016, 46(5):607-611.

LI CH L, SHI J SH, WEI L, et al ..Color fusion of night vision image based on color transfer and target enhancement[J]. Laser & Infrared , 2016, 46(5):607-611.(in Chinese)

邓潺, 刘文, 黄彪, 等.基于多核DSP的微光与红外图像彩色融合系统[J].红外与激光工程, 2014, 43(9):3141-3145.

DENG C, LIU W, HUANG B, et al ..Color fusion system of low-light level and infrared images based on multi-core DSP[J]. Infrared and Laser Engineering , 2014, 43(9):3141-3145.(in Chinese)

裴闯, 蒋晓瑜, 王加, 等.自然彩色化双通道实时图像融合系统[J].光学精密工程, 2013, 21(5):1333-1339.

PEI CH, JIANG X Y, WANG J, et al ..Dual-channel real-time image fusion system with nature color[J]. Opt. Precision Eng. , 2013, 21(5):1333-1339.(in Chinese)

王贵圆, 常本康, 富容国, 等.分光轴式多源图像融合系统近距离配准方法研究[J].红外与激光工程, 2016, 45(11):144-150.

WANG G Y, CHANG B K, FU R G, et al ..Close range image registration of multi-source image fusion system with a separate optical axis structure[J]. Infrared and Laser Engineering , 2016, 45(11):144-150.(in Chinese)

李英杰, 张俊举, 常本康, 等.远距离多波段红外图像融合系统及配准方法[J].红外与激光工程, 2016, 45(5):276-282.

LI Y J, ZHANG J J, CHANG B K, et al ..Remote multiband infrared image fusion system and registration method[J]. Infrared and Laser Engineering , 2016, 45(5):276-282.(in Chinese)

王晗, 魏明.自适应特征点检测的可见-红外图像配准[J].中国图象图形学报, 2017, 22(2):179-187.

WANG H, WEI M.CCD-IR image registration based on adaptive feature point detection[J]. Journal of Image and Graphics , 2017, 22(2):179-187.(in Chinese)

徐军, 付天宇, 杨健, 等.采用显著性分析与改进边缘方向直方图特征的红外与可见光图像配准[J].光学精密工程, 2016, 24(11):2830-2840.

XU J, FU T Y, YANG J, et al ..Registration of infrared image and visible image based on saliency and EOH feature analysis[J]. Opt. Precision Eng. , 2016, 24(11):2830-2840.(in Chinese)

何炳阳, 张智诠, 李强, 等.基于CbCr查找表的双波段图像彩色融合算法[J].光学学报, 2018, 38(1):374-383.

HE B Y, ZHANG ZH Q, LI Q, et al ..Color fusion algorithm of dual-band images based on CbCr look-up table[J]. Acta Optica Sinica , 2018, 38(1):374-383.(in Chinese)

陈显毅.图像配准技术及其MATLAB编程实现[M].北京:电子工业出版社, 2009.

CHEN X Y. Image Registration Technology and Realization of MATLAB Programming [M].Beijing:Publishing House of Electronics Industry, 2009.(in Chinese)

杨锋, 张俊举, 许辉, 等.一种图像融合算法硬件实现[J].红外技术, 2013, 35(9):541-545.

YANG F, ZHANG J J, XU H, et al ..Hardware implementation of an image fusion method[J]. Infrared Technology , 2013, 35(9):541-545.(in Chinese)

浏览量

292

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

暂无数据