To improve the target recognition distance of the airborne electro-optical reconnaissance equipment of a UAV
this study has developed a high-speed micro-scanning super-resolution core component based on an actual engineering project. The real-time super-resolution reconstruction algorithm is implemented in the embedded platform GPU-TX2i. First
the micro-scanning super-resolution core component moves according to the preset step size and frequency to obtain a continuous image sequence with sub-pixel deviation. Then
the image super-resolution reconstruction algorithm is used based on probability distribution to process the acquired four continuous images into higher resolution images. The experimental results show that the image sequence output achieved by the detector with a frame rate of 120 fps and a resolution of 640×512 is reconstructed via super-resolution and becomes an image sequence with a frame rate of 30 fps and a resolution of 1 280×1024. After super-resolution reconstruction
the effective spatial resolution of the image is increased by 78.2% and target recognition distance is increased by 43.3%. The reconstruction time of a high-resolution image is approximately 33 ms. Furthermore
the micro-scanning super-resolution core component's micro-scan response time is < 1.0 ms and the accuracy in place is < 0.3 μm (corresponding to approximately 0.03 pixels). These results meet the real-time and precision requirements of airborne electro-optical reconnaissance equipment.
关键词
Keywords
references
O'NEIL F . WILLIAM. Recent Progress in Microscan Resolution Enhancement [J]. Northrop grumman corp baltimore md electronic sensors and systems div , 1999 .
JEAN F , CHEVRETTE P C . Realization of a fast microscanning device for infrared focal plane arrays [J]. Realization of a fast microscanning device for infrared focal plane arrays , 1996 . doi: 10.1117/12.241959 http://dx.doi.org/10.1117/12.241959
JOHN G S , WAN W H , HARRIS V , et al . Compact airborne staring FPA sensor with microscanning [J]. Compact airborne staring FPA sensor with microscanning , 1996 .
JIN W Q , CHEN Y N , WANG X , et al . Scanning type sub-pixel thermal imaging algorithm taking account of detector filling rate and micro-scanning contraposition bias [J]. Journal of Infrared and Millimeter Waves , 2008 , 27 ( 4 ): 308 - 312 . (in Chinese) . doi: 10.3321/j.issn:1001-9014.2008.04.015 http://dx.doi.org/10.3321/j.issn:1001-9014.2008.04.015
OLSON C , THEISEN M , PACE T , et al . Model development and system performance optimization for staring infrared search and track (IRST) sensors [C]. SPIE Defense+Security. Proc SPIE 9820, Infrared Imaging Systems :. doi: 10.1117/12.2225862 http://dx.doi.org/10.1117/12.2225862
BRAY M , PANELLA I . Research strategy for the electro-optics sensors domain of the Materials and Components for Missiles Innovative Technology Partnership [C]. SPIE Defense, Security, and Sensing. Proc SPIE 7668 ,. doi: 10.1117/12.849525 http://dx.doi.org/10.1117/12.849525
Airborne Intelligence , Surveillance , Reconnaissance (ISR) Systems and Applications VII , Orlando , Florida , USA , 2010 , 7668 : 288 - 298 . doi: 10.1117/12.849525 http://dx.doi.org/10.1117/12.849525
MILLERJOHN L. , WILTSE J M . Benefits of microscan for staring infrared imagers [J]. Benefits of microscan for staring infrared imagers , 2004 , 127 - 38 . doi: 10.1117/12.541432 http://dx.doi.org/10.1117/12.541432
FAN L L , ZHAO H W , ZHAO H Y , et al . Survey of target detection based on deep convolutional neural networks [J]. Opt. Precision Eng. , 2020 , 28 ( 5 ): 1152 - 1164 . (in Chinese)
WAGNER R S , WAAGEN D E , CASSABAUM M L . Image superresolution for improved automatic target recognition [C]. Defense and Security. Proc SPIE 5426 , Automatic Target Recognition XIV, Orlando, Florida, USA , 2004 , 5426 : 188 - 196 . doi: 10.1117/12.541161 http://dx.doi.org/10.1117/12.541161
MOHAMMAD S A , BOGNAR J G , CAIN S , et al . Fast registration and reconstruction of aliased low-resolution frames by use of a modified maximum-likelihood approach [J]. Applied Optics , 1998 , 37 ( 8 ): 1319 . doi: 10.1364/AO.37.001319 http://dx.doi.org/10.1364/AO.37.001319
MU SH SH , ZHANG Y , JIA P . Super-resolution imaging of multi-frame sub-pixel images based on self-learning LLE [J]. Opt. Precision Eng. , 2015 , 23 ( 9 ): 2677 - 2686 . (in Chinese) . doi: 10.3788/OPE.20152309.2677 http://dx.doi.org/10.3788/OPE.20152309.2677
BORMAN S , STEVENSON R . Spatial resolution enhancement of low-resolution image sequences - A comprehensive review with directions for future research [EB/OL]. 1998 . https://www.researchgate.net/publication/2461146 https://www.researchgate.net/publication/2461146 . doi: 10.1109/mwscas.1998.759509 http://dx.doi.org/10.1109/mwscas.1998.759509