基于深度调节方法的集成成像畸变消除

邓莉巾; 朴燕; 王宇; 谷岳佳楠

doi:10.37188/OPE.20202810.2168

您当前的位置：

首页 >

文章列表页 >

基于深度调节方法的集成成像畸变消除

现代应用光学 | 更新时间：2020-11-16

- 基于深度调节方法的集成成像畸变消除
- Eliminating distortion of integral imaging technology based on depth adjustment method
- 光学精密工程 2020年28卷第10期页码：2168-2179
- 作者机构：
  
  长春理工大学电子信息工程学院, 吉林长春 130022
- 作者简介：
  
  [ "邓莉巾(1991-), 女, 吉林白山人, 博士研究生, 2014年于吉林大学获得学士学位, 主要从事裸眼三维显示、集成成像技术的研究。E-mail:denglijin@126.com" ]
  朴燕(1965-), 女, 吉林蛟河人, 教授, 博士生导师, 1988年于哈尔滨工业大学获得学士学位, 1995年于中科院长春物理研究所获得硕士学位, 2000年于中国科学院长春光学精密机械与物理研究所获得博士学位, 主要从事裸眼三维显示、集成成像技术、智能目标识别及数字信号处理等方面的研究。E-mail:piaoyan@cust.edu.cn PIAO Yan, E-mail:piaoyan@cust.edu.cn
- 基金信息：
  
  国家自然科学基金资助项目(60977011);国家留学基金委(201808220249);吉林省科技计划资助项目(20180201091GX);吉林省机器视觉智能检测科技创新中心(20180623039TC);吉林省教育厅“十三五”科研项目(JJKH20200779KJ)
- DOI：10.37188/OPE.20202810.2168
  中图分类号： TN919.81;TP391.41
- 收稿日期：2020-06-28，
  
  修回日期：2020-07-17，
  
  录用日期：2020-7-17，
  
  纸质出版日期：2020-10-25
- 稿件说明：
移动端阅览
邓莉巾, 朴燕, 王宇, 等. 基于深度调节方法的集成成像畸变消除[J]. 光学精密工程, 2020,28(10):2168-2179.

Li-jin DENG, Yan PIAO, Yu WANG, et al. Eliminating distortion of integral imaging technology based on depth adjustment method[J]. Optics and precision engineering, 2020, 28(10): 2168-2179.
邓莉巾, 朴燕, 王宇, 等. 基于深度调节方法的集成成像畸变消除[J]. 光学精密工程, 2020,28(10):2168-2179. DOI： 10.37188/OPE.20202810.2168.

Li-jin DENG, Yan PIAO, Yu WANG, et al. Eliminating distortion of integral imaging technology based on depth adjustment method[J]. Optics and precision engineering, 2020, 28(10): 2168-2179. DOI： 10.37188/OPE.20202810.2168.

摘要

为了消除集成成像系统中景深范围外目标的畸变现象，提高重构图像的整体观察效果，本文通过逆向光线追迹分析集成成像系统中弥散斑直径关系。参考人眼视觉特性，首先推导出系统的目标采集景深范围；然后根据此范围模型，在采集装置固定的情况下，得到集成成像系统所能重构出的真实深度范围；以此真实深度值为参考值做深度调整，基于查找表法得到元素图像，最终在重构阶段得到无畸变的三维重构图像。实验结果表明，采集景深范围内的目标可以清晰重构，验证了此采集景深模型的合理性；与其他方法得到的元素图像相比，根据此模型做深度调节得到的元素图像，其三维重构图与目标平面图的颜色直方图相似度从67.057%提升到94.507%，结构相似性从54.002%提升到84.510%，峰值信噪比从16.902提升到19.740，明显消除了深度范围外目标的重构畸变，适用于分辨率优先的集成成像显示技术。

Abstract

A method was proposed to eliminate the distortion of targets beyond the depth of field (DOF) in integral imaging systems and improve the overall effect of the reconstruction. First

the relationship of the diffuse spot diameter in the integral imaging system was analyzed through ray tracing

and the DOF range of the system with reference to the visual characteristics of the human eye was obtained. Then

in the case of a fixed collection device

the depth of the three-dimensional target beyond the DOF range was adjusted according to the actual depth value used as the reference value to obtain an element image using a look up table. Finally

the reconstructed image without distortion was obtained in the reconstruction stage. Experimental results demonstrate that the targets within the range of the acquisition DOF can be clearly reconstructed

thus verifying the efficacy of the acquisition DOF model. According to this model

the reconstructed image could be obtained using the depth adjustment method. Its color similarity with the two-dimensional color map increases from 67.057% to 94.507%. The SSIM increases from 54.002% to 84.510%

and the PSNR increases from 16.902 to 19.740. This method clearly eliminates the distortion in the reconstruction of objects beyond the DOF range and is suitable for resolution-first integral imaging display technology.

关键词

Keywords

references

M G LIPPMANN . La photographie integrals . Compt. rend. , 1908 . 146 446 - 451 .

H ARIMOTO , B JAVIDI . Integral three-dimensional imaging with digital reconstruction . Optics Letters , 2001 . 26 ( 3 ): 157 - 159 . DOI: 10.1364/OL.26.000157 http://doi.org/10.1364/OL.26.000157 .

S H HONG , J S JANG , B JAVIDI . Three-dimensional volumetric object reconstruction using computational integral imaging . Optics Express , 2004 . 12 ( 3 ): 483 - 491 . DOI: 10.1364/OPEX.12.000483 http://doi.org/10.1364/OPEX.12.000483 .

邓欢 , 李述利 , 吴非 , 等 . 增大3D观看视角的会聚式集成成像 . 光学精密工程 , 2014 . 22 ( 1 ): 1 - 6 . http://ope.lightpublishing.cn/thesisDetails?columnId=2146686&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=2146686&Fpath=&index=-1&l=zh .

H DENG , SH L LI , F WU , 等 . Toed-in integral imaging with enhanced 3D viewing angle . Opt. Precision Eng. , 2014 . 22 ( 1 ): 1 - 6 . http://ope.lightpublishing.cn/thesisDetails?columnId=2146686&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=2146686&Fpath=&index=-1&l=zh .

孟繁斐 , 步敬 . 集成成像系统中高填充率微透镜阵列的设计与加工 . 光学精密工程 , 2017 . 25 ( 8 ): 2130 - 2138 . http://ope.lightpublishing.cn/thesisDetails?columnId=1410886&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1410886&Fpath=&index=-1&l=zh .

F F MENG , J BU . Design and fabrication for micro-lens array with high fill factor in integral imaging system . Opt. Precision Eng. , 2017 . 25 ( 8 ): 2130 - 2138 . http://ope.lightpublishing.cn/thesisDetails?columnId=1410886&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1410886&Fpath=&index=-1&l=zh .

J S PARK , D C HWANG , D H SHIN , 等 . Resolution-enhanced 3D image correlator using computationally reconstructed integral images . Optics Communications , 2007 . 276 ( 1 ): 72 - 79 . DOI: 10.1016/j.optcom.2007.04.007 http://doi.org/10.1016/j.optcom.2007.04.007 .

J H PARK , K HONG , B LEE . Recent progress in three-dimensional information processing based on integral imaging . Applied Optics , 2009 . 48 ( 34 ): H77 - H94 . DOI: 10.1364/AO.48.000H77 http://doi.org/10.1364/AO.48.000H77 .

X XIAO , B JAVIDI , M MARTINEZ-CORRAL , 等 . Advances in three-dimensional integral imaging: sensing, display, and applications (Invited) . Applied Optics , 2013 . 52 ( 4 ): 546 - 560 . DOI: 10.1364/AO.52.000546 http://doi.org/10.1364/AO.52.000546 .

王芳宁 , 闫安英 , 凌绪玉 . 集成成像技术的发展与应用 . 西南民族大学学报:自然科学版 , 2011 . 37 ( S1 ): 150 - 153 . http://www.cqvip.com/QK/95512B/2011S1/1003573898.html http://www.cqvip.com/QK/95512B/2011S1/1003573898.html .

F N WANG , A Y YAN , X Y LING . The development and application of integral imaging . Journal of Southwest University for Nationalities: Natural Science Edition , 2011 . 37 ( S1 ): 150 - 153 . http://www.cqvip.com/QK/95512B/2011S1/1003573898.html http://www.cqvip.com/QK/95512B/2011S1/1003573898.html .

张雷 , 杨勇 , 赵星 , 等 . 多级投影式集成成像三维显示的视场角拓展 . 光学精密工程 , 2013 . 21 ( 1 ): 1 - 6 . http://ope.lightpublishing.cn/thesisDetails?columnId=1768869&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1768869&Fpath=&index=-1&l=zh .

L ZHANG , Y YANG , X ZHAO , 等 . Enhancement of viewing angle of multi-stage projection-type integral imaging 3D display . Opt. Precision Eng. , 2013 . 21 ( 1 ): 1 - 6 . http://ope.lightpublishing.cn/thesisDetails?columnId=1768869&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1768869&Fpath=&index=-1&l=zh .

L J DENG , Y PIAO , T L SI , 等 . True-color restoration of reconstructed image in naked-eye 3D LED display based on eliminating optical dispersion . Japanese Journal of Applied Physics , 2020 . 59 ( 1 ): 017001 DOI: 10.7567/1347-4065/ab5899 http://doi.org/10.7567/1347-4065/ab5899 .

R MARTINEZ-CUENCA , G SAAVEDRA , M MARTINEZ-CORRAL , 等 . Progress in 3-D multiperspective display by integral imaging . Proceedings of the IEEE , 2009 . 97 ( 6 ): 1067 - 1077 . DOI: 10.1109/JPROC.2009.2016816 http://doi.org/10.1109/JPROC.2009.2016816 .

D H SHIN , S H LEE , E S KIM . Optical display of true 3D objects in depth-priority integral imaging using an active sensor . Optics Communications , 2007 . 275 ( 2 ): 330 - 334 . DOI: 10.1016/j.optcom.2007.03.072 http://doi.org/10.1016/j.optcom.2007.03.072 .

Y R PIAO , M ZHANG , X H WANG , 等 . Extended depth of field integral imaging using multi-focus fusion . Optics Communications , 2018 . 411 8 - 14 . DOI: 10.1016/j.optcom.2017.10.081 http://doi.org/10.1016/j.optcom.2017.10.081 .

Y XING , Q H WANG , H REN , 等 . Optical arbitrary-depth refocusing for large-depth scene in integral imaging display based on reprojected parallax image . Optics Communications , 2019 . 433 209 - 214 . DOI: 10.1016/j.optcom.2018.10.022 http://doi.org/10.1016/j.optcom.2018.10.022 .

焦小雪 , 赵星 , 杨勇 , 等 . 基于最佳记录距离的三维集成成像光学获取技术 . 光学精密工程 , 2011 . 19 ( 11 ): 2805 - 2811 . http://ope.lightpublishing.cn/thesisDetails?columnId=1760358&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1760358&Fpath=&index=-1&l=zh .

X X JIAO , X ZHAO , Y YANG , 等 . Optical acquiring technique of three-dimensional integral imaging based on optimal pick-up distance . Opt. Precision Eng. , 2011 . 19 ( 11 ): 2805 - 2811 . http://ope.lightpublishing.cn/thesisDetails?columnId=1760358&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1760358&Fpath=&index=-1&l=zh .

H NAVARRO , R MARTINEZ-CUENCA , A MOLINA-MARTIAN , 等 . Method to remedy image degradations due to facet braiding in 3D integral-imaging monitors . Journal of Display Technology , 2010 . 6 ( 10 ): 404 - 411 . DOI: 10.1109/JDT.2010.2052347 http://doi.org/10.1109/JDT.2010.2052347 .

赵岩 , 李丽 , 王世刚 . 结合成像几何特征的立体元图像阵列编码 . 光学精密工程 , 2018 . 26 ( 12 ): 3060 - 3066 . http://ope.lightpublishing.cn/thesisDetails?columnId=1424665&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1424665&Fpath=&index=-1&l=zh .

Y ZHAO , L LI , SH G WANG . Elemental image array coding combining imaging geometry features . Opt. Precision Eng. , 2018 . 26 ( 12 ): 3060 - 3066 . http://ope.lightpublishing.cn/thesisDetails?columnId=1424665&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1424665&Fpath=&index=-1&l=zh .

杨勇 , 徐于萍 , 赵星 , 等 . 基于同名点间距变换的三维显示参数匹配 . 光学精密工程 , 2012 . 20 ( 5 ): 1084 - 1089 . http://ope.lightpublishing.cn/thesisDetails?columnId=1765198&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1765198&Fpath=&index=-1&l=zh .

Y YANG , Y P XU , X ZHAO , 等 . Parameter matching of three dimensional display based on space of corresponding image point transformation . Opt. Precision Eng. , 2012 . 20 ( 5 ): 1084 - 1089 . http://ope.lightpublishing.cn/thesisDetails?columnId=1765198&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1765198&Fpath=&index=-1&l=zh .

杨神武.大景深、大视角3D光场显示关键技术研究[D].北京: 北京邮电大学, 2019.

YANG SH W. The Key Technology Research of the 3 d Light Field Display with Large Depth Range and Wide Viewing Angle [D]. Beijing: Beijing University of Posts and Telecom, 2019.(in Chinese)

G LI , K C KWON , G H SHIN , 等 . Simplified integral imaging pickup method for real objects using a depth camera . Journal of the Optical Society of Korea , 2012 . 16 ( 4 ): 381 - 385 . DOI: 10.3807/JOSK.2012.16.4.381 http://doi.org/10.3807/JOSK.2012.16.4.381 .

C L ZITNICK , S B KANG , M UYTTENDAELE , 等 . High-quality video view interpolation using a layered representation . ACM Transactions on Graphics , 2004 . 23 ( 3 ): 600 - 608 . DOI: 10.1145/1015706.1015766 http://doi.org/10.1145/1015706.1015766 .

Y J N GU , Y PIAO . Elemental image generation algorithm using reverse iteration along optical path . Journal of Russian Laser Research , 2019 . 40 ( 6 ): 559 - 570 . DOI: 10.1007/s10946-019-09838-9 http://doi.org/10.1007/s10946-019-09838-9 .

浏览量

274

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于多项式拟合的中阶梯光栅光谱仪谱图还原

基于贝叶斯自适应估计的光子计数集成成像

球面弯晶成像的优化设计及实验测试

激光三角测距中的光斑形状修正

空间激光主动探测离轴三反系统的猫眼效应