Eliminating distortion of integral imaging technology based on depth adjustment method

Li-jin DENG; Yan PIAO; Yu WANG; Yue-jianan GU

doi:10.37188/OPE.20202810.2168

您当前的位置：

首页 >

文章列表页 >

Eliminating distortion of integral imaging technology based on depth adjustment method

Modern Applied Optics | 更新时间：2020-11-16

- Eliminating distortion of integral imaging technology based on depth adjustment method
- Optics and Precision Engineering Vol. 28, Issue 10, Pages: 2168-2179(2020)
- 作者机构：
  
  长春理工大学电子信息工程学院, 吉林长春 130022
- 作者简介：
- 基金信息：
- DOI：10.37188/OPE.20202810.2168
  CLC： TN919.81;TP391.41
- Received：28 June 2020，
  
  Revised：17 July 2020，
  
  Accepted：17 July 2020，
  
  Published：25 October 2020
- 稿件说明：
移动端阅览
Li-jin DENG, Yan PIAO, Yu WANG, et al. Eliminating distortion of integral imaging technology based on depth adjustment method[J]. Optics and precision engineering, 2020, 28(10): 2168-2179.
DOI：

Li-jin DENG, Yan PIAO, Yu WANG, et al. Eliminating distortion of integral imaging technology based on depth adjustment method[J]. Optics and precision engineering, 2020, 28(10): 2168-2179. DOI： 10.37188/OPE.20202810.2168.

摘要

为了消除集成成像系统中景深范围外目标的畸变现象，提高重构图像的整体观察效果，本文通过逆向光线追迹分析集成成像系统中弥散斑直径关系。参考人眼视觉特性，首先推导出系统的目标采集景深范围；然后根据此范围模型，在采集装置固定的情况下，得到集成成像系统所能重构出的真实深度范围；以此真实深度值为参考值做深度调整，基于查找表法得到元素图像，最终在重构阶段得到无畸变的三维重构图像。实验结果表明，采集景深范围内的目标可以清晰重构，验证了此采集景深模型的合理性；与其他方法得到的元素图像相比，根据此模型做深度调节得到的元素图像，其三维重构图与目标平面图的颜色直方图相似度从67.057%提升到94.507%，结构相似性从54.002%提升到84.510%，峰值信噪比从16.902提升到19.740，明显消除了深度范围外目标的重构畸变，适用于分辨率优先的集成成像显示技术。

Abstract

A method was proposed to eliminate the distortion of targets beyond the depth of field (DOF) in integral imaging systems and improve the overall effect of the reconstruction. First

the relationship of the diffuse spot diameter in the integral imaging system was analyzed through ray tracing

and the DOF range of the system with reference to the visual characteristics of the human eye was obtained. Then

in the case of a fixed collection device

the depth of the three-dimensional target beyond the DOF range was adjusted according to the actual depth value used as the reference value to obtain an element image using a look up table. Finally

the reconstructed image without distortion was obtained in the reconstruction stage. Experimental results demonstrate that the targets within the range of the acquisition DOF can be clearly reconstructed

thus verifying the efficacy of the acquisition DOF model. According to this model

the reconstructed image could be obtained using the depth adjustment method. Its color similarity with the two-dimensional color map increases from 67.057% to 94.507%. The SSIM increases from 54.002% to 84.510%

and the PSNR increases from 16.902 to 19.740. This method clearly eliminates the distortion in the reconstruction of objects beyond the DOF range and is suitable for resolution-first integral imaging display technology.

关键词

Keywords

references

M G LIPPMANN . La photographie integrals . Compt. rend. , 1908 . 146 446 - 451 .

H ARIMOTO , B JAVIDI . Integral three-dimensional imaging with digital reconstruction . Optics Letters , 2001 . 26 ( 3 ): 157 - 159 . DOI: 10.1364/OL.26.000157 http://doi.org/10.1364/OL.26.000157 .

S H HONG , J S JANG , B JAVIDI . Three-dimensional volumetric object reconstruction using computational integral imaging . Optics Express , 2004 . 12 ( 3 ): 483 - 491 . DOI: 10.1364/OPEX.12.000483 http://doi.org/10.1364/OPEX.12.000483 .

邓欢 , 李述利 , 吴非 , 等 . 增大3D观看视角的会聚式集成成像 . 光学精密工程 , 2014 . 22 ( 1 ): 1 - 6 . http://ope.lightpublishing.cn/thesisDetails?columnId=2146686&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=2146686&Fpath=&index=-1&l=zh .

H DENG , SH L LI , F WU , 等 . Toed-in integral imaging with enhanced 3D viewing angle . Opt. Precision Eng. , 2014 . 22 ( 1 ): 1 - 6 . http://ope.lightpublishing.cn/thesisDetails?columnId=2146686&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=2146686&Fpath=&index=-1&l=zh .

孟繁斐 , 步敬 . 集成成像系统中高填充率微透镜阵列的设计与加工 . 光学精密工程 , 2017 . 25 ( 8 ): 2130 - 2138 . http://ope.lightpublishing.cn/thesisDetails?columnId=1410886&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1410886&Fpath=&index=-1&l=zh .

F F MENG , J BU . Design and fabrication for micro-lens array with high fill factor in integral imaging system . Opt. Precision Eng. , 2017 . 25 ( 8 ): 2130 - 2138 . http://ope.lightpublishing.cn/thesisDetails?columnId=1410886&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1410886&Fpath=&index=-1&l=zh .

J S PARK , D C HWANG , D H SHIN , 等 . Resolution-enhanced 3D image correlator using computationally reconstructed integral images . Optics Communications , 2007 . 276 ( 1 ): 72 - 79 . DOI: 10.1016/j.optcom.2007.04.007 http://doi.org/10.1016/j.optcom.2007.04.007 .

J H PARK , K HONG , B LEE . Recent progress in three-dimensional information processing based on integral imaging . Applied Optics , 2009 . 48 ( 34 ): H77 - H94 . DOI: 10.1364/AO.48.000H77 http://doi.org/10.1364/AO.48.000H77 .

X XIAO , B JAVIDI , M MARTINEZ-CORRAL , 等 . Advances in three-dimensional integral imaging: sensing, display, and applications (Invited) . Applied Optics , 2013 . 52 ( 4 ): 546 - 560 . DOI: 10.1364/AO.52.000546 http://doi.org/10.1364/AO.52.000546 .

王芳宁 , 闫安英 , 凌绪玉 . 集成成像技术的发展与应用 . 西南民族大学学报:自然科学版 , 2011 . 37 ( S1 ): 150 - 153 . http://www.cqvip.com/QK/95512B/2011S1/1003573898.html http://www.cqvip.com/QK/95512B/2011S1/1003573898.html .

F N WANG , A Y YAN , X Y LING . The development and application of integral imaging . Journal of Southwest University for Nationalities: Natural Science Edition , 2011 . 37 ( S1 ): 150 - 153 . http://www.cqvip.com/QK/95512B/2011S1/1003573898.html http://www.cqvip.com/QK/95512B/2011S1/1003573898.html .

张雷 , 杨勇 , 赵星 , 等 . 多级投影式集成成像三维显示的视场角拓展 . 光学精密工程 , 2013 . 21 ( 1 ): 1 - 6 . http://ope.lightpublishing.cn/thesisDetails?columnId=1768869&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1768869&Fpath=&index=-1&l=zh .

L ZHANG , Y YANG , X ZHAO , 等 . Enhancement of viewing angle of multi-stage projection-type integral imaging 3D display . Opt. Precision Eng. , 2013 . 21 ( 1 ): 1 - 6 . http://ope.lightpublishing.cn/thesisDetails?columnId=1768869&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1768869&Fpath=&index=-1&l=zh .

L J DENG , Y PIAO , T L SI , 等 . True-color restoration of reconstructed image in naked-eye 3D LED display based on eliminating optical dispersion . Japanese Journal of Applied Physics , 2020 . 59 ( 1 ): 017001 DOI: 10.7567/1347-4065/ab5899 http://doi.org/10.7567/1347-4065/ab5899 .

R MARTINEZ-CUENCA , G SAAVEDRA , M MARTINEZ-CORRAL , 等 . Progress in 3-D multiperspective display by integral imaging . Proceedings of the IEEE , 2009 . 97 ( 6 ): 1067 - 1077 . DOI: 10.1109/JPROC.2009.2016816 http://doi.org/10.1109/JPROC.2009.2016816 .

D H SHIN , S H LEE , E S KIM . Optical display of true 3D objects in depth-priority integral imaging using an active sensor . Optics Communications , 2007 . 275 ( 2 ): 330 - 334 . DOI: 10.1016/j.optcom.2007.03.072 http://doi.org/10.1016/j.optcom.2007.03.072 .

Y R PIAO , M ZHANG , X H WANG , 等 . Extended depth of field integral imaging using multi-focus fusion . Optics Communications , 2018 . 411 8 - 14 . DOI: 10.1016/j.optcom.2017.10.081 http://doi.org/10.1016/j.optcom.2017.10.081 .

Y XING , Q H WANG , H REN , 等 . Optical arbitrary-depth refocusing for large-depth scene in integral imaging display based on reprojected parallax image . Optics Communications , 2019 . 433 209 - 214 . DOI: 10.1016/j.optcom.2018.10.022 http://doi.org/10.1016/j.optcom.2018.10.022 .

焦小雪 , 赵星 , 杨勇 , 等 . 基于最佳记录距离的三维集成成像光学获取技术 . 光学精密工程 , 2011 . 19 ( 11 ): 2805 - 2811 . http://ope.lightpublishing.cn/thesisDetails?columnId=1760358&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1760358&Fpath=&index=-1&l=zh .

X X JIAO , X ZHAO , Y YANG , 等 . Optical acquiring technique of three-dimensional integral imaging based on optimal pick-up distance . Opt. Precision Eng. , 2011 . 19 ( 11 ): 2805 - 2811 . http://ope.lightpublishing.cn/thesisDetails?columnId=1760358&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1760358&Fpath=&index=-1&l=zh .

H NAVARRO , R MARTINEZ-CUENCA , A MOLINA-MARTIAN , 等 . Method to remedy image degradations due to facet braiding in 3D integral-imaging monitors . Journal of Display Technology , 2010 . 6 ( 10 ): 404 - 411 . DOI: 10.1109/JDT.2010.2052347 http://doi.org/10.1109/JDT.2010.2052347 .

赵岩 , 李丽 , 王世刚 . 结合成像几何特征的立体元图像阵列编码 . 光学精密工程 , 2018 . 26 ( 12 ): 3060 - 3066 . http://ope.lightpublishing.cn/thesisDetails?columnId=1424665&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1424665&Fpath=&index=-1&l=zh .

Y ZHAO , L LI , SH G WANG . Elemental image array coding combining imaging geometry features . Opt. Precision Eng. , 2018 . 26 ( 12 ): 3060 - 3066 . http://ope.lightpublishing.cn/thesisDetails?columnId=1424665&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1424665&Fpath=&index=-1&l=zh .

杨勇 , 徐于萍 , 赵星 , 等 . 基于同名点间距变换的三维显示参数匹配 . 光学精密工程 , 2012 . 20 ( 5 ): 1084 - 1089 . http://ope.lightpublishing.cn/thesisDetails?columnId=1765198&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1765198&Fpath=&index=-1&l=zh .

Y YANG , Y P XU , X ZHAO , 等 . Parameter matching of three dimensional display based on space of corresponding image point transformation . Opt. Precision Eng. , 2012 . 20 ( 5 ): 1084 - 1089 . http://ope.lightpublishing.cn/thesisDetails?columnId=1765198&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1765198&Fpath=&index=-1&l=zh .

杨神武.大景深、大视角3D光场显示关键技术研究[D].北京: 北京邮电大学, 2019.

YANG SH W. The Key Technology Research of the 3 d Light Field Display with Large Depth Range and Wide Viewing Angle [D]. Beijing: Beijing University of Posts and Telecom, 2019.(in Chinese)

G LI , K C KWON , G H SHIN , 等 . Simplified integral imaging pickup method for real objects using a depth camera . Journal of the Optical Society of Korea , 2012 . 16 ( 4 ): 381 - 385 . DOI: 10.3807/JOSK.2012.16.4.381 http://doi.org/10.3807/JOSK.2012.16.4.381 .

C L ZITNICK , S B KANG , M UYTTENDAELE , 等 . High-quality video view interpolation using a layered representation . ACM Transactions on Graphics , 2004 . 23 ( 3 ): 600 - 608 . DOI: 10.1145/1015706.1015766 http://doi.org/10.1145/1015706.1015766 .

Y J N GU , Y PIAO . Elemental image generation algorithm using reverse iteration along optical path . Journal of Russian Laser Research , 2019 . 40 ( 6 ): 559 - 570 . DOI: 10.1007/s10946-019-09838-9 http://doi.org/10.1007/s10946-019-09838-9 .

Views

401

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Spectrogram reduction for echelle grating spectrometer based on Polynomial fitting

Photon counting integral imaging based on adaptive Bayesian estimation

Optimum design and test experiments of spherically bent crystal imaging

Spot modification in laser triangulation displacement measurement

Active laser detection of cat's eye effect for space-based off-axis three mirror optical system

Related Author

Jian ZHANG

Xue-qiang GUO

Ting-ting MA

Jin YANG

Ci SUN

Ji-wei ZHU

Yuan-jin CHEN

Jia-jia QI

Related Institution

Changchun SPKTRM Optronicsco. Ltd

Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences

Department of Optoelectronic Technology, Nanjing University of Science and Technology

Science and Technology on Plasma Physics Laboratory, Research Center of Laser Fusion, Chinese Academy of Engineering Physics

College of Electronic Information and Electric Engineering, Shanghai Jiao Tong University

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰