基于光场相机的深度面光场计算重构

陈琦; 徐熙平; 姜肇国; 尹鹏; 王鹤程

doi:10.3788/OPE.20182603.0708

您当前的位置：

首页 >

文章列表页 >

基于光场相机的深度面光场计算重构

信息科学 | 更新时间：2020-07-05

- 基于光场相机的深度面光场计算重构
- Light field computational reconstruction from focal planes based on light field camera
- 光学精密工程 2018年26卷第3期页码：708-714
- 作者机构：
  
  长春理工大学光电工程学院, 吉林长春 130022
- 作者简介：
  
  [ "陈琦(1991-), 男, 河北唐山人, 博士在读, 2014年河北地质大学获得学士学位, 现为长春理工大学光电工程学院在读博士生, 主要从事光场成像, 计算光学等方面的研究。E-mail:1551497786@qq.com" ]
  [ "徐熙平(1969-), 男, 吉林长春人, 博士, 1993年、1999年、2004年于长春理工大学分别获得学士、硕士、博士学位。现为长春理工大学仪器科学技术与仪器专业教授, 博士生导师。E-mail:xxp@cust.edu.cn" ]
- 基金信息：
  
  国家重大科学仪器设备开发重点专项资助项目(2012YQ130125);国家自然科学基金资助项目(11375227);国家自然基金青年基金资助项目(61605016)
- DOI：10.3788/OPE.20182603.0708
  中图分类号： O438
- 收稿日期：2017-05-23，
  
  录用日期：2017-7-18，
  
  纸质出版日期：2018-03-25
- 稿件说明：
移动端阅览
陈琦, 徐熙平, 姜肇国, 等. 基于光场相机的深度面光场计算重构[J]. 光学精密工程, 2018,26(3):708-714.

Qi CHEN, Xi-ping XU, Zhao-guo JIANG, et al. Light field computational reconstruction from focal planes based on light field camera[J]. Optics and precision engineering, 2018, 26(3): 708-714.
陈琦, 徐熙平, 姜肇国, 等. 基于光场相机的深度面光场计算重构[J]. 光学精密工程, 2018,26(3):708-714. DOI： 10.3788/OPE.20182603.0708.

Qi CHEN, Xi-ping XU, Zhao-guo JIANG, et al. Light field computational reconstruction from focal planes based on light field camera[J]. Optics and precision engineering, 2018, 26(3): 708-714. DOI： 10.3788/OPE.20182603.0708.

摘要

光场相机与传统相机不同，通过在主镜组和传感器间特定位置设置微透镜阵列，实现在采集物方光强的同时记录光线方向。为了重构物方光场，研究了基于光场相机的深度面计算重构算法，对该算法所采用的焦点堆栈、投影切片定理进行研究。首先，对四维光场定义及光场相机工作原理进行分析；建立了相机内部深度面重构模型，分析了投影切片定理在深度面获取的应用，并推导出不同深度面图像表达式；根据得到不同深度位置图像，研究了计算重构算法，搭建了含有微透镜阵列的微型单相机光场采集系统，采集原始光场，利用本文方法实现了物方光场的逆向重构。实验结果表明：利用本文重构算法，光场相机采集的物方光场可通过滤波计算方法逆向重构，通过重构光场数据可获得物方场景深度信息。本文深度面获取算法较其他算法节省30%以上的时间，各深度面图像峰值信噪比在25~30 dB之间，实现了高精度、稳定可靠的计算光场重构。

Abstract

Different from traditional cameras

light field camera sets a lenslet array between the main lens and the sensor at a specific position

which makes it possible to record the light intensity and the direction of light rays at the same time. In order to reconstruct the object-side light field

the reconstruction algorithm of the focal planes based on the light field camera was studied. Focal stack and projection slice theorem used in the algorithm was researched. Firstly

parameterized 4D light field definition and the working principle of light field camera were analyzed. Secondly

the depth reconstruction model of the camera was established and research the application of the projection slice theorem in getting the focal planes and then Derived the expression of the different focal planes images. Finally

according to the different focal planes images

the computational reconstruction algorithm was studied to realize the reverse reconstruction of the object-side light field. A micro light field camera was built contains lenslet array

collected the original light field

reconstructed the object light field by the method in this paper.The results show that the light field collected by light field camera can be filtered reverse reconstruction of the method proposed in this paper

the depth and the surface of object can be further reconstruction via the light field data. The focal planes images acquisition algorithm in this paper saves more than 30% time compared with other algorithms

and the Peak Signal to Noise Ratio of each focal plane image is between 25-30 dB

which meets the requirements of high precision

stability

reliability and fast speed of light field reconstruction.

关键词

Keywords

references

GERSHUN A, MOON P H, TIMOSHENKO G. The Light Field[M]. Cambridge, MA:Massachusetts Institute of Technology, 1939.

WILBURN B, JOSHI N, VAISH V, et al .. High performance imaging using large camera arrays[J]. ACM Transactions on Graphics, 2005, 24(3):765-776.

NG R, LEVOY M, BRéDIF M, et al . . Light field photography with a hand-held plenoptic camera[R]. Stanford Tech Report CTSR 2005-02, 2005.

BOLLES R C, BAKER H H, MARIMONT D H. Epipolar-plane image analysis:An approach to determining structure from motion[J]. International Journal of Computer Vision, 1987, 1(1):7-55.

朱晓阳, 侯丽雅, 郑悦, 等.微流体数字化技术制备聚合物微透镜阵列[J].光学精密工程, 2014, 22(2):360-368.

ZHU X Y, HOU L Y, ZHENG Y, et al .. Fabrication of polymer micro-lens array by micro-fluid digitalization[J]. Opt. Precision Eng., 2014, 22(2):360-368. (in Chinese)

刘民哲, 王泰升, 李和福, 等.静电场辅助的微压印光刻技术[J].光学精密工程. 2017, 25(3):663-671.

LIU M ZH, WANG T SH, LI H F, et al .. Electrostatic field assisted micro imprint lithography technology[J]. Opt. Precision Eng., 2017, 25(3):663-671. (in Chinese)

李以贵, 颜平, 黄远, 等.基于X光移动光刻技术的PMMA微透镜阵列制备[J].红外与激光工程, 2016, 45(6):0620001.

LI Y G, YAN P, HUANG Y, et al .. Fabrication of PMMA micro lens array based on X-ray moving lithography[J]. Infrared and Laser Engineering, 2016, 45(6):0620001. (in Chinese)

ZHOU CH Y, NAYAR S K. Computational cameras:Convergence of optics and processing[J]. IEEE Transactions on Image Processing, 2011, 20(12):3322-3340.

KLUG M, BURNETT T, FANCELLO A, et al .. A scalable, collaborative, interactive light-field display system[J]. SID Symposium Digest of Technical Papers, 2013, 44(1):412-415.

LüKE J P, ROSA F, MARICHAL-HERNáNDEZ J G, et al .. Depth from light fields analyzing 4D local structure[J]. Journal of Display Technology, 2015, 11(11):900-907.

KIM C, ZIMMER H, PRITCH Y, et al .. Scene reconstruction from high spatio-angular resolution light fields[J]. ACM Transactions on Graphics, 2013, 32(4):73.

NG R. Fourier slice photography[J]. ACM Transactions on Graphics, 2005, 24(3):735-744.

刘永春, 龚华军, 沈春林.基于掩膜的光场采集与重建的研究[J].光学学报, 2014, 34(8):0810001.

LIU Y CH, GONG H J, SHEN CH L. Research of lightfield acquisition and reconstruction based on mask[J]. Acta Optica Sinica, 2014, 34(8):0810001. (in Chinese)

LAM E Y. Computational photography with plenoptic camera and light field capture:Tutorial[J]. Journal of the Optical Society of America A, 2015, 32(11):2021-2032.

MOUSNIER A, VURAL E, GUILLEMOT C. Partial light field tomographic reconstruction from a fixed-camera focal stack[Z]. arXiv: 1503. 01903, 2015.

YIN X W, WANG G J, LI W T, et al .. Iteratively reconstructing 4D light fields from focal stacks[J]. Applied Optics, 2016, 55(30):8457-8463.

浏览量

393

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

融合3D对极平面图像的光场角度超分辨重建