Light field computational reconstruction from focal planes based on light field camera

Qi CHEN; Xi-ping XU; Zhao-guo JIANG; peng YIN; He-cheng WANG

doi:10.3788/OPE.20182603.0708

您当前的位置：

首页 >

文章列表页 >

Light field computational reconstruction from focal planes based on light field camera

Information Sciences | 更新时间：2020-07-05

- Light field computational reconstruction from focal planes based on light field camera
- Optics and Precision Engineering Vol. 26, Issue 3, Pages: 708-714(2018)
- 作者机构：
  
  长春理工大学光电工程学院, 吉林长春 130022
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20182603.0708
  CLC： O438
- Received：23 May 2017，
  
  Accepted：18 July 2017，
  
  Published：25 March 2018
- 稿件说明：
移动端阅览
Qi CHEN, Xi-ping XU, Zhao-guo JIANG, et al. Light field computational reconstruction from focal planes based on light field camera[J]. Optics and precision engineering, 2018, 26(3): 708-714.
DOI：

Qi CHEN, Xi-ping XU, Zhao-guo JIANG, et al. Light field computational reconstruction from focal planes based on light field camera[J]. Optics and precision engineering, 2018, 26(3): 708-714. DOI： 10.3788/OPE.20182603.0708.

摘要

光场相机与传统相机不同，通过在主镜组和传感器间特定位置设置微透镜阵列，实现在采集物方光强的同时记录光线方向。为了重构物方光场，研究了基于光场相机的深度面计算重构算法，对该算法所采用的焦点堆栈、投影切片定理进行研究。首先，对四维光场定义及光场相机工作原理进行分析；建立了相机内部深度面重构模型，分析了投影切片定理在深度面获取的应用，并推导出不同深度面图像表达式；根据得到不同深度位置图像，研究了计算重构算法，搭建了含有微透镜阵列的微型单相机光场采集系统，采集原始光场，利用本文方法实现了物方光场的逆向重构。实验结果表明：利用本文重构算法，光场相机采集的物方光场可通过滤波计算方法逆向重构，通过重构光场数据可获得物方场景深度信息。本文深度面获取算法较其他算法节省30%以上的时间，各深度面图像峰值信噪比在25~30 dB之间，实现了高精度、稳定可靠的计算光场重构。

Abstract

Different from traditional cameras

light field camera sets a lenslet array between the main lens and the sensor at a specific position

which makes it possible to record the light intensity and the direction of light rays at the same time. In order to reconstruct the object-side light field

the reconstruction algorithm of the focal planes based on the light field camera was studied. Focal stack and projection slice theorem used in the algorithm was researched. Firstly

parameterized 4D light field definition and the working principle of light field camera were analyzed. Secondly

the depth reconstruction model of the camera was established and research the application of the projection slice theorem in getting the focal planes and then Derived the expression of the different focal planes images. Finally

according to the different focal planes images

the computational reconstruction algorithm was studied to realize the reverse reconstruction of the object-side light field. A micro light field camera was built contains lenslet array

collected the original light field

reconstructed the object light field by the method in this paper.The results show that the light field collected by light field camera can be filtered reverse reconstruction of the method proposed in this paper

the depth and the surface of object can be further reconstruction via the light field data. The focal planes images acquisition algorithm in this paper saves more than 30% time compared with other algorithms

and the Peak Signal to Noise Ratio of each focal plane image is between 25-30 dB

which meets the requirements of high precision

stability

reliability and fast speed of light field reconstruction.

关键词

Keywords

references

GERSHUN A, MOON P H, TIMOSHENKO G. The Light Field[M]. Cambridge, MA:Massachusetts Institute of Technology, 1939.

WILBURN B, JOSHI N, VAISH V, et al .. High performance imaging using large camera arrays[J]. ACM Transactions on Graphics, 2005, 24(3):765-776.

NG R, LEVOY M, BRéDIF M, et al . . Light field photography with a hand-held plenoptic camera[R]. Stanford Tech Report CTSR 2005-02, 2005.

BOLLES R C, BAKER H H, MARIMONT D H. Epipolar-plane image analysis:An approach to determining structure from motion[J]. International Journal of Computer Vision, 1987, 1(1):7-55.

朱晓阳, 侯丽雅, 郑悦, 等.微流体数字化技术制备聚合物微透镜阵列[J].光学精密工程, 2014, 22(2):360-368.

ZHU X Y, HOU L Y, ZHENG Y, et al .. Fabrication of polymer micro-lens array by micro-fluid digitalization[J]. Opt. Precision Eng., 2014, 22(2):360-368. (in Chinese)

刘民哲, 王泰升, 李和福, 等.静电场辅助的微压印光刻技术[J].光学精密工程. 2017, 25(3):663-671.

LIU M ZH, WANG T SH, LI H F, et al .. Electrostatic field assisted micro imprint lithography technology[J]. Opt. Precision Eng., 2017, 25(3):663-671. (in Chinese)

李以贵, 颜平, 黄远, 等.基于X光移动光刻技术的PMMA微透镜阵列制备[J].红外与激光工程, 2016, 45(6):0620001.

LI Y G, YAN P, HUANG Y, et al .. Fabrication of PMMA micro lens array based on X-ray moving lithography[J]. Infrared and Laser Engineering, 2016, 45(6):0620001. (in Chinese)

ZHOU CH Y, NAYAR S K. Computational cameras:Convergence of optics and processing[J]. IEEE Transactions on Image Processing, 2011, 20(12):3322-3340.

KLUG M, BURNETT T, FANCELLO A, et al .. A scalable, collaborative, interactive light-field display system[J]. SID Symposium Digest of Technical Papers, 2013, 44(1):412-415.

LüKE J P, ROSA F, MARICHAL-HERNáNDEZ J G, et al .. Depth from light fields analyzing 4D local structure[J]. Journal of Display Technology, 2015, 11(11):900-907.

KIM C, ZIMMER H, PRITCH Y, et al .. Scene reconstruction from high spatio-angular resolution light fields[J]. ACM Transactions on Graphics, 2013, 32(4):73.

NG R. Fourier slice photography[J]. ACM Transactions on Graphics, 2005, 24(3):735-744.

刘永春, 龚华军, 沈春林.基于掩膜的光场采集与重建的研究[J].光学学报, 2014, 34(8):0810001.

LIU Y CH, GONG H J, SHEN CH L. Research of lightfield acquisition and reconstruction based on mask[J]. Acta Optica Sinica, 2014, 34(8):0810001. (in Chinese)

LAM E Y. Computational photography with plenoptic camera and light field capture:Tutorial[J]. Journal of the Optical Society of America A, 2015, 32(11):2021-2032.

MOUSNIER A, VURAL E, GUILLEMOT C. Partial light field tomographic reconstruction from a fixed-camera focal stack[Z]. arXiv: 1503. 01903, 2015.

YIN X W, WANG G J, LI W T, et al .. Iteratively reconstructing 4D light fields from focal stacks[J]. Applied Optics, 2016, 55(30):8457-8463.

Views

393

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Light-field angular super-resolution reconstruction via fusing 3D epipolar plane images

Related Author

CHEN Chunyi

FAN Xiaohui

HU Xiaojuan

YU Haiyang

Related Institution

School of Computer Science and Technology， Changchun University of Science and Technology

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰