Color restoration of object surface point cloud in three-dimensional laser scanning system

Ou SHA; Yuan-zhi LÜ; Jian-yong LING; Han-yi FU

doi:10.37188/OPE.20202810.2158

您当前的位置：

首页 >

文章列表页 >

Color restoration of object surface point cloud in three-dimensional laser scanning system

Modern Applied Optics | 更新时间：2020-11-16

- Color restoration of object surface point cloud in three-dimensional laser scanning system
- Optics and Precision Engineering Vol. 28, Issue 10, Pages: 2158-2167(2020)
- 作者机构：
  
  1.中国科学院长春光学精密机械与物理研究所, 吉林长春 130033
  2.中国科学院大学, 北京 100049
- 作者简介：
- 基金信息：
- DOI：10.37188/OPE.20202810.2158
  CLC： TN247;TH721
- Received：18 March 2020，
  
  Revised：16 April 2020，
  
  Accepted：16 April 2020，
  
  Published：25 October 2020
- 稿件说明：
移动端阅览
Ou SHA, Yuan-zhi LÜ, Jian-yong LING, et al. Color restoration of object surface point cloud in three-dimensional laser scanning system[J]. Optics and precision engineering, 2020, 28(10): 2158-2167.
DOI：

Ou SHA, Yuan-zhi LÜ, Jian-yong LING, et al. Color restoration of object surface point cloud in three-dimensional laser scanning system[J]. Optics and precision engineering, 2020, 28(10): 2158-2167. DOI： 10.37188/OPE.20202810.2158.

摘要

为建立目标表面的真实彩色三维点云数据模型，以编码标志点作为定位介质，利用目标的无色点云和彩色图像，提出一种三维点云颜色复原方法。在目标附近放置多组编码标志点，用基于激光线的三维扫描设备获取目标无色的三维点云和编码标志点信息；用彩色相机从多视角采集目标及编码标志点的彩色图像，通过Canny边缘检测及亚像素定位算法得到编码标志点的图像坐标；再利用改进的直接线性变换法由编码标志点的世界坐标值及像素坐标值求解出相机相对世界坐标系的位姿矩阵，通过相机成像模型建立点云与彩色图像像元的映射关系；最后，利用插值法计算局部点云的颜色并完成整个点云颜色的融合。采用该方法对多个模型进行了颜色复原实验，彩色三维点云的颜色空间位置偏差小于0.6 mm，重建效率为7.3×10

point/s，彩色三维点云与目标相似度高。该方法可以实现目标彩色三维点云重建，计算精度和效率均能够满足使用需求。

Abstract

To obtain the real colorful three-dimensional (3-D) point cloud data model of a target surface

a 3-D point cloud color restoration method is proposed. The method uses code points

based on the colorless 3-D point cloud and colorful images of an object

as the location medium. First

multiple code points were placed near the object and thecolorless 3-D point cloud of the object; thereafter

the information of code points was captured by a 3-D scanning device based on a structure laser line. A color camera was then used to capture color images of the target from different perspectives

and then

using canny edge detection and a subpixel localization algorithm

coding point coordinate values in the images were calculated. Later

an improved method of direct linear transformation was used to solve the camera pose matrix in the world coordinate system by coding point world coordinates and pixel coordinates.The corresponding relation between the point cloud and color image pixels was then set up by the camera imaging model. Finally

interpolation was used to calculate the color of the local point cloud

and thus

complete color fusion of the entire point cloud was achieved. In the experiments

the proposed method was adopted to restore the color of multiple point cloud models. The color space position deviation of the color 3-D point cloud is less than 0.6 mm

and the reconstruction efficiency is approximately 73 000 point/s.The color 3-D point cloud exhibits high similarity with the targets.Therefore

the method can achieve the goal of color 3-D point cloud reconstruction

and the achieved calculation accuracy and efficiency can satisfy user demands.

关键词

Keywords

references

S H SHEN . Accurate multiple view 3D reconstruction using patch-based stereo for large-scale scenes . IEEE Transactions on Image Processing , 2013 . 22 ( 5 ): 1901 - 1914 . DOI: 10.1109/TIP.2013.2237921 http://doi.org/10.1109/TIP.2013.2237921 .

高瞻宇 , 顾营迎 , 吕耀宇 , 等 . 融合通用形变模型信息的面部三维重建 . 光学精密工程 , 2018 . 26 ( 1 ): 184 - 192 . http://ope.lightpublishing.cn/thesisDetails?columnId=1451952&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1451952&Fpath=&index=-1&l=zh .

ZH Y GAO , Y Y GU , Y Y LV , 等 . Face reconstruction fused with generic morphable model . Opt. Precision Eng. , 2018 . 26 ( 1 ): 184 - 192 . http://ope.lightpublishing.cn/thesisDetails?columnId=1451952&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1451952&Fpath=&index=-1&l=zh .

丁汛 , 赵跃进 , 丁玉奎 . 基于多图像融合的MEMS显微三维形貌重构 . 光学精密工程 , 2018 . 26 ( 5 ): 1275 - 1285 . http://ope.lightpublishing.cn/thesisDetails?columnId=1415824&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1415824&Fpath=&index=-1&l=zh .

X DING , Y J ZHAO , Y K DING . Three-dimensional microscopic reconstruction of MEMS based on multi image fusion . Opt. Precision Eng. , 2018 . 26 ( 5 ): 1275 - 1285 . http://ope.lightpublishing.cn/thesisDetails?columnId=1415824&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1415824&Fpath=&index=-1&l=zh .

冯佳睿 , 马晓丹 , 关海鸥 , 等 . 基于深度信息的大豆株高计算方法 . 光学学报 , 2019 . 39 ( 5 ): 0515003 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=gxxb201905032 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=gxxb201905032 .

J R FENG , X D MA , H O GUAN , 等 . Calculation method of soybean plant height based on depth information . Acta Optica Sinica , 2019 . 39 ( 5 ): 0515003 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=gxxb201905032 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=gxxb201905032 .

郭彩玲 , 刘刚 . 基于颜色取样的苹果树枝干点云数据提取方法 . 农业机械学报 , 2019 . 50 ( 10 ): 189 - 196 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=nyjxxb201910021 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=nyjxxb201910021 .

C L GUO , G LIU . Point cloud extraction of apple tree canopy branch based on color sampling . Transactions of the Chinese Society for Agricultural Machinery , 2019 . 50 ( 10 ): 189 - 196 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=nyjxxb201910021 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=nyjxxb201910021 .

MACKNOJIA R. Design and Calibration of a Network of RGB-D Sensors for Robotic Applications over Large Workspaces [D]. Universitéd' Ottawa/University of Ottawa, 2013.

徐连瑞 , 张锦明 . 基于Kinect的室内环境建模 . 系统仿真学报 , 2019 . 31 ( 12 ): 2643 - 2651 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=D01521151 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=D01521151 .

L R XU , J M ZHANG . Modeling indoor environment with kinect . Journal of System Simulation , 2019 . 31 ( 12 ): 2643 - 2651 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=D01521151 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=D01521151 .

D Y LEE , S A PARK , S J LEE , 等 . Segmental tracheal reconstruction by 3D-printed scaffold: Pivotal role of asymmetrically porous membrane . The Laryngoscope , 2016 . 126 ( 9 ): E304 - E309 . DOI: 10.1002/lary.25806 http://doi.org/10.1002/lary.25806 .

丁忠军 , 赵子毅 , 张春堂 , 等 . 载人潜水器的深海地貌线结构光三维重建 . 红外与激光工程 , 2019 . 48 ( 5 ): 0503001 http://www.cqvip.com/QK/91846A/20195/7002138501.html http://www.cqvip.com/QK/91846A/20195/7002138501.html .

ZH J DING , Z Y ZHAO , CH T ZHANG , 等 . 3D reconstruction of deep sea geomorphologic linear structured light based on manned submersible . Infrared and Laser Engineering , 2019 . 48 ( 5 ): 0503001 http://www.cqvip.com/QK/91846A/20195/7002138501.html http://www.cqvip.com/QK/91846A/20195/7002138501.html .

王鹏 , 杨文超 , 孙长库 , 等 . 舌面彩色三维点云的舌体分割及舌裂纹提取 . 红外与激光工程 , 2017 . 46 ( S1 ): 88 - 95 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=hwyjggc2017z1014 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=hwyjggc2017z1014 .

P WANG , W CH YANG , CH K SUN , 等 . Tongue segmentation and tongue crack extraction of tongue 3D color point cloud . Infrared and Laser Engineering , 2017 . 46 ( S1 ): 88 - 95 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=hwyjggc2017z1014 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=hwyjggc2017z1014 .

F TOPAK , M K PEKERIÇLI , A M TANYER . Technological viability assessment of bluetooth low energy technology for indoor localization . Journal of Computing in Civil Engineering , 2018 . 32 ( 5 ): 04018034 DOI: 10.1061/(ASCE)CP.1943-5487.0000778 http://doi.org/10.1061/(ASCE)CP.1943-5487.0000778 .

冯筠 , 延瑜瑜 , 赵妍 , 等 . 基于学习不变特征变换的兵马俑图像分区匹配 . 光学精密工程 , 2018 . 26 ( 7 ): 1774 - 1783 . http://ope.lightpublishing.cn/thesisDetails?columnId=1420510&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1420510&Fpath=&index=-1&l=zh .

J FENG , Y Y YAN , Y ZHAO , 等 . A terracotta image partition matching method based on learned invariant feature transform . Opt. Precision Eng. , 2018 . 26 ( 7 ): 1774 - 1783 . http://ope.lightpublishing.cn/thesisDetails?columnId=1420510&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1420510&Fpath=&index=-1&l=zh .

屈也频 , 侯旺 . 基于误差传播理论的PnP问题姿态精度分析 . 光学精密工程 , 2019 . 27 ( 2 ): 479 - 487 . http://ope.lightpublishing.cn/thesisDetails?columnId=1425320&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1425320&Fpath=&index=-1&l=zh .

Y P QU , W HOU . Attitude accuracy analysis of PnP based on error propagation theory . Opt. Precision Eng. , 2019 . 27 ( 2 ): 479 - 487 . http://ope.lightpublishing.cn/thesisDetails?columnId=1425320&Fpath=&index=-1&l=zh http://ope.lightpublishing.cn/thesisDetails?columnId=1425320&Fpath=&index=-1&l=zh .

Y F QU , J Y HUANG , X ZHANG . Rapid 3D reconstruction for image sequence acquired from UAV camera . Sensors , 2018 . 18 ( 1 ): E225 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=sensors-18-00225 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=sensors-18-00225 .

王浩云 , 闫茹琪 , 周小莉 , 等 . 基于局部点云的苹果外形指标估测方法 . 农业机械学报 , 2019 . 50 ( 5 ): 205 - 213 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=nyjxxb201905024 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=nyjxxb201905024 .

H Y WANG , R Q YAN , X L ZHOU , 等 . Apple shape index estimation method based on local point cloud . Transactions of the Chinese Society for Agricultural Machinery , 2019 . 50 ( 5 ): 205 - 213 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=nyjxxb201905024 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=nyjxxb201905024 .

Views

314

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Rotation-invariant 2D views-3D point clouds auto-encoder

Semantic segmentation of 3D point cloud based on self-attention feature fusion group convolutional neural network

Fast scan method of digital speckle and three-dimensional human body

Related Author

LIU Xianying

WU Qiuxia

KANG Wenxiong

LI Yuqiong

Jun YANG

Bozan LI

WANG Yong-xin

LU Bing-heng

Related Institution

School of Software Engineering， South China University of Technology

School of Automation Science and Engineering， South China University of Technology

Institute of Mechanics， Chinese Academy of Sciences

Faculty of Geomatics， Lanzhou Jiaotong University

School of Automation and Electrical Engineering， Lanzhou Jiaotong University

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰