Image completion with global optimization based on four-direction features

LI Zhi-dan; HE Hong-jie; CHEN Fan; YIN Zhong-ke

doi:10.3788/OPE.20152304.1171

您当前的位置：

首页 >

文章列表页 >

Image completion with global optimization based on four-direction features

更新时间：2020-08-13

- Image completion with global optimization based on four-direction features
- Optics and Precision Engineering Vol. 23, Issue 4, Pages: 1171-1178(2015)
- 作者机构：
  
  1. 北京遥感信息研究所北京,100192
  2. 西南交通大学信号与信息处理四川省重点实验室,四川成都,610031
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20152304.1171
  CLC： TP391.41
- Received：04 December 2014，
  
  Revised：22 January 2015，
  
  Published：25 April 2015
- 稿件说明：
移动端阅览
李志丹, 和红杰, 陈帆等. 联合4方向特征的全局优化图像补全[J]. 光学精密工程, 2015,23(4): 1171-1178

LI Zhi-dan, HE Hong-jie, CHEN Fan etc. Image completion with global optimization based on four-direction features[J]. Editorial Office of Optics and Precision Engineering, 2015,23(4): 1171-1178
李志丹, 和红杰, 陈帆等. 联合4方向特征的全局优化图像补全[J]. 光学精密工程, 2015,23(4): 1171-1178 DOI： 10.3788/OPE.20152304.1171.

LI Zhi-dan, HE Hong-jie, CHEN Fan etc. Image completion with global optimization based on four-direction features[J]. Editorial Office of Optics and Precision Engineering, 2015,23(4): 1171-1178 DOI： 10.3788/OPE.20152304.1171.

摘要

为更好地保持修复后图像的结构连贯性及与邻域信息的连续一致性

提出了联合4方向特征的全局优化图像补全算法。该方法利用Curvelet变换提取图像的水平

垂直

正对角及反对角4个方向的特征。在构造数据项和平滑项能量时

利用4方向特征与颜色信息共同衡量样本块间的相似性

以此构造符合人眼视觉要求的全局能量约束方程;同时自适应确定计算数据项和平滑项能量的样本块尺寸。最后利用图割算法求取全局能量的极小值

获得修复图像。实验显示:与现有算法相比

提出算法可以获得更优的修复结果

其峰值信噪比(PSNR)平均值比现有算法至少高出2 dB

验证了提出算法的有效性;结果也表明:提出的算法可以更好地保持图像结构的连贯性及修复区域内的连续一致性

能满足人眼视觉需求。

Abstract

To better maintain the structure coherence and neighborhood consistence of inpainted images

this paper proposes an image completion algorithm by using global optimization based on four-direction features. In the algorithm

the Curvelet transform was adopted to extract the features in horizontal

vertical

positive diagonal and antidiagonal directions. when the data term and smooth term energy were constructed

the four-direction features were combined with color information to measure the similarity between patches and to construct a global energy constraint equation to satisfy human eye visual requirement. Meanwhile

the sizes of patches used to compute data term and smooth term energy were adaptively determined. Finally

the graph cut algorithm was applied to calculation of the minimum value of global energy to obtain the inpainted image. The experimental results show that the proposed algorithm achieves better inpainted results. Moreover

the Peak Signal to Noise Ratio(PSNR) values of the proposed method are much larger than that of the existing methods

and the PSNR on average is higher 2 dB than that of the existing methods. The objective and subjective evaluations both show the validity of the proposed method. It concludes that the proposed algorithm has better maintained the structure coherence and neighborhood consistence

which makes the repaired images meet the human eye visual requirements.

关键词

Keywords

references

BERTALMIO M, SAPIRO G, CASELLES V, et al.. Image inpainting[C]. Proceeding of the 27th Annual Conference on Computer Graphics and Interactive Techniques, 2000, 417-424.

曾文静, 万磊, 张铁栋, 等. 复杂海空背景下弱小目标的快速自动检测[J]. 光学精密工程, 2012, 20(2): 403-412. ZENG W J, WAN L, ZHANG T D, et al.. Fast detection of weak targets in complex sea-sky background [J]. Opt. Precision Eng., 2012, 20(2): 403-412. (in Chinese)

ELAD M, STARCK J L, QUERRE P, et al.. Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA) [J]. Applied and Computational Harmonic Analysis, 2005, 19(3):340-358.

邓承志, 刘娟娟, 汪胜前, 等. 保留结构特征的稀疏性正则化图像修复[J]. 光学精密工程, 2013, 21(7): 1906-1913. DENG CH ZH, LIU J J, WANG SH Q, et al.. Feature retained image inpainting based on sparsity regularization [J]. Opt. Precision Eng., 2013, 21(7): 1906-1913. (in Chinese)

金炜, 王文龙, 符冉迪, 等. 联合块匹配与稀疏表示的卫星云图修复[J]. 光学精密工程, 2014, 22(7): 1886-1895. JIN W, WANG W L, FU R D, et al.. Satellite cloud image inpainting based on patch matching and sparse representation [J]. Opt. Precision Eng., 2014, 22(7):1886-1895. (in Chinese)

DONG W S, SHI G M, LI X, Nonlocal image restoration with bilateral variance estimation: a low-rank approach [J]. IEEE Transactions on Image Processing, 2013, 22(2): 700-711.

CRIMINISI A, PEREZ P, TOYAMA K. Region filling and object removal by exemplar-based image inpainting [J]. IEEE Transactions on Image Processing, 2004, 13(9): 1200-1212.

李志丹, 和红杰, 尹忠科, 等. 结合颜色和梯度信息的稀疏图像修复算法[J]. 计算机研究与发展, 2014, 51(9): 2081-2093. LI ZH D, HE H J, YIN ZH K, et al.. A sparsity image inpainting algorithm combining color with gradient information [J]. Journal of Computer Research and Development, 2014, 51(9): 2081-2093. (in Chinese)

PRITCH Y, KAV-VENAKI E, PELEG S. Shift-map image editing[C]. Proceeding of IEEE International Conference on Computer Vision, 2009: 151-158.

BOYKOV Y, VEKSLER O, ZABIH R. Fast approximate energy minimization via graph cuts [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(11): 1222-1239.

HE K M, SUN J. Statistics of patch offsets for image completion[C]. European Conference on Computer Vision (ECCV), 2012:16-29.

XUE W, ZHANG R. Graph-based image completion using patch offsets and structure feature[C]. Fifth International Conference on Graphic and Image Processing, International Society for Optics and Photonics, 2014: 906906-906906-9.

LE MEUR O, EBDELLI M, GUILLEMOT C. Hierarchical super-resolution-based inpainting [J]. IEEE Transactions on Image Processing, 2013, 22(10): 3779-3790.

LIU Y Q, CASELLES V. Exemplar-based image inpainting using multiscale graph cuts [J]. IEEE Transactions on Image Processing, 2013, 22(5): 1699-1711.

CHOI S, HAM B, SOHN K. Space-time hole filling with random walks in view extrapolation for 3D video [J]. IEEE Transactions on Image Processing, 2013, 22(6): 2429-2441.

赵亮, 和红杰, 尹忠科. 基于Curvelet的纹理方向自适应图像值[J]. 光电子·激光, 2012, 23(4): 798-804. ZHAO L, HE H J, YIN ZH K. Texture direction adaptive image interpolation based on Curvelet transform [J]. Journal of Optoelectronics· Laser, 2012, 23(4): 798-804. (in Chinese)

Views

340

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Design and application of fast matching method based on support points expansion

Parallel stereo matching algorithm base on belief propagation

Related Author

ZHOU Zi-wei

FAN Ji-zhuang

LI Ge

ZHAO Jie

ZHANG He

ZHOU Zi-wei

FAN Ji-zhuang

ZHAO Jie

Related Institution

State Key Laboratory of Robotics and System, Harbin Institute of Technology2.School of Electronics and Information Engineering, Liaoning University of Science and Technology

State Key Laboratory of Robotics and System, Harbin Institute of Technology

School of Electronics Information, Liaoning University of Science and Technology

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰