Satellite cloud image inpainting based on patch matching and sparse representation

JIN Wei; WANG Wen-long; FU Ran-di; TIAN Wen-zhe; YIN Cao-qian

doi:10.3788/OPE.20142207.1886

您当前的位置：

首页 >

文章列表页 >

Satellite cloud image inpainting based on patch matching and sparse representation

更新时间：2020-08-13

- Satellite cloud image inpainting based on patch matching and sparse representation
- Optics and Precision Engineering Vol. 22, Issue 7, Pages: 1886-1895(2014)
- 作者机构：
  
  宁波大学信息科学与工程学院,浙江宁波,315211
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20142207.1886
  CLC： TP75
- Received：10 October 2013，
  
  Revised：29 November 2013，
  
  Published：25 July 2014
- 稿件说明：
移动端阅览
金炜, 王文龙, 符冉迪等. 联合块匹配与稀疏表示的卫星云图修复[J]. 光学精密工程, 2014,22(7): 1886-1895

JIN Wei, WANG Wen-long, FU Ran-di etc. Satellite cloud image inpainting based on patch matching and sparse representation[J]. Editorial Office of Optics and Precision Engineering, 2014,22(7): 1886-1895
金炜, 王文龙, 符冉迪等. 联合块匹配与稀疏表示的卫星云图修复[J]. 光学精密工程, 2014,22(7): 1886-1895 DOI： 10.3788/OPE.20142207.1886.

JIN Wei, WANG Wen-long, FU Ran-di etc. Satellite cloud image inpainting based on patch matching and sparse representation[J]. Editorial Office of Optics and Precision Engineering, 2014,22(7): 1886-1895 DOI： 10.3788/OPE.20142207.1886.

摘要

针对卫星云图在接收及传输过程中受噪声、大气湍流、太阳风暴及卫星轨道漂移等影响造成的云图数据破损，提出了一种联合块匹配与稀疏表示的卫星云图修复方法。首先，根据破损区域的优先权值确定待修复像素，对该像素的邻域进行分块处理。然后，利用待修复块与各匹配块之间的结构相似度，建立相应的冗余字典；通过求解稀疏表示问题修复该破损区域。最后，沿着等照度线不断更新优先权值，实现整幅图像的修复。实验结果表明，提出的方法不仅能避免传统偏微分方程（PDE）修复法所导致的结构丢失，也能很好地改善基于纹理填充修复方法所导致的修复不足及块效应现象。测试结果显示：在云图存在局部区域缺失时，修复后云图的峰值信噪比（PSNR）比匹配追踪法及总变分法的修复结果平均提高了8.50 dB和0.28 dB，而且在纹理细节及边缘区域具有更好的视觉效果。

Abstract

For some defects of satellite cloud images caused by noises

atmospheric turbulence

solar storms and satellite orbit drifts in the receiving and transmission process

a novel satellite cloud image inpainting method using patch matching and sparse representation was proposed.Firstly

a pixel to be inpainted was searched according to the priority of the damaged area.The neighborhood of this pixel was divided into patches

and a redundant dictionary was constructed by calculating the structural similarity of inpainting patch and matching patches.Then the damaged area was repaired by solving a sparse representation problem.Finally

the whole cloud image was inpainted by updating priority along an isophote repeatedly.The experimental results show that the proposed method can not only avoid the structure missing from the traditional Partial Differential Equation (PDE) method

but also can improve the texture details and blocking effect of the texture filling repair method.For the cloud image with local defects

the inpainted image by proposed method can improve Peak Signal to Noise Ratio(PSNR) by 8.50 dB and 0.28 dB as compared to Matching Pursuit (MP) method and Total Variation (TV) method respectively.It shows better visual effects on texture details and edge regions.

关键词

Keywords

references

赵姼,周其永,毛成忠. FY卫星系统云图失真问题的一种解决方法[J]. 气象水文海洋仪器,2011,2(6):114-118. ZHAO SH,ZHOU Q Y,MAO CH ZH. A method for solving abnormal images in FY meteorological satellite system[J]. Meteorological,Hydrological and Marine Instruments,2011,2(6):114-118. (in Chinese)

朱长明,沈占锋,骆剑承,等. 基于MODIS数据的Landsat-7 SLC-off影像修复方法研究[J]. 测绘学报,2010,39(6):251-256. ZHU CH M,SHEN ZH F,LOU J CH,et al. Research on landsat-7 SLC-off image restoration method based on MODIS09 data[J]. Acta Geodaetica et Cartographica Sinica,2010,39(6):251-256. (in Chinese)

吕恒毅,刘杨,薛旭成. 遥感图像星上背景扣除和灰度拉伸方案与实验[J]. 液晶与显示,2012,27(2):235-240. LV H Y,LIU Y,XUE X CH. Methods and experiments of background subtraction and grayscale stretch for remote sensing images[J]. Chinese Journal of Liquid Crystals and Displays,2012,27(2):235-240. (in Chinese)

BERTALMIO M,SAPIRO G,CASELLES V,et al. Proceedings of international conference on computer graphics and interactive techniques. New Orleans,Louisiana USA,2000,1:417-424.

CRIMINISI A,PEREA P,TOYAMA K. Region filling and object removal by exemplar-based image inpainting[J]. IEEE Transactions on Image Processing, 2004,13(9):1200-1212.

冯亮,王平,许廷发,等. 运动模糊退化图像的双字典稀疏复原[J]. 光学精密工程,2011,19(8):1982-1989. FENG L,WANG P,XU T F,et al. Dual dictionary sparse restoration of blurred images[J]. Opt. Precision Eng. ,2011,19(8):1982-1989. (in Chinese)

ZHOU M,CHEN H,PAISLEY J,et al. Nonparametric Bayesian dictionary learning for analysis of noisy and incomplete images[J]. IEEE Transactions on Image Processing, 2012,21(1):130-144.

曾文静,万磊,张铁栋,等. 复杂海空背景下弱小目标的自动检测[J]. 光学精密工程,2012,20(2):403-413. ZENG W J,WAN L,ZHANG T D,et al. Fast detection of weak targets in complex sea-sky background[J]. Opt. Precision Eng. ,2012,20(2):403-413. (in Chinese)

李民,程建,李小文,等. 非局部学习字典的图像修复[J]. 电子与信息学报,2011,33(11):2672-2678. LI M,CHENG J,LI X W,et al. Image inpainting based on non-local learned dictionary[J]. Journal of Electronics & Information Technology,2011,33(11):2672-2678. (in Chinese)

李长洋. 基于稀疏性的图像分层修复. 成都:西南交通大学,2010. LI CH Y. Image inpainting based on decomposition. Chengdu:Xi'Nan jiaotong University,2010. (in Chinese)

刘洋,田小建,王晴,等. 采用局部分形的高效图像分割方法在红外云图处理中的应用[J]. 光学精密工程,2011,19(6):1367-1375. LIU Y,TIAN X J,WANG Q,et al. Application of efficient image segmentation method based on local fractal in the infrared cloud image process[J]. Opt. Precision Eng. ,2011,19(6):1367-1375. (in Chinese)

WANG ZH,BOVIK A C,SHEIKH H R,et al. Image quality assessment from error visibility to structural similarity[J]. IEEE Transactions on Image Processing,2004,13(4):600-612.

AHARON M,ELAD M,BRUCKSTEIN A. K-SVD:An algorithm for designing overcomplete dictionaries for sparse representation[J]. IEEE Trans. Signal Process,2006,54(11):4311-4322.

吴君钦,李艳丽,刘昊. "类整数DCT"变换基去相关性能分析[J]. 液晶与显示,2013,28(2):278-284. WU J Q,LI Y L,LIU H. De-correlation characteristic analysis of variety integer DCT transform radix[J]. Chinese Journal of Liquid Crystals and Displays,2013,28(2):278-284. (in Chinese)

GETREUER P. RED:tvreg v2:Variational Imaging Methods for Denoising,Deconvolution,Inpainting,and Segmentation. http://www. mathworks. com/matlabcentral/fileexchange/29743-tvreg. 2012. 11.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Using image smoothing structure information to guide image inpainting

Blind image deconvolution via cross-scale dictionary learning

Remote sensing image super-resolution based on improved sparse representation

Image inpainting using gradient features and color consistency

Visual tracking algorithm based on the sparse-regularized subspace

Related Author

ZHANG Huaikun

DONG Zilong

LIU Jizhao

ZHANG Jiajun

LIAN Jing

Tian-qi PENG

Jing YU

Le-ning GUO

Related Institution

School of Information Science and Engineering， Lanzhou University

School of Electronic and Information Engineering， Lanzhou Jiaotong University

Faculty of Information Technology， Beijing University of Technology

College of Electronic Engineering, Heilongjiang University

College of Electrical Engineering and Information, Southwest Petroleum University

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰