Digital video stabilization for large-scale moving foreground object and rotation jitter

DI Xiao-guang; JIN Wan-xin; YU Ying

doi:10.3788/OPE.20142201.0177

您当前的位置：

首页 >

文章列表页 >

Digital video stabilization for large-scale moving foreground object and rotation jitter

Information Sciences | 更新时间：2020-08-13

- Digital video stabilization for large-scale moving foreground object and rotation jitter
- Optics and Precision Engineering Vol. 22, Issue 1, Pages: 177-185(2014)
- 作者机构：
  
  1. 哈尔滨工业大学控制与仿真中心,黑龙江哈尔滨,150080
  2. 空间重点物理实验室北京,10076
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20142201.0177
  CLC： TP391.4
- Received：10 May 2013，
  
  Published：15 January 2014
- 稿件说明：
移动端阅览
遆晓光, 靳万鑫, 余颖. 大运动前景和旋转抖动视频的快速数字稳定[J]. 光学精密工程, 2014,22(1): 177-185

DI Xiao-guang, JIN Wan-xin, YU Ying. Digital video stabilization for large-scale moving foreground object and rotation jitter[J]. Editorial Office of Optics and Precision Engineering, 2014,22(1): 177-185
遆晓光, 靳万鑫, 余颖. 大运动前景和旋转抖动视频的快速数字稳定[J]. 光学精密工程, 2014,22(1): 177-185 DOI： 10.3788/OPE.20142201.0177.

DI Xiao-guang, JIN Wan-xin, YU Ying. Digital video stabilization for large-scale moving foreground object and rotation jitter[J]. Editorial Office of Optics and Precision Engineering, 2014,22(1): 177-185 DOI： 10.3788/OPE.20142201.0177.

摘要

针对存在大的旋转抖动和大的运动前景的视频

提出了一种快速电子稳像方法。由于现有圆周投影法在估计图像大角度旋转运动时鲁棒性较差

故对算法进行了改进以提高投影相关匹配时的准确性。考虑常用的稳像算法难以处理含较大或较多运动前景的抖动视频

提出一种基于图像位平面金字塔的自适应取块平移运动估计方案; 该方案可根据块匹配结果的统计特性决策最优取块模式

最大程度地避免运动前景对运动参数估计的干扰。最后

引入一种自适应分组的限幅加均值复合滤波方式

一方面通过限幅滤波修正帧间错误运动估计

另一方面自适应分组确定滤波窗口以达到较佳运动平滑效果。实验结果表明:改进的圆周投影法旋转估计的准确性和稳健性均有提高;自适应取块的平移运动估计方案能够准确估计较大运动前景抖动视频的运动参数

同时也适用于灰度特征不丰富的抖动视频;稳像的信噪比峰值可达31.08 dB。

Abstract

For video images with large-scale moving foreground objects and rotation jitters

a new fast digital image stabilization algorithm was proposed. According to the poor robustness of the existing circular-projection algorithm to estimate video's rotation jitter with large angles

several modifications for existing circular-projection algorithm was performed to improve the accuracy in the projection correlation matching.As the jitter videos contain larger or much more moving foreground objects

a novel Adaptive Block-selected Matching Algorithm (ABSMA) based on image bit-plane pyramid was proposed to determine the optimal block selection mode according to statistical characteristics of block matching results and to effectively reduce moving foreground objects on global motion estimation. Finally

an adaptive compound filter using the frame grouping and mean filter with a limiting magnitude was introduced

which could not only correct the inter-frame motion estimation error by limiting filter

but also could determine a filtering window to achieve better smoothness of motion by an adaptive frame grouping. Experimental results show that modified circular-projection algorithm has significant effect on improving the accuracy and robustness of image stabilization and the ABSMA can accurately estimate motion parameters of jitter videos with larger or more moving foreground objects. The proposed algorithm is also suitable for the jitter videos without rich gray features and its mean Peak Signal-to-noise Ratio(PSNR) can reach 31.08 dB.

关键词

Keywords

references

赵红颖, 金宏, 熊经武.电子稳像技术概述[J].光学精密工程, 2001, 9(4):353-359.

ZHAO H Y, JIN H , XIONG J W. A brief description of electronic image stabilization techniques [J]. Opt. Precision Eng., 2001, 9(4):353-359 .(in Chinese)

罗诗途, 王艳玲, 张玘, 等.车载图像跟踪系统中电子稳像算法的研究[J]. 光学精密工程, 2005, 13(1):95-103.

LUO SH T, WANG Y L, ZHANG Q, et al.. Electronic image stabilizing algorithm for image tracking system on vehicle [J]. Opt. Precision Eng., 2005, 13(1):95-103.(in Chinese)

郭宝龙, 朱娟娟, 孙伟. 电子稳像的分层位平面全局运动估计算法[J]. 光子学报, 2009, 38(11):2993-2998.

GUO B L, ZHU J J, SUN W. Hierarchical bit-plane global motion estimation for image stabilization [J]. Acta Photonica Sinica, 2009, 38(11): 2993-2998.(in Chinese)

张坤, 许廷发, 王平, 等. 高精度实时全帧频SURF电子稳像方法[J].光学精密工程, 2011, 19(8):1964-1972.

ZHANG K, XU T F, WANG P, et al.. Real time full frame digital image stabilization system by SURF[J]. Opt. Precision Eng., 2011, 19(8):1964-1972.(in Chinese)

YANG J L, SCHONFELD D, MOHANED M.Robust video stabilization based on particle filter tracking of projected camera motion [J].IEEE Transactions on Circuits and Systems for Video Technol., 2009, 19(7):945-954.

王智慧, 王敬东, 李鹏, 等.一种基于KLT-RANSAC全局运动估计的电子稳像算法研究[J].光电子技术, 2012, 32(1):46-55.

WANG ZH H, WANG J D, LI P, et al..Research on electronic image stabilization based on KLT-RANSAC global motion estimation [J].Opto.Electronic Technology, 2012, 32(1):46-55.(in Chinese)

蔡昌金, 李友毅, 朱明. 基于圆周投影匹配的电子稳像技术研究[J]. 压电与声光, 2009, 31(3): 341-343.

CAI CH J, LI Y Y, ZHU M. Research of electronic image stability based on the circular projection matching [J]. Piezoelectrics & Acoustooptics, 2009, 31(3):341-343.(in Chinese)

XIE T, ZHU B, XIE L J, et al.. A circular-projection based digital image stabilization algorithm and its implementation for rotating image sequences [C]. International Conference on Signal ProcessingProceedings, 2010:1236-1239.

LIU K X, QIAN J, YANG R K. Block matching algorithm based on RANSAC algorithm [C]. International Conference on Image Analysis and Signal Processing, 2010:223-227.

XI L D, LIN X G. Digital image stabilization based on circular block matching [J]. IEEE Transaction on Consumer Electrionics, 2006, 52(2): 566-574.

邱家涛, 李玉山, 初秀琴, 等. 稳定运动物体视频的特征方法[J]. 光学精密工程, 2012, 20(10):2300-2307.

QIU J T, LI Y SH, CHU X Q, et al.. Feature-based approach for stabilizing videos with moving objects[J]. Opt. Precision Eng., 2012, 20(10): 2300-2307.(in Chinese)

Views

228

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Fast digital image stabilization based on characteristic peak of projection matching

Real-time full-frame digital image stabilization system by SURF

Feature matching electronic image stabilization based on binary robust invariant scalable keypionts

Electronic image stabilization for Bayer color video sequence image

Digital image stabilization based on improved Noble feature matching

Related Author

SUN Qiang

WANG Fei

LIU Jian-zhuo

ZHAO Jian

WANG Fang

ZHANG Yan-chao

ZHANG Kun

XU Ting-fa

Related Institution

The First Engineer Scientific Research Institute of the General Armament Department

Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences

University of Chinese Academy of Sciences

School of Optics and Electronics, Beijing Institute of Technology, Beijing 100081, China

Key Laboratory of Photoelectronic Imaging Technology and System of the Ministry of Education of China, Beijing Institute of Technology, Beijing 100081, China

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰