Video stabilization with improved motion vector estimation

JI Shu-jiao; ZHU Ming; LEI Yan-min; HU Han-ping

doi:10.3788/OPE.20152305.1458

您当前的位置：

首页 >

文章列表页 >

Video stabilization with improved motion vector estimation

更新时间：2020-08-13

- Video stabilization with improved motion vector estimation
- Optics and Precision Engineering Vol. 23, Issue 5, Pages: 1458-1465(2015)
- 作者机构：
  
  1. 中国科学院长春光学精密机械与物理研究所,吉林长春,中国,130033
  2. 中国科学院大学北京,中国,100049
  3. 长春大学电子信息工程学院,吉林长春,130022
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20152305.1458
  CLC： V557;TN941.1
- Received：18 August 2014，
  
  Revised：10 September 2014，
  
  Published：25 May 2015
- 稿件说明：
移动端阅览
吉淑娇, 朱明, 雷艳敏等. 基于改进运动矢量估计法的视频稳像[J]. 光学精密工程, 2015,23(5): 1458-1465

JI Shu-jiao, ZHU Ming, LEI Yan-min etc. Video stabilization with improved motion vector estimation[J]. Editorial Office of Optics and Precision Engineering, 2015,23(5): 1458-1465
吉淑娇, 朱明, 雷艳敏等. 基于改进运动矢量估计法的视频稳像[J]. 光学精密工程, 2015,23(5): 1458-1465 DOI： 10.3788/OPE.20152305.1458.

JI Shu-jiao, ZHU Ming, LEI Yan-min etc. Video stabilization with improved motion vector estimation[J]. Editorial Office of Optics and Precision Engineering, 2015,23(5): 1458-1465 DOI： 10.3788/OPE.20152305.1458.

摘要

提出用改进的运动矢量估计方法对视频序列进行运动补偿

以有效去除机载成像设备摄取视频序列的帧间抖动

实现电子稳像。介绍了BRISK算子提取特征的模型和算子描述方式

利用BRISK算子提取相邻帧的稳定特征点并进行匹配

结合参数仿射变换模型实现帧间运动矢量粗估计。为了提高运动矢量估计的精度

引入粒子滤波解决因特征点景深不同引起的运动矢量估计失准的问题

继而采用加权最小二乘法改进运动矢量估计。最后采用卡尔曼滤波从全局运动矢量里分离出运动补偿分量

对视频序列进行逐帧补偿。实验表明

视频序列稳像后的帧间变换保真度值提高了近3 db

显示提出的的稳像算法可以处理复杂运动下视频的帧间抖动

且快速准确并具有一定的鲁棒性。

Abstract

An improved motion vector estimation algorithm was proposed to remove effectively the inter frame jitter of the video sequences recorded by airborne imaging equipment and to realize the electronic image stability. The BRISK operator and the corresponding feature extraction model were introduced. Then

the BRISK operator was employed to extract and match the stable feature points of neighbor frames. By combining with the affine transformation motion model

the rough estimation of inter frame motion vectors was implemented. To improve the accuracy of motion vector estimation

the particle filter with the weighted least-square method was employed to solve the problem of the motion vector calculation inaccuracy caused by different depths of the feature points. Finally

the Kalman filter was used to separate the jitter components from the global motion vectors for compensating the video sequences frame by frame. The experimental result indicates that the inter-frame transformation fidelity (ITF) of video sequence has improved about 3 db

which verifies that the proposed stabilized algorithm removes inter-frame jitter of high frequency under complicated movement with fast speed

higher accuracy and stronger robustness.

关键词

Keywords

references

LEE T H, LEE Y G, SONG B CH. Fast 3D video stabilization using ROI-based warping [J]. Journal of Visual Communication and Image Representation, 2014, 25(5):943-950.

ZHOU Z H, JIN H L, MA Y. Plane-based content preserving warps for video stabilization[C].IEEE Conference on Computer Vision and Pattern Recognition(CVPR), 2013: 2299-2306.

遆晓光, 靳万鑫, 余颖. 大运动前景和旋转抖动视频的快速数字稳定[J]. 光学精密工程, 2014, 22(1):178-185. DI X G, JIN W X, YU Y. Digital video stabilization for large-scale moving foreground object and rotation jitter [J]. Opt. Precision Eng., 2014, 22(1):178-185. (in Chinese)

TANG CH ZH, WANG R G. Sparse moving factorization for subspace video stabilization [C]. 2014 IEEE International Conference on Acoustics, Speech and Signal Processing(ICASSP), 2014: 4314-4318.

孙辉. Bayer彩色序列图像的电子稳像[J]. 光学精密工程, 2014, 22(2):481-488. SUN H. Electronic image stabilization for Bayer color video sequence image [J].Opt. Precision Eng., 2014, 22(2): 481-488. (in Chinese)

KIM S W, YIN SH M, YUN K M, et al.. Spatio-temporal weighting in local patches for direct estimation of camera motion in video stabilization [J]. Computer Vision and Image Understanding, 2014, 118:71-83.

ZHU J J, GUO B L. Electronic image stabilization algorithms based on adaptive motion filter [J]. Journal of Theoretical and Applied Information Technology, 2013, 50(1):204-209.

WALHAA, WALI A, ALIMI A M. Video stabilization for aerial video surveillance [C]. AASRI Conference on Intelligent System and Control, 2013, 4:72-77.

AGUILAR W G, ANGULO C. Robust video stabilization based on motion intention for low-cost micro aerial vehicles [C].2014 11th International Conference on Multi-Conference on Systems, Signals & Devices, 2014:1-6.

SONG CH H, ZHAO H, JING W, et al..Robust video stabilization based on particle filtering with weighted feature points [J].IEEE Transactions on Consumer Electronics, 2012, 58(2):570-577.

初守燕, 席志红. 结合SURF的数字稳像技术[J]. 计算机辅助设计与图形图像学报, 2014, 26(2):241-247. CHU SH Y, XI ZH H, Digital image stabilization based on SURF[J].Journal of Computer-Aided Design & Computer Graphics, 2014, 26(2):241-247.(in Chinese)

KIM S K, KANG S J, WANG T S. et al.. Feature point classification based global motion estimation for video stabilization [J].IEEE Transactions on Consumer Electronics, 2013, 59(1):267-272.

LEUTENEGGER S, CHLI M, SIEGWA-RTRY. BRISK: binary robust invariant scalable keypoints [C]. 2011 IEEE International Conference on Computer Vision(ICCV), 2011:2548-2555.

林森, 苑玮琦, 宋辉. 二进制鲁棒不变尺度特征在非接触掌纹识别中的应用[J]. 仪器仪表学报, 2013, 34(12): 2785-2792. LIN S, YUAN W Q, SONG H. Application of binary robust invariant scalable keypoints in non-contact palmprint recognition [J].Chinese Journal of Scientific Instrument, 2013, 34(12): 2785-2792. (in Chinese)

王灿进, 孙涛, 陈娟. 局部不变特征匹配的并行加速技术研究[J]. 液晶与显示, 2014, 29(2):266-273. WANG C J, SUN T, CHEN J. Speeding up local invariant feature matching using parallel technology[J]. Chinese Journal of Liquid Crystals and Displays, 2014, 29(2):266-273. (in Chinese)

王飞宇, 邸男, 贾平. 结合尺度空间FAST角点检测器和SURF描绘器的图像特征[J]. 液晶与显示, 2014, 29(4):598-604. WANG F Y, DI N, JIA P. Image features using scale-space FAST corner detector and SURF descriptor [J]. Chinese Journal of Liquid Crystals and Displays, 2014, 29(4):598-604. (in Chinese)

ROSTEN E, PORTER R, DRUMMOND T. Faster and better: a machine learning approach to corner detection [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32 (1):105-119.

YANG J, SCHONFELD D, CHEN C, et al.. Online video stabilization based on particle filters[C].2006 IEEE International Conference on Image Processing, 2006:1545-1548.

YANG J L, SCHONFELD D, MOHAMED M D. Robust video stabilization based on particle filter tracking of projected camera motion [J].IEEE Transactions on. Circuits and System for Video Technology, 2009, 19(7):945-954.

WANG Y R, TANG X L, QING C. Dynamic appearance model for particle filter based visual tracking [J]. Pattern Recognition, 2012, 45(12): 4510-4523.

WANG CH T, KIM J H, BYUN K Y, et al.. Robust digital image stabilization using the Kalman filter [J]. IEEE Transactions on Consumer Electronics, 2009, 55(1):6-14.

VERMA K, KUMAR A, GUPTA S, et al.. Fast and robust real time digital video stabilization with smear removal using integral projection curve warping technique[C]. 2014 Twentieth National Conference on Communications, 2014:1-6.

Views

521

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Feature-based approach for stabilizing videos with moving objects

EIS for ground-based imaging systems supporting scene switching perception

Binocular vision SLAM with fused point and line features in weak texture environment

Adaptive feature matching network for object occlusion

A visual SLAM algorithm based on adaptive inertial navigation assistant feature matching

Related Author

QIU Jia-tao

LI Yu-shan

CHU Xiu-qin

LIU Yang

NI Le-zhen

SONG Liduo

LI Hongwen

WANG Minghao

Related Institution

Institute of Electronic CAD, Xidian University

Academy for Advanced Interdisciplinary Studies， Northeast Normal University

Changchun Institute of Optics，Fine Mechanics and Physics，Chinese Academy of Sciences

National Innovation Institute of Defense Technology， Academy of Military Science

Unmanned System Research Institute， Northwestern Polytechnical University

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰