基于改进运动矢量估计法的视频稳像

吉淑娇; 朱明; 雷艳敏; 胡汉平

doi:10.3788/OPE.20152305.1458

您当前的位置：

首页 >

文章列表页 >

基于改进运动矢量估计法的视频稳像

信息科学 | 更新时间：2020-08-13

- 基于改进运动矢量估计法的视频稳像
- Video stabilization with improved motion vector estimation
- 光学精密工程 2015年23卷第5期页码：1458-1465
- 作者机构：
  
  1. 中国科学院长春光学精密机械与物理研究所,吉林长春,中国,130033
  2. 中国科学院大学北京,中国,100049
  3. 长春大学电子信息工程学院,吉林长春,130022
- 作者简介：
- 基金信息：
  
  国家自然科学基金资助项目(No.61203242)();吉林省科技发展计划资助项目(No.20140101084JC)();吉林省教育厅资助项目(No.2015LY50
- DOI：10.3788/OPE.20152305.1458
  中图分类号： V557;TN941.1
- 收稿日期：2014-08-18，
  
  修回日期：2014-09-10，
  
  纸质出版日期：2015-05-25
- 稿件说明：
移动端阅览
吉淑娇, 朱明, 雷艳敏等. 基于改进运动矢量估计法的视频稳像[J]. 光学精密工程, 2015,23(5): 1458-1465

JI Shu-jiao, ZHU Ming, LEI Yan-min etc. Video stabilization with improved motion vector estimation[J]. Editorial Office of Optics and Precision Engineering, 2015,23(5): 1458-1465
吉淑娇, 朱明, 雷艳敏等. 基于改进运动矢量估计法的视频稳像[J]. 光学精密工程, 2015,23(5): 1458-1465 DOI： 10.3788/OPE.20152305.1458.

JI Shu-jiao, ZHU Ming, LEI Yan-min etc. Video stabilization with improved motion vector estimation[J]. Editorial Office of Optics and Precision Engineering, 2015,23(5): 1458-1465 DOI： 10.3788/OPE.20152305.1458.

摘要

提出用改进的运动矢量估计方法对视频序列进行运动补偿

以有效去除机载成像设备摄取视频序列的帧间抖动

实现电子稳像。介绍了BRISK算子提取特征的模型和算子描述方式

利用BRISK算子提取相邻帧的稳定特征点并进行匹配

结合参数仿射变换模型实现帧间运动矢量粗估计。为了提高运动矢量估计的精度

引入粒子滤波解决因特征点景深不同引起的运动矢量估计失准的问题

继而采用加权最小二乘法改进运动矢量估计。最后采用卡尔曼滤波从全局运动矢量里分离出运动补偿分量

对视频序列进行逐帧补偿。实验表明

视频序列稳像后的帧间变换保真度值提高了近3 db

显示提出的的稳像算法可以处理复杂运动下视频的帧间抖动

且快速准确并具有一定的鲁棒性。

Abstract

An improved motion vector estimation algorithm was proposed to remove effectively the inter frame jitter of the video sequences recorded by airborne imaging equipment and to realize the electronic image stability. The BRISK operator and the corresponding feature extraction model were introduced. Then

the BRISK operator was employed to extract and match the stable feature points of neighbor frames. By combining with the affine transformation motion model

the rough estimation of inter frame motion vectors was implemented. To improve the accuracy of motion vector estimation

the particle filter with the weighted least-square method was employed to solve the problem of the motion vector calculation inaccuracy caused by different depths of the feature points. Finally

the Kalman filter was used to separate the jitter components from the global motion vectors for compensating the video sequences frame by frame. The experimental result indicates that the inter-frame transformation fidelity (ITF) of video sequence has improved about 3 db

which verifies that the proposed stabilized algorithm removes inter-frame jitter of high frequency under complicated movement with fast speed

higher accuracy and stronger robustness.

关键词

Keywords

references

LEE T H, LEE Y G, SONG B CH. Fast 3D video stabilization using ROI-based warping [J]. Journal of Visual Communication and Image Representation, 2014, 25(5):943-950.

ZHOU Z H, JIN H L, MA Y. Plane-based content preserving warps for video stabilization[C].IEEE Conference on Computer Vision and Pattern Recognition(CVPR), 2013: 2299-2306.

遆晓光, 靳万鑫, 余颖. 大运动前景和旋转抖动视频的快速数字稳定[J]. 光学精密工程, 2014, 22(1):178-185. DI X G, JIN W X, YU Y. Digital video stabilization for large-scale moving foreground object and rotation jitter [J]. Opt. Precision Eng., 2014, 22(1):178-185. (in Chinese)

TANG CH ZH, WANG R G. Sparse moving factorization for subspace video stabilization [C]. 2014 IEEE International Conference on Acoustics, Speech and Signal Processing(ICASSP), 2014: 4314-4318.

孙辉. Bayer彩色序列图像的电子稳像[J]. 光学精密工程, 2014, 22(2):481-488. SUN H. Electronic image stabilization for Bayer color video sequence image [J].Opt. Precision Eng., 2014, 22(2): 481-488. (in Chinese)

KIM S W, YIN SH M, YUN K M, et al.. Spatio-temporal weighting in local patches for direct estimation of camera motion in video stabilization [J]. Computer Vision and Image Understanding, 2014, 118:71-83.

ZHU J J, GUO B L. Electronic image stabilization algorithms based on adaptive motion filter [J]. Journal of Theoretical and Applied Information Technology, 2013, 50(1):204-209.

WALHAA, WALI A, ALIMI A M. Video stabilization for aerial video surveillance [C]. AASRI Conference on Intelligent System and Control, 2013, 4:72-77.

AGUILAR W G, ANGULO C. Robust video stabilization based on motion intention for low-cost micro aerial vehicles [C].2014 11th International Conference on Multi-Conference on Systems, Signals & Devices, 2014:1-6.

SONG CH H, ZHAO H, JING W, et al..Robust video stabilization based on particle filtering with weighted feature points [J].IEEE Transactions on Consumer Electronics, 2012, 58(2):570-577.

初守燕, 席志红. 结合SURF的数字稳像技术[J]. 计算机辅助设计与图形图像学报, 2014, 26(2):241-247. CHU SH Y, XI ZH H, Digital image stabilization based on SURF[J].Journal of Computer-Aided Design & Computer Graphics, 2014, 26(2):241-247.(in Chinese)

KIM S K, KANG S J, WANG T S. et al.. Feature point classification based global motion estimation for video stabilization [J].IEEE Transactions on Consumer Electronics, 2013, 59(1):267-272.

LEUTENEGGER S, CHLI M, SIEGWA-RTRY. BRISK: binary robust invariant scalable keypoints [C]. 2011 IEEE International Conference on Computer Vision(ICCV), 2011:2548-2555.

林森, 苑玮琦, 宋辉. 二进制鲁棒不变尺度特征在非接触掌纹识别中的应用[J]. 仪器仪表学报, 2013, 34(12): 2785-2792. LIN S, YUAN W Q, SONG H. Application of binary robust invariant scalable keypoints in non-contact palmprint recognition [J].Chinese Journal of Scientific Instrument, 2013, 34(12): 2785-2792. (in Chinese)

王灿进, 孙涛, 陈娟. 局部不变特征匹配的并行加速技术研究[J]. 液晶与显示, 2014, 29(2):266-273. WANG C J, SUN T, CHEN J. Speeding up local invariant feature matching using parallel technology[J]. Chinese Journal of Liquid Crystals and Displays, 2014, 29(2):266-273. (in Chinese)

王飞宇, 邸男, 贾平. 结合尺度空间FAST角点检测器和SURF描绘器的图像特征[J]. 液晶与显示, 2014, 29(4):598-604. WANG F Y, DI N, JIA P. Image features using scale-space FAST corner detector and SURF descriptor [J]. Chinese Journal of Liquid Crystals and Displays, 2014, 29(4):598-604. (in Chinese)

ROSTEN E, PORTER R, DRUMMOND T. Faster and better: a machine learning approach to corner detection [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32 (1):105-119.

YANG J, SCHONFELD D, CHEN C, et al.. Online video stabilization based on particle filters[C].2006 IEEE International Conference on Image Processing, 2006:1545-1548.

YANG J L, SCHONFELD D, MOHAMED M D. Robust video stabilization based on particle filter tracking of projected camera motion [J].IEEE Transactions on. Circuits and System for Video Technology, 2009, 19(7):945-954.

WANG Y R, TANG X L, QING C. Dynamic appearance model for particle filter based visual tracking [J]. Pattern Recognition, 2012, 45(12): 4510-4523.

WANG CH T, KIM J H, BYUN K Y, et al.. Robust digital image stabilization using the Kalman filter [J]. IEEE Transactions on Consumer Electronics, 2009, 55(1):6-14.

VERMA K, KUMAR A, GUPTA S, et al.. Fast and robust real time digital video stabilization with smear removal using integral projection curve warping technique[C]. 2014 Twentieth National Conference on Communications, 2014:1-6.

浏览量

521

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

稳定运动物体视频的特征方法

场景切换感知的地基成像系统电子稳像技术

弱纹理环境下融合点线特征的双目视觉同步定位与建图

针对目标遮挡的自适应特征匹配网络

基于自适应惯导辅助特征匹配的视觉SLAM算法