基于双目视觉特性的立体视频编码码率控制算法

蒋刚毅; 廖义; 郁梅; 邵枫; 王晓东; 李福翠; Yo-SungHo

doi:10.3788/OPE.20142202.0451

您当前的位置：

首页 >

文章列表页 >

基于双目视觉特性的立体视频编码码率控制算法

信息科学 | 更新时间：2020-08-13

- 基于双目视觉特性的立体视频编码码率控制算法
- Rate control algorithm for stereoscopic video coding based on binocular visual characteristics
- 光学精密工程 2014年22卷第2期页码：451-458
- 作者机构：
  
  1. 宁波大学信息科学与工程学院,浙江宁波,315211
  2. 南京大学计算机软件新技术国家重点实验室,江苏南京,210093
  3. School of Information and Communications, Gwangju Institute of Science and Technology,Korea
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20142202.0451
  中图分类号： TN919.8;TP391
- 收稿日期：2013-06-21，
  
  纸质出版日期：2014-02-20
- 稿件说明：
移动端阅览
蒋刚毅,廖义,郁梅等. 基于双目视觉特性的立体视频编码码率控制算法[J]. 光学精密工程, 2014,22(2): 451-458

JIANG Gang-yi, LIAO Yi, YU Mei etc. Rate control algorithm for stereoscopic video coding based on binocular visual characteristics[J]. Editorial Office of Optics and Precision Engineering, 2014,22(2): 451-458
蒋刚毅,廖义,郁梅等. 基于双目视觉特性的立体视频编码码率控制算法[J]. 光学精密工程, 2014,22(2): 451-458 DOI： 10.3788/OPE.20142202.0451.

JIANG Gang-yi, LIAO Yi, YU Mei etc. Rate control algorithm for stereoscopic video coding based on binocular visual characteristics[J]. Editorial Office of Optics and Precision Engineering, 2014,22(2): 451-458 DOI： 10.3788/OPE.20142202.0451.

摘要

为了使立体视频中的比特分配更加符合人眼视觉感知特性

提出了一种非对称质量的立体视频编码码率控制算法。首先

建立了左右帧的码率分配比例与量化参数差值之间的立体指数RRQ(Rate-ratio Quantization)模型。然后

将码率控制算法分为SGOP(Stereoscopic Group of Pictures)层、立体图像对层和帧层等3个码率控制层。在SGOP层计算每个SGOP的目标码率和关键帧的量化参数;在立体图像对层根据剩余比特数和缓冲区饱和度计算每个立体图像对的目标比特;在帧层则通过分析双目视觉掩蔽效应

用一种适合于立体视频的率失真优化方法合理分配左右帧的目标码率。实验结果表明

本文算法的码率控制偏差平均值为0.21%;立体视频客观质量比对称质量算法和Wang的算法分别提高了0.23 dB和0.06 dB

且质量波动较为稳定。因此

该算法基本满足网络带宽传输要求。由于充分利用了人眼双目视觉特性

可满足人们对立体视频的视觉需求。

Abstract

To allocate bitrates more satisfactory with human visual characteristics

a new rate control algorithm was proposed for an asymmetric quality stereoscopic video coding. Firstly

an exponent model(Rate-ratio Quantization

RRQ) between the rate ratio and the difference between quantization parameters of left and right frames was established. Then

the algorithm was performed on three levels

namely Stereoscopic Group of Pictures (SGOP) level

stereoscopic image pair level and frame level. The target bits for each SGOP and the quantization parameter of each key frame were calculated in the SGOP level

the total target bits for each stereoscopic image pair were calculated according to the remaining bits in the SGOP and the current buffer occupancy in the stereoscopic image pair level

and by utilizing the binocular masking

a stereoscopic rate distortion model was used to allocate bitrates for the left and right frames more rationally in the frame level. Experimental results show that the proposed algorithm can control the bitrates error within 0.21% on average. Meanwhile

it has improved the stereoscopic video objective quality by 0.23 dB and 0.06 dB as compared with the symmetric quality algorithm and Wang's algorithm

respectively

so that it can provide more stable video quality fluctuation. In conclusion

the proposed algorithm has effective network transmission bandwidth

and can satisfy the requirements of human for stereoscopic video by utilizing the human binocular visual characteristics.

关键词

Keywords

references

AGGOUN A,TSEKLEVES E, ZARPALAS D, et al.. Immersive 3D holoscopic video system [J]. IEEE Transactions on MultiMedia, 2013, 20(1):28-37.

周怀得, 刘金国, 张立平, 等. 线阵-面阵CCD三线阵立体测绘相机焦平面组件的研制[J]. 光学精密工程, 2012,20(7): 1492-1499.

ZHOU H D, LIU J G, ZHANG L P, et al.. Development of focal plane module for three-line LMCCD mapping cameras [J].Opt. Precision Eng., 2012,20(7): 1492-1499. (in Chinese)

HU S D, KWONG S, ZHANG Y, et al.. Rate-distortion optimized rate control for depth map based 3D video coding [J]. IEEE Transactions on Image Processing, 2013, 22(2): 585-594.

祝世平, 陈菊嫱. 基于预搜索的高效双目分形视频编码[J]. 光学精密工程, 2012,20(3):675-684.

ZHU SH P, CHEN J Q. Efficient stereo fractal video coding based on pre-searching [J].Opt. Precision Eng., 2012,20(3):675-684.(in Chinese)

祝世平, 侯仰拴. 快速分形立体视频编码系统的设计[J]. 光学精密工程, 2010,18(11): 2505-2512.

ZHU SH P, HOU Y SH. Design of fast fractal stereo video coding system [J].Opt. Precision Eng., 2010,18(11): 2505-2512.(in Chinese)

LIU S, LIU F, FAN J J, et al.. Asymmetric stereoscopic video encoding algorithm based on subjective visual characteristic [C]. 2009 IEEE International Conference on Wireless Communications & Signal Processing, Nanjing, China, 2009: 1-5.

卢山, 孙军, 王嘉. 基于人眼立体视觉特性的多视视频码率控制算法[J].中国图像图形学报, 2009,14(11): 2396-2400.

LU SH, SUN J, WANG J. Multiview video rate control scheme based on human stereo visual feature [J]. Journal of Image and Grahpics, 2009, 14(11): 2396-2400. (in Chinese)

WANG Q, ZHUO L, ZHANG J, et al.. A rate-distortion model based frame layer rate control algorithm for stereoscopic video coding [J]. Chinese Journal of Electronics, 2012, 21(4):678-682.

MERKLE P, WANG Y, MULLER K, et al.. Video plus depth compression for mobile 3D services [C]. 2009 IEEE 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, 2009: 1-4.

CHANG Y J, KIM M. Hybrid codec-based intra-frame joint rate control for stereoscopic video [J]. IEEE Signal Processing Letters, 2011, 18(10): 543-546.

JULESZ B. Foundations of Cyclopean Perception [M]. USA:The University of Chicago Press, 1971: 54-56.

OZBEK N, TEKALP A M. Unequal inter-view rate allocation using scalable stereo video coding and an objective stereo video quality measure [C]. 2008 IEEE International Conference on Multimedia and Expo, Hannover, Germany, 2008: 1113-1116.

ZHAO Y, CHEN ZH ZH, ZHU C, et al.. Binocular just-noticeable-difference model for stereoscopic images [J]. IEEE Signal Processing Letters, 2011, 18(1): 19-22.

WANG X, JIANG G Y, ZHOU J M, et al.. Visibility threshold of compressed stereoscopic image: effects of asymmetrical coding [J]. Imaging Science Journal, 2013, 61(2):172-182.

LI ZH G, PAN F, LIM K P, et al.. Adaptive basic unit layer rate control for JVT[C]. JVT-G012-r1, the 7th Meeting, Pattaya II, Thailand,2003,7-14.

浏览量

486

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

暂无数据