期刊文献+

Efficient fast mode decision using mode complexity for multi-view video coding 被引量:1

Efficient fast mode decision using mode complexity for multi-view video coding
在线阅读 下载PDF
导出
摘要 The variable block-size motion estimation(ME) and disparity estimation(DE) are adopted in multi-view video coding(MVC) to achieve high coding efficiency. However, much higher computational complexity is also introduced in coding system, which hinders practical application of MVC. An efficient fast mode decision method using mode complexity is proposed to reduce the computational complexity. In the proposed method, mode complexity is firstly computed by using the spatial, temporal and inter-view correlation between the current macroblock(MB) and its neighboring MBs. Based on the observation that direct mode is highly possible to be the optimal mode, mode complexity is always checked in advance whether it is below a predefined threshold for providing an efficient early termination opportunity. If this early termination condition is not met, three mode types for the MBs are classified according to the value of mode complexity, i.e., simple mode, medium mode and complex mode, to speed up the encoding process by reducing the number of the variable block modes required to be checked. Furthermore, for simple and medium mode region, the rate distortion(RD) cost of mode 16×16 in the temporal prediction direction is compared with that of the disparity prediction direction, to determine in advance whether the optimal prediction direction is in the temporal prediction direction or not, for skipping unnecessary disparity estimation. Experimental results show that the proposed method is able to significantly reduce the computational load by 78.79% and the total bit rate by 0.07% on average, while only incurring a negligible loss of PSNR(about 0.04 d B on average), compared with the full mode decision(FMD) in the reference software of MVC. The variable block-size motion estimation(ME) and disparity estimation(DE) are adopted in multi-view video coding(MVC) to achieve high coding efficiency. However, much higher computational complexity is also introduced in coding system, which hinders practical application of MVC. An efficient fast mode decision method using mode complexity is proposed to reduce the computational complexity. In the proposed method, mode complexity is firstly computed by using the spatial, temporal and inter-view correlation between the current macroblock(MB) and its neighboring MBs. Based on the observation that direct mode is highly possible to be the optimal mode, mode complexity is always checked in advance whether it is below a predefined threshold for providing an efficient early termination opportunity. If this early termination condition is not met, three mode types for the MBs are classified according to the value of mode complexity, i.e., simple mode, medium mode and complex mode, to speed up the encoding process by reducing the number of the variable block modes required to be checked. Furthermore, for simple and medium mode region, the rate distortion(RD) cost of mode 16×16 in the temporal prediction direction is compared with that of the disparity prediction direction, to determine in advance whether the optimal prediction direction is in the temporal prediction direction or not, for skipping unnecessary disparity estimation. Experimental results show that the proposed method is able to significantly reduce the computational load by 78.79% and the total bit rate by 0.07% on average, while only incurring a negligible loss of PSNR(about 0.04 d B on average), compared with the full mode decision(FMD) in the reference software of MVC.
出处 《Journal of Central South University》 SCIE EI CAS 2014年第11期4244-4253,共10页 中南大学学报(英文版)
基金 Project(08Y29-7)supported by the Transportation Science and Research Program of Jiangsu Province,China Project(201103051)supported by the Major Infrastructure Program of the Health Monitoring System Hardware Platform Based on Sensor Network Node,China Project(61100111)supported by the National Natural Science Foundation of China Project(BE2011169)supported by the Scientific and Technical Supporting Program of Jiangsu Province,China
关键词 multi-view video coding mode decision mode complexity computational complexity 计算复杂性 视频编码 多视角 时间预测 视差估计 计算复杂度 MVC 运动估计
  • 相关文献

参考文献17

  • 1TANIMOTO M, TEHRANI M P, FUJII T, YENDO T. Free- viewpoint TV [J]. IEEE Signal Processing Magazine, 2011, 28(1): 67-76.
  • 2MULLER K, MERKLE P, WIEGEND T. 3-D video representation using depth maps [J]. Proceedings of the IEEE, 2011, 99(4): 643- 656.
  • 3ISO/IEC 14496-10: 2008/FDAM 1:2008(E). Information technology Coding of audio-visual objects-part 10: Advanced video coding, Amendment 1 : multiview video coding [S].
  • 4VETRO A, WIEGAND T, SULLIVAN G J. Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC standard [J]. Proceedings of the IEEE, 201 l, 99(4): 626-642.
  • 5DING Li-fu, TSUNG Pei-kuei, CHIEN Shao-yi, CHEN Wei-yin, CHEN Liang-gee. Content-aware prediction algorithm with inter- view mode decision for multiview video coding [J]. IEEE Transactions on Multimedia, 2008, 10(8): 1553-1563.
  • 6HUO Jun-yan, CHANG Yi-lin, LI Ming, MA Yan-zhuo. Scalable prediction structure for multiview video coding [C]// IEEE International Symposium on Circuits and Systems. Piscataway: IEEE 2009: 2593-2596.
  • 7CHAN C C, LIN J P, TANG C W. On-line statistical analysis based fast mode decision for multi-view video coding [C]// Picture Coding Symposium. Piscataway: IEEE, 2010: 478481.
  • 8SHEN Li-quan, YAN Tao, LIU Zhi, ZHANG Zhao-yang, AN Ping, YANG Lei. Fast mode decision for rnultiview video coding [C]// IEEE International Conference on Image Processing. Piscataway: 1EEE, 2009: 2953~956.
  • 9ZENG Huan-qiang, MA Kai-kuang, CAI Can-hui. Mode-correlation- based early termination mode decision for multi-view video coding [C]// IEEE International Conference on Image Processing. Piscataway: IEEE, 2010: 3405-3408.
  • 10SEO J, SOHN K. Early disparity estimation skipping for multi-view video coding [J]. EURASIP Journal on Wireless Communications and Networking, 2012, 2012(1): 1-12.

同被引文献14

  • 1Vetro A,Tourapis A,Muller K,et al.3D-TV Content Storage and Transmission[J].IEEE Transactions on Broadcasting,2011,57(2):384-394.
  • 2Tanimoto M,Tehrani M P,Fujii T,et al.FTV for 3-D Spatial Communication[J].Proceedings of the IEEE,2012,100(4):905-917.
  • 3Vetro A,Wiegand T,Sullivan G J.Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard[J].Proceedings of the IEEE,2011,99(4):626-642.
  • 4Zatt B,Shafique M,Bampi S,et al.A Multi-level Dynamic Complexity Reduction Scheme for Multiview Video Coding[C]//Processings of International Con-ference on Image Processing.Washington D.C.,USA:IEEE Press,2011:749-752.
  • 5Zeng Huanqiang,Ma Kaikuang,Cai Canhui.Modecorrelation-based Early Termination Mode Decision for Multi-view Video Coding[C]//Proceedings of International Conference on Image Processing.Washington D.C.,USA:IEEE Press,2010:3406-3408.
  • 6Shen Liquan,Liu Zhi,An Ping,et al.Low-complexity Mode Decision for MVC[J].IEEE Transactions on Circuits and Systems for Video Technology,2011,21(6):837-843.
  • 7Chan C C,Tang C W.Coding Statistics Based Fast Mode Decision for Multi-view Video Coding[J].Journal of Visual Communication and Image Representation,2013,24(6):686-699.
  • 8Wang Fengsui,Zeng Huanqiang,Shen Qinghong,et al.Efficient Early Direct Mode Decision for Multi-view Video Coding[J].Signal Processing:Image Com-munication,2013,28(7):736-744.
  • 9Zhang Yun,Sam K,Jiang Gangyi,et al.Statistical Early Termination Model for Fast Mode Decision and Reference Frame Selection in Multiview Video Coding[J].IEEE Transactions on Broadcasting,2012,58(1):10-23.
  • 10Zhang Yun,San K,Xu Long,et al.Direct Mode Early Decision Optimization Based on Rate Distortion Cost Property and Inter-view Correlation[J].IEEE Transactions on Broadcasting,2013,59(2):390-398.

引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部