Generic placeholder image

Recent Advances in Electrical & Electronic Engineering

Author(s): Mohammad Barr*

DOI: 10.2174/2352096513666191227102559

DownloadDownload PDF Flyer Cite As
A Fast Encoding Scheme for High Efficiency Video Coding

Page: [933 - 941] Pages: 9

  • * (Excluding Mailing and Handling)

Abstract

Background: High-Efficiency Video Coding (HEVC) is a recent video compression standard. It provides better compression performance compared to its predecessor, H.264/AVC. However, the computational complexity of the HEVC encoder is much higher than that of H.264/AVC encoder. This makes HEVC less attractive to be used in real-time applications and in devices with limited resources (e.g., low memory, low processing power, etc.). The increased computational complexity of HEVC is partly due to its use of a variable size Transform Unit (TU) selection algorithm which successively performs transform operations using transform units of different sizes before selecting the optimal transform unit size. In this paper, a fast transform unit size selection method is proposed to reduce the computational complexity of an HEVC encoder.

Methods: Bayesian decision theory is used to predict the size of the TU during encoding. This is done by exploiting the TU size decisions at a previous temporal level and by modeling the relationship between the TU size and the Rate-Distortion (RD) cost values.

Results: Simulation results show that the proposed method achieves a reduction of the encoding time of the latest HEVC encoder by 16.21% on average without incurring any noticeable compromise on its compression efficiency. The algorithm also reduces the number of transform operations by 44.98% on average.

Conclusion: In this paper, a novel fast TU size selection scheme for HEVC is proposed. The proposed technique outperforms both the latest HEVC reference software, HM 16.0, as well as other state-of-the-art techniques in terms of time-complexity. The compression performance of the proposed technique is comparable to that of HM 16.0.

Keywords: Video compression, high efficiency video coding, transform unit, video compression standard, fast encoding technique, bayesian decision theory.

Graphical Abstract

[1]
G. Sullivan, J. Ohm, W. Han, and T. Wiegand, "Overview of the high efficiency video coding (HEVC) standard", IEEE Trans. Circ. Syst. Video Tech., vol. 22, no. 12, pp. 1649-1668, 2012.
[http://dx.doi.org/10.1109/TCSVT.2012.2221191]
[2]
M. Wien, High efficiency video coding., Coding Tools Specificat, 2015, pp. 133-160.
[3]
T. Tan, R. Weerakkody, M. Mrak, N. Ramzan, V. Baroncini, J. Ohm, and G. Sullivan, "Video quality evaluation methodology and verification testing of HEVC compression performance", IEEE Trans. Circ. Syst. Video Tech., vol. 26, no. 1, pp. 76-90, 2016.
[http://dx.doi.org/10.1109/TCSVT.2015.2477916]
[4]
T. Wiegand, G. Sullivan, G. Bjontegaard, and A. Luthra, "Overview of the H. 264/AVC video coding standard", IEEE Trans. Circ. Syst. Video Tech., vol. 13, no. 7, pp. 560-576, 2003.
[http://dx.doi.org/10.1109/TCSVT.2003.815165]
[5]
J. Ostermann, J. Bormans, P. List, D. Marpe, M. Narroschke, F. Pereira, T. Stockhammer, and T. Wedi, "Video coding with H. 264/AVC: tools, performance, and complexity", IEEE Circuits Syst. Mag., vol. 4, no. 1, pp. 7-28, 2004.
[http://dx.doi.org/10.1109/MCAS.2004.1286980]
[6]
M. Dissanayake, and D. Abeyrathna, "Performance comparison of HEVC and H.264/AVC standards in broadcasting environments", J. Inform. Process. Syst., vol. 11, no. 3, pp. 483-494, 2015.
[7]
R. Duda, P. Hart, and D. Stork, Pattern Classification., John Wiley & Sons, 2012.
[8]
F. Pan, X. Lin, S. Rahardja, K. Lim, Z. Li, D. Wu, and S. Wu, "Fast mode decision algorithm for intraprediction in H. 264/AVC video coding", IEEE Trans. Circ. Syst. Video Tech., vol. 15, no. 7, pp. 813-822, 2005.
[http://dx.doi.org/10.1109/TCSVT.2005.848356]
[9]
H. Zeng, C. Cai, and K. Ma, "Fast mode decision for H. 264/AVC based on macroblock motion activity", IEEE Trans. Circ. Syst. Video Tech., vol. 19, no. 4, pp. 491-499, 2009.
[http://dx.doi.org/10.1109/TCSVT.2009.2014014]
[10]
S. Khattak, R. Hamzaoui, S. Ahmad, and P. Frossard, "Low-complexity multiview video coding", In: Proc. Picture Coding Symposium (PCS), 2012, pp. 97-100.
[11]
S. Khattak, "Framework for low-complexity multiview video coding", In: Proc. 14th Annual Post Graduate Symposium on the Convergence of Telecommunications, Networking, and Broadcasting (PGNet2013), Liverpool, UK, 2013.,
[12]
S. Khattak, R. Hamzaoui, S. Ahmad, and P. Frossard, "Fast encoding techniques for Multiview Video Coding", Signal Process. Image Commun., vol. 28, no. 6, pp. 569-580, 2013.
[http://dx.doi.org/10.1016/j.image.2012.12.010]
[13]
T. Zhao, Z. Wang, and S. Kwong, "Flexible mode selection and complexity allocation in high efficiency video coding", IEEE J. Sel. Top. Signal Process., vol. 7, no. 6, pp. 1135-1144, 2013.
[http://dx.doi.org/10.1109/JSTSP.2013.2271421]
[14]
H. Zhang, and Z. Ma, "Fast intra mode decision for high efficiency video coding (HEVC)", IEEE Trans. Circ. Syst. Video Tech., vol. 24, no. 4, pp. 660-668, 2014.
[http://dx.doi.org/10.1109/TCSVT.2013.2290578]
[15]
S. Khan, and S. Khattak, "Early decision of CU splitting, using base view information, for low complexity MV-HEVC", In: Proc. Multi-Topic Conf. (INMIC), 2017, pp. 1-6.
[http://dx.doi.org//10.1109/INMIC.2017.8289476]
[16]
W. Kuang, Y.L. Chan, S.H. Tsang, and W.C. Siu, "Online-learning-based Bayesian decision rule for fast intra mode and CU partitioning algorithm in HEVC screen content coding", IEEE Trans. Image Process., vol. 29, pp. 170-185, 2020.
[http://dx.doi.org/10.1109/TIP.2019.2924810] [PMID: 31265399]
[17]
I. Marzuki, J. Ma, Y. Ahn, and D. Sim, "A context Adaptive fast intra coding algorithm of high efficiency video coding", J. Real-Time Image Process., vol. 16, no. 4, pp. 883-899, 2019.
[http://dx.doi.org/10.1007/s11554-016-0571-5]
[18]
W. Mu, Y. Liang, S. Xu, W. Zhang, and Y. Liu, "Fast algorithm for HEVC intra-coding implemented by preprocessing", IET Image Process., vol. 13, no. 9, pp. 1578-1586, 2019.
[http://dx.doi.org/10.1049/iet-ipr.2018.6640]
[19]
C. Wang, C. Tung, and J. Wang, ""An effective transform unit size decision method for high efficiency video coding"", Proc. Mathemat. Probl. Eng., 2014, pp. 1-10., .
[http://dx.doi.org/10.1155/2014/718189]
[20]
Y. Shi, Z. Gao, and X. Zhang, "Early TU split termination in HEVC based on quasi-zero-block", In: Proc. 3rd Inter. Conf. Electric Electron. (EEIC), 2013, pp. 450-454.
[http://dx.doi.org/10.2991/eeic-13.2013.106]
[21]
Q. Tu, J. Feng, J. Qi, A. Men, and F. Ye, "An adaptive CU mode decision mechanism based on Bayesian decision theory for H.265/HEVC", In: Proc. IEEE International Conference on Multimedia and Expo (ICME), 2014, pp. 1-6,
[http://dx.doi.org/10.1109/ICME.2014.6890293]
[22]
Q. Hu, Y. Shi, X. Zhang, and Z. Gao, "Fast coding unit size selection for HEVC based on Bayesian decision rule", In: Proc. Picture Coding Symposium (PCS), Krakow, Poland, 2012, pp. 453-456,
[23]
H. Kim, and R. Park, "Fast CU partitioning algorithm for HEVC using an online-learning-based Bayesian decision rule", IEEE Trans. Circ. Syst. Video Tech., vol. 26, no. 1, pp. 130-138, 2016.
[http://dx.doi.org/10.1109/TCSVT.2015.2444672]
[24]
X. Fang, X. Zhu, L. Yu, and X. Shen, "Fast HEVC intra coding unit size decision based on an improved Bayesian classification framework", Proc. Picture Coding Symposium (PCS), 2013, pp. 273-276,
[http://dx.doi.org/10.1109/PCS.2013.6737736]
[25]
Q. Hu, Z. Shi, X. Zhang, and Z. Gao, "Early SKIP mode decision based on Bayesian model for HEVC", In: Proc. IEEE VCIP, 2015, pp. 978-981.
[http://dx.doi.org/10.1109/VCIP.2015.7457828]
[26]
S. Cho, and M. Kim, "Fast CU splitting and pruning for suboptimal CU partitioning in HEVC intra coding", IEEE Trans. Circ. Syst. Video Tech., vol. 23, no. 9, pp. 1555-1564, 2013.
[http://dx.doi.org/10.1109/TCSVT.2013.2249017]
[27]
A. Vetro, T. Wiegand, and G. Sullivan, "Overview of the stereo and multiview video coding extensions of the H. 264/MPEG-4 AVC standard", Proc. IEEE, vol. 99, no. 4, pp. 626-642, 2011.
[http://dx.doi.org/10.1109/JPROC.2010.2098830]
[28]
S. Khattak, R. Hamzaoui, T. Maugey, S. Ahmad, and P. Frossard, "Bayesian early mode decision technique for view synthesis prediction-enhanced multiview video coding", IEEE Signal Process. Lett., vol. 20, no. 11, pp. 1126-1129, 2013.
[http://dx.doi.org/10.1109/LSP.2013.2281607]
[29]
L. Shen, Z. Zhang, X. Zhang, P. An, and Z. Liu, "Fast TU size decision algorithm for HEVC encoders using Bayesian theorem detection", Signal Process. Image Commun., vol. 32, pp. 121-128, 2015.
[http://dx.doi.org/10.1016/j.image.2015.01.008]
[30]
Y. Kim, D. Jun, S. Jung, J. Choi, and J. Kim, "A fast intra-prediction method in HEVC using rate-distortion estimation based on Hadamard transform", ETRI J., vol. 35, no. 2, pp. 270-280, 2013.
[http://dx.doi.org/10.4218/etrij.13.0112.0223]
[31]
Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11. HM 16.0 Reference Software. Available at:, https://hevc.hhi.fraunhofer.de/svn/svn−HEVCSoftware/tags/HM-16.0/
[32]
F. Bossen, JCTVC-L1100: Common HM test conditions and software reference configurations. Joint Collaborative Team on Video Coding., JCT-VC, 2013.
[33]
A. Gul, and S. Khattak, "Bayesian early mode decision for multiview video coding", J. Graphics, Vision, Image Process., vol. 18, no. 1, pp. 15-24, 2018.
[34]
J. Fang, Y. Tsai, J. Lee, and P. Yu, "Computation reduction in transform unit of high efficiency video coding based on zerocoefficients", In: Proc. 2016 International Symposium on Computer, Consumer and Control (IS3C), 2016, pp. 797-800.,
[http://dx.doi.org/10.1109/IS3C.2016.203]
[35]
W. Lin, Z. Liu, D. Mukherjee, J. Han, P. Wilkins, Y. Xu, and K. Rose, "Efficient AV1 video coding using a multi-layer framework", In: Proc. Data Compression Conference, 2018.,
[http://dx.doi.org/10.1109/DCC.2018.00045]