Search by item HOME > Access full text > Search by item

JBE, vol. 25, no. 5, pp.665-671, September, 2020

DOI: https://doi.org/10.5909/JBE.2020.25.5.665

An Atlas Generation Method with Tiny Blocks Removal for Efficient 3DoF+ Video Coding

Sung-Gyun Lim, Hyun-Ho Kim, and Jae-Gon Kim

C.A E-mail: jgkim@kau.ac.kr

Abstract:

MPEG-I is actively working on standardization on the coding of immersive video which provides up to 6 degree of freedom (6DoF) in terms of viewpoint. 3DoF+ video, which provides motion parallax to omnidirectional view of 360 video, renders a view at any desired viewpoint using multiple view videos acquisitioned in a limited 3D space covered with upper body motion at a fixed position. The MPEG-I visual group is developing a test model called TMIV (Test Model for Immersive Video) in the process of development of the standard for 3DoF+ video coding. In the TMIV, the redundancy between a set of input view videos is removed, and several atlases are generated by packing patches including the remaining texture and depth regions into frames as compact as possible, and coded. This paper presents an atlas generation method that removes small-sized blocks in the atlas for more efficient 3DoF+ video coding. The proposed method shows a performance improvement of BD-rate bit savings of 0.7% and 1.4%, respectively, in natural and graphic sequences compared to TMIV.



Keyword: MPEG-I, 3DoF+, Immersive video, Atlas, TMIV, 360 video

Reference:
[1] “MPEG-I Use Cases for omnidirectional 6DoF, windowed 6DoF, and 6DoF,” ISO/IEC JTC1/SC29/WG11, N16768, Apr. 2017.
[2] M. Wien, J. M. Boyce, T. Stockhammer, and W.-H. Peng, "Standardization Status of Immersive Video Coding," IEEE Jour. Emerg. Select. Topics Circuits Syst., vol. 9, no. 1, Mar. 2019.
[3] J. Boyce, R. Dore, V. Vadakital, “Working Draft 4 of Immersive Video,” ISO/IEC JTC1/SC29/WG11, N19001, Jan. 2020.
[4] B. Salahieh, B. Kroon, J. Jung, M. Domański (Eds.), “Test model 4 for Immersive Video,” ISO/IEC JTC1/SC29/WG11, N19002, Jan. 2020.
[5] J. Jung, B. Kroon, J. Boyce, “Common Test Conditions for Immersive Video,” ISO/IEC JTC1/SC29/WG11, N18997, Jan. 2020.
[6] HM reference software, [Online]. Available at http://hevc.hhi. fraunhofer.de/svn/svn_HEVCSoftware
[7] ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, “On BD-rate Calculation,” JCTVC-F270, Jul. 2011.
[8] S. Lim, H. Kim, J. Kim, G. Lee, J. Jeong, J. Seo, “CE3-Related: Patch Trimming Using Hole Filling and Tiny Region Removal in Atlas,” ISO/IEC JTC1/SC29/WG11, m53834, Apr. 2020.

Comment


Editorial Office
1108, New building, 22, Teheran-ro 7-gil, Gangnam-gu, Seoul, Korea
Homepage: www.kibme.org TEL: +82-2-568-3556 FAX: +82-2-568-3557
Copyrightⓒ 2012 The Korean Institute of Broadcast and Media Engineers
All Rights Reserved