JBE, vol. 27, no. 4, pp.548-560, July, 2022

DOI: https://doi.org/10.5909/JBE.2022.27.4.548

SHVC-based V-PCC Content ISOBMFF Encapsulation and DASH Configuration Method

Kwijung Nam, Junsik Kim, and Kyuheon Kim

C.A E-mail: kyuheonkim@khu.ac.kr

Abstract:

Video based Point Cloud Compression (V-PCC) is one of the compression methods for compressing point clouds, and shows high efficiency in dynamic point cloud compression with movement due to the feature of compressing point cloud data using an existing video codec. Accordingly, V-PCC is drawing attention as a core technology for immersive content services such as AR/VR. In order to effectively service these V-PCC contents through a media streaming platform, it is necessary to encapsulate them in the existing media file format, ISO based Media File Format (ISOBMFF). However, in order to service through an adaptive streaming platform such as Dynamic Adaptive Streaming over HTTP (DASH), it is necessary to encode V-PCC contents of various qualities and store them in the server. Due to the size of the 2D media, it causes a great burden on the encoder and the server compared to the existing 2D media. As a method to solve such a problem, it may be considered to configure a streaming platform based on content obtained through V-PCC content encoding based on SHVC. Therefore, this paper encapsulates the SHVC-based V-PCC bitstream into ISOBMFF suitable for DASH service and proposes a configuration method to service it. In addition, in this paper, we propose ISOBMFF encapsulation and DASH configuration method to effectively service SHVC-based V-PCC contents, and confirm them through verification experiments.

Keyword: Point Cloud, V-PCC, SHVC, ISOBMFF, DASH

Reference:
[1] Junsik Kim, Jiheon Im, Kyuheon Kim, “Dynamically Acquired Point Cloud Compression Method based on Video based Point Cloud Compression”, 2020 The Korean Institute of Broadcast and Media Engineers Summer Conference, Korea, pp.189-192, 2019.
[2] Dong Tianyu, Euee S. Jang, "Review on codec-agnostic approach for MPEG V-PCC", 2020 The Korean Institute of Broadcast and Media Engineers Summer Conference, Korea, pp.388-390, 2019
[3] Doohwan Kim, Jiheon Im, Ktuheon Kim, “MPEG-DASH based 3D Point Cloud Content Configuration Method”, Journal of Broadcast Engineering, Vol.24, No.4, pp.660-669, July 2019. doi: https://doi.org/10.5909/JBE.2019.24.4.660
[4] ISO/IEC JTC1/SC29/WG11 Doc. MPEG2015/N15778, Scalable HEVC (SHVC) Test Model 11 (SHM11), Geneva, October, 2015
[5] Y. Hwang, J. Kim, K. Kim, “A method of density scalability using SHVC codec in Video based Point Cloud Compression” 2020 The Korean Institute of Broadcast and Media Engineers Summer Conference, Korea, pp . 383-387, 2020.
[6] ISO/IEC JTC1/SC29/WG11 Doc. MPEG2020/N19092, V-PCC Codec Description, Brussels, March, 2020.
[7] ISO/IEC JTC1/SC29/WG11 Doc. MPEG2019/N18180, Video-based Point Cloud Compression, Marrakesh, January 2019
[8] ISO/IEC JTC1/SC29/WG3/N0163, “Draft text of ISO/IEC FDIS 23090-10 Carriage of Visual Volumetric Video-based Coding
[9] ISO/IEC 14496-12 – MPEG-4 Part 12, ISO base media file format, July, 2014.
[10] ISO/IEC 23009-1:2014 (Second edition), Information technology Dynamic adaptive streaming over HTTP (DASH) Part 1: Media pre- sentation description and segment formats, 2014
[11] MPEG DASH Industry Forum, Guidelines for Inplementation: DASH-IF Interoperability Points, Retrieved April.09, 2018, from http://dashif.org/
[12] ISO/IEC JTC1/SC29/WG11 Doc. MPEG2020/N19324, Common Test Conditions for PCC, Alpbach, online , April 2020.

Efficient Memory Update Module for Video Object Segmentation

Window Attention Module Based Transformer for Image Classification