Search by item HOME > Access full text > Search by item

JBE, vol. 24, no. 7, pp.1209-1220, December, 2019

DOI: https://doi.org/10.5909/JBE.2019.24.7.1209

A Study on Projection Conversion for Efficient 3DoF+ 360-Degree Video Streaming

Jong-Beom Jeong, Soonbin Lee, Dongmin Jang, Sungbin Kim, Sangsoon Lee, and Eun-Seok Ryu

C.A E-mail: esryu@skku.edu

Abstract:

The demand for virtual reality (VR) is rapidly increasing. Providing the immersive experience requires much operation and many data to transmit. For example, a 360-degree video (360 video) with at least 4K resolution is needed to offer an immersive experience to users. Moreover, the MPEG-I group defined three degrees of freedom plus (3DoF+), and it requires the transmission of multiview 360 videos simultaneoulsy. This could be a burden for the VR streaming system. Accordingly, in this work, a bitrate-saving method using projection conversion is introduced, along with experimental results for streaming 3DoF+ 360 video. The results show that projection conversion of 360 video with 360lib shows a Bjontegaard delta bitrate gain of as much as 11.4%



Keyword: 360-Degree Video, 3DoF+, HEVC, Virtual Reality, 360lib, Projection

Reference:
1] Bart Kroon, Gauthier Lafruit. 2018. Reference view synthesizer (rvs) 2.0 manual. 123th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG123/n17759.
[2] Jong-Beom Jeong, Dongmin Jang, Jangwoo Son, and Eun-Seok Ryu. 2018. 3DoF+ 360 Video Location-Based Asymmetric Down-Sampling for View Synthesis to Immersive VR Video Streaming. Sensors 18, 9(2018), 3148.
[3] Joel Jung, Bart Kroon, Renaud Doré, Gauthier Lafruit, Jill Boyce. 2018. CTC on 3DoF+ and Windowed 6DoF (v2). 123th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG123/n17726.
[4] Bart Kroon. 2018. 3DoF+ test sequence ClassroomVideo. 122th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG2018/m42415.
[5] Tuan Thanh Le, Dien Ngyuen Van, and Eun-Seok Ryu. 2018. Real-time 360-degree video streaming over millimeter wave communication. 2018 International Conference on Information Networking (ICOIN), IEEE. pp. 857-862.
[6] Masayuki Tanimoto, Toshiaki Fujii, Kazuyoshi Suzuki. 2009. View Synthesis Algorithm in View Synthesis Reference Software 2.0 (VSRS2.0). 87th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG2009/m16090.
[7] Masayuki Tanimoto, Toshiaki Fujii. 2010. FTV - Free Viewpoint Television. 61th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG2010/m8595.
[8] Sejin Oh. 2017. Projections under Considerations for ISO/IEC 23090-2 Omnidirectional MediA Format. 118th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG2017/n16828.
[9] Hyun-Joon Roh, SungWon Han, and Eun-Seok Ryu. 2017. Prediction complexitybased HEVC parallel processing for asymmetric multicores. Multimedia Tools and Applications 76, 23 (2017), 25271–25284.
[10] Robert Skupin, Yago Sanchez, Karsten SÃijhring, Thomas Schierl, Eun-Seok Ryu, and Jangwoo Son. 2018. Temporal MCTS Coding Constraints Implementation. 122th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG 122/m42423.
[11] Jang-Woo Son, Dongmin Jang, Eun-Seok Ryu. 2018. Implementing 360 video tiled streaming system. Proceedings of the 9th ACM Multimedia Systems Conference. ACM. pp. 521-524.
[12] Jang-Woo Son, Dongmin Jang, Eun-Seok Ryu. 2018. Implementing Motion-Constrained Tile and Viewport Extraction for VR Streaming. ACM Network and Operating System Support for Digital Audio and Video 2018 (NOSSDAV2018). pp. 61-66.
[13] Jang-Woo Son, Eun-Seok Ryu. 2018. Tile-Based 360-Degree Video Streaming for Mobile Virtual Reality in Cyber Physical System. Elsevier, Computers and Electrical Engineering.
[14] Yule Sun, Lu Ang, Lu Yu. 2017. Weighted-to-spherically-uniform quality evaluation for omnidirectional video. IEEE signal processing letters 24.9. pp. 1408-1412.
[15] Takanori Senoh, Nobuji Tetsutani, Hiroshi Yasuda. 2018. MPEG-I-Visual: View Synthesis Reference Software (VSRSx). 123th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG 123/m42911.
[16] Xin Wang, Lulin Chen, Shuai Zhao and Shawmin Lei. 2017. From OMAF for 3DoF VR to MPEG-I Media Format for 3DoF+, Windowed 6DoF and 6DoF VR. 119th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG 119/m41197.
[17] Yule Sun, Bin Wang, Lu Yu. 2018. ERP WS-PSNR Software Manual. 123th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG 123/n17760.

Comment


Editorial Office
1108, New building, 22, Teheran-ro 7-gil, Gangnam-gu, Seoul, Korea
Homepage: www.kibme.org TEL: +82-2-568-3556 FAX: +82-2-568-3557
Copyrightⓒ 2012 The Korean Institute of Broadcast and Media Engineers
All Rights Reserved