Search by item HOME > Access full text > Search by item

JBE, vol. 23, no. 6, pp.747-759, November, 2018

DOI: https://doi.org/10.5909/JBE.2018.23.6.747

Implementing Renderer for Viewport Dependent 360 Video

Dongmin Jang, Jang-Woo Son, JongBeom Jeong, and Eun-Seok Ryu

C.A E-mail: esryu@gachon.ac.kr

Abstract:

In this paper, we implement viewport dependent tile partitioning for high quality 360 video transmission and rendering method to present a HMD (Head Mounted Display) screen for 360 video quality evaluation. As a method for high-quality video transmission based on a user’s viewport, this paper introduces MCTS (Motion Constrained Tile Sets) technique for solving the motion reference problem and EIS (Extraction Information Sets) SEI including pre-configured tile information, and extractor that extracts tiles. In addition, it explains tile extraction method based on user’s viewport and implementation contents of the method of expressing on an HMD. Therefore, if 360 video is transferred by the proposed implementation which only transfers video from the user viewport area, it is possible to express higher quality video with lower bandwidth while avoiding unnecessary image transmission.



Keyword: 360 Video, Viewport, HEVC, MCTS, Renderer

Reference:
[1] M. Champel, T. Stockhammer, T. Fautier, E. Thomas, and R. Koenen, “Quality Requirements for VR,” 116th MPEG meeting of ISO/IEC JTC1/SC29/WG11, MPEG 116/m39532, 2016.
[2] R. Skupin, Y. Sanchez, K. Suehring, T. Schierl, E. Ryu, and J. Son, “Temporal MCTS Coding Constraints Implementation,” 120th MPEG meeting of ISO/IEC JTC1/SC29/WG11, MPEG 120/m41626, 2017.
[3] J. Boyce, A. Ramasubramanian, R. Skupin, G. J. Sullivan, A. Tourapis, and Y. Wang, “HEVC Additional Supplemental Enhancement Information (Draft 4),” 29th JCT-VC meeting of ISO/IEC JTC1/SC29/ WG11, JCTVC-AC1005, 2017.
[4] Y. Ryu, and E. S. Ryu. “Video on Mobile CPU: UHD Video Parallel Decoding for Asymmetric Multicores,” Proceedings of the 8th ACM International Conference on Multimedia System (MMSys 2017), Taipei, Taiwan, pp. 229-232, 2017.
[5] T. T. Le, D. N. Van, and E. S. Ryu. “Real-time 360-Degree Video Streaming over Millimeter Wave Communication,” International Conference on Information Networking 2018 (ICOIN2018), Chiang Mai, Thailand, pp. 5-17, 2018.
[6] A. Zare, A. Aminlou, M. Hannuksela, and M. Gabbouj. ”HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications,” In Proceedings of the 24th ACM Multimedia Conference, Amsterdam, Netherlands, pp. 601-605, 2016.
[7] R. Skupin, Y. Sanchez, D. Podborski, C. Hellge, and T. Schierl, "Viewport-dependent 360 degree video streaming based on the emerging Omnidirectional Media Format (OMAF) standard," Image Processing (ICIP), 2017 IEEE International Conference on. IEEE, Beijing, China, pp. 4592-4592, 2017.
[8] K. Brunnström, S. A. Beker, K. De Moor, A. Dooms, S. Egger, M.-N. Garcia, T. Hossfeld, S. Jumisko-Pyykkö, C. Keimel, M.-C. Larabi et al. "Qualinet white paper on definitions of quality of experience," https://hal.archives-ouvertes.fr/hal-00977812 (accessed Sep. 03, 2018).
[9] F. Qian, L. Ji, B. Han, and V. Gopalakrishnan, “Optimizing 360 video delivery over cellular networks,” Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges. ACM, New York, USA, pp. 1-6, 2016.
[10] High Efficiency Video Coding (HEVC), https://hevc.hhi.fraunhofer. de/ (accessed Sep. 03, 2018).
[11] T. Ikai, Y. Yasugi, and T. Aono, “AHG8: Dynamic viewport generation for 360° video evaluation,” 5th JVET Meeting of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC29/WG11, JVET-E0024, 2016.
[12] J. Son, D. Jang, and E. S. Ryu, “Implementing Motion-Constrained Tile and Viewport Extraction for VR Streaming,” ACM Network and Operating System Support for Digital Audio and Video 2018 (NOSSDAV2018), Amsterdam, Netherlands, pp. 61-66, 2018.
[13] J. Son, D. Jang, J. Chung, E. S. Ryu, “Implementing 360 Video Tiled Streaming System,“ ACM Multimedia Systems 2018 (ACM MMSys 2018), Amsterdam, Netherlands, pp. 521-524, 2018.
[14] L. Bassbouss, S. Steglich, and M. Lasak, “High quality 360° video rendering and streaming,” NEM Summit proceedings, Porto, Portugal, 2016.
[15] Oculus rift, https://www.oculus.com/rift (accessed Sep. 03, 2018).
[16] P. Hanhart, J. Boyce, and K. Choi, “JVET common test conditions and evaluation procedures for 360° video,” 11th JVET Meeting of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC29/WG11, JVET-K1012-v1, 2018.
[17] Y. Ye, and J. Boyce, “Algorithm descriptions of projection format conversion and video quality metrics in 360Lib Version 7,” 11th JVET Meeting of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC29/WG11, JVET-K1004, 2018.
[18] K. K. Sreedhar, A. Aminlou, and M. M. Hannuksela, "Viewport-adaptive encoding and streaming of 360-degree video for virtual reality applications," IEEE International Symposium Multimedia (ISM) 2016 on. IEEE, San Jose, USA, pp. 583-586, 2016.

Comment


Editorial Office
1108, New building, 22, Teheran-ro 7-gil, Gangnam-gu, Seoul, Korea
Homepage: www.kibme.org TEL: +82-2-568-3556 FAX: +82-2-568-3557
Copyrightⓒ 2012 The Korean Institute of Broadcast and Media Engineers
All Rights Reserved