Search by item HOME > Access full text > Search by item

JBE, vol. 27, no. 5, pp.654-664, September, 2022


A Study on Immersive Content Production and Storytelling Methods using Photogrammetry and Artificial Intelligence Technology

Jungho Kim, JinWan Park, and Taekyung Yoo

C.A E-mail:


Immersive content overcomes spatial limitations through convergence with extended reality, artificial intelligence, and photogrammetry technology along with interest due to the COVID-19 pandemic, presenting a new paradigm in the content market such as entertainment, media, performances, and exhibitions. However, it can be seen that in order for realistic content to have sustained public interest, it is necessary to study storytelling method that can increase immersion in content rather than technological freshness. Therefore, in this study, we propose a immersive content storytelling method using artificial intelligence and photogrammetry technology. The proposed storytelling method is to create a content story through interaction between interactive virtual beings and participants. In this way, participation can increase content immersion. This study is expected to help content creators in the accelerating immersive content market with a storytelling methodology through virtual existence that utilizes artificial intelligence technology proposed to content creators to help in efficient content creation. In addition, I think that it will contribute to the establishment of a immersive content production pipeline using artificial intelligence and photogrammetry technology in content production.

Keyword: Immersive Contents, Photogrammetry, Artificial Intelligene, Virtual Beings, eXtented Reality

[1] J. Kang, “A Case Study on Application of Realistic Content to Space Design”, Journal of Digital Convergence, Vol.15, No.6, pp. 369-376, 2017 doi:
[2] E. Leem, “Design and Development of XR Contents Authoring Framework for IT Convergence Education”, Journal of Advanced Navigation Technology, Vol.24, No.6, pp.633-539, September 2020. doi:
[3] Market spending on extended reality(XR) technologie worldwide from 2018 to 2023, by industry, 1096765/global-market-spend-on-xr-technologies-by-industry
[4] The Mandalorian leads the way: Real-time virtual production is saving hollywood during the lockdown, the-mandalorian-real-time-virtual-production-saving-hollywood-lockdown-vfx-120230120/
[5] M. Choi, “Augmented Reality and Storytelling”, The Society of Korean Language & Culture, Vol.0, No.73, pp.433-459, 2020.
[6] T. Yoo, “A Study on Storytelling of VR Cartoons”, Journal of braodcast engineering, Vol.23, No.1, pp.45-52, 2018. doi:
[7] H. Shin, “The Freedom of Viewpoint in VR Contents: With a Focus on Lost, an Animation”, The Korean Journal of animation, Vol.12, No.4, pp.87-102, 2016.
[8] Geigel, Joe, et al, “The digital docent: XR Storytelling for a Living History Museum”, In 26th ACM Symposium on Virtual Reality Sofeware and Technology, pp. 1-3, 2020. doi:
[9] N. Skult and J. Smed, “Interactive Storytelling in Extended Reality: Concepts for the Design”, In: Game User Experience and Player- Centered Design, pp. 449-467, 2020. doi:
[10] Huynh-The, Thien, et al., “Artificial Intelligence for the Metaverse: A Survey”, arXiv preprint arXiv:2202. 10336, 2022. doi:
[11] J. Cohn, “The Scientist of the Holy Ghost: Sunsrping and Reading Nonsense”, Journal of Cinema and Media Studies, Vol.60, No.5, pp.1-21, 2021. [12] H. Rheingold, Virtual Reality, Summit Books, 1991
[13] C. Anthes, R. J. G. Hernandez, M. Wiedemann, D. Kranzlmuller, “State of the Art of Virtual Reality Technologies”, 2016 IEEE Aerospace Conference, Montana, United States, 2016. doi:
[14] T. P. Caudell and D. W. Mizell, “Augmented reality: an application of heads-up display technology to manual manufacturing processes”, in Proceedings of the Twenty-Fifth Hawaii Interanational Conference on System Science, Vol.2, pp.659-669, 1992.
[15] P. Chen, X. Liu, and R. Huang, “A review of using Augmented Reality in Education from 2011 to 2016”, Innovations in Smart Learning, pp.13-18, 2017.
[16] M. Flasinski, Introduction to artificial intelligence, Springer International Publishing, Switzeland, pp.3-14, 2016.
[17] F. Tao, H. Zhang, A. Liu, and A. Y. C. Nee, “Digital twin in industry:State-of-the-art”, IEEE Transactions on Industrial Infor- matics, Vol.15, No.4, pp.2405-2415, April, 2019. doi:
[18] D. Chen, D. Wang, Y. Zhu, and Z. Han, “Digital twin for federated analytics using a bayesian approach”, IEEE Internet of Things Journal, Vol.8, No.22, pp.16301-16312, November, 2021. doi:
[19] M. Daniluk, T. Rocktaschel, J. Welbl, and S. Riedel, “Frustraingly short attention spans in neural language modeling”, arXiv preprint arxiv:1702.04521, 2017
[20] D. Liu, J. Fu, Q. Qu, and J. Lv, “BFGAN: backward and forwad generative adversarial networks for lexically constrained sentence generation”, IEEEE/ACM Transaction on Audio, Speech, and Language Processing, Vol.27, No.12, pp.2350-2362, December, 2019
[21] J. Decker, A. Doherty, J. Geigel, and G. D. Jacobs, “Blending Diciplines for a Blended Reality: Virtual Guides for a Living History Museum”, The Journal of Interactive Technology & Pedagogy, Vol.17, May, 2020.
[22] Comparison of Top 10 Speech Processing APIs, activewizards-machine-learning-company/comparison-of-top-10-speech-processing-apis-2293de1d337f


Editorial Office
1108, New building, 22, Teheran-ro 7-gil, Gangnam-gu, Seoul, Korea
Homepage: TEL: +82-2-568-3556 FAX: +82-2-568-3557
Copyrightⓒ 2012 The Korean Institute of Broadcast and Media Engineers
All Rights Reserved