Search by item HOME > Access full text > Search by item

JBE, vol. 25, no. 4, pp.475-486, July, 2020


Production Technology for Multi-face Convergence Performance

Mi You, Tae-Woong Son, and Sang-Il Kim

C.A E-mail:


This paper is a thesis on media art technology for high-tech performances and exhibitions. After creating an interactive stroke in VR, it is projected in real time through a media facade technique. Among our traditional dramas emphasizing linear movements, movements were extracted from the Bongsan mask dance, and the movements of the lines were used in a media art performance called 'Multi-face Convergence’. When motion data enters the virtual space, geometry consisting of faces is created in the VR space. The created strokes can be set with various brush types, and when performing, a stroke with a red fire effect that matches a dynamic movement was used. It was made to be able to harmonize with the dancers performing the Bongsan mask dance. The medium called VR has characteristics that are not suitable for melting into a performance, but in this performance, it has overcome its limitations by using a technique called media façade. We propose the world's first performance technique that combines interactive strokes with traditional dance performances.

Keyword: Interactive Stroke, Motion Extraction, Tilt Brush, Media Facade

[1] P. Milgram, “A Taxonomy of Mixed Reality Visual Displays“, IEICE Transactions on Information Systems, Vol. E77-D, No.12 December 1994.
[2] M. You, “A Study on Production for Mixed Reality Animation”, The Korean Journal of Animation, Vol. 15, No. 1, pp.23-38, March 2019.
[3] H. Lee, S. Seo, S. Ryoo and K. Yoon, “Painterly Stroke Generation using Object Motion Analysis“, Journal of KIISE : Computer Systems and Theory, Vol.37, No.4, pp.239-245, August 2010.
[4] M. Salisbury, M. Wong, J. Hughes and D. Salesin, "Orientable Textures for Image-based Pen and Ink Illustration," In Proceedings of SIGGRAPH 1997, pp.401-406, Auguast 1997.
[5] J. Hays and I. Essa, "Image and Video Based Painterly Animation", 3rd Ann. Symp. Non-Photorealistic Animation and Rendering(NPAR2004), pp.120-133, June 2004.
[6] C. Park, “A Study on the Development Direction of New Media Art Using Virtual Reality”, Journal of the Korea Academia-Industrial Coopera- tion Society, Vol.21, No.1 pp. 97-102, January 2020.
[7] Y, Liu and C, Chang, "The Application of Virtual Reality Technology in Art Therapy: A Case of Tilt Brush", 2018 1st IEEE International Conference on Knowledge Innovation and Invention (ICKII), pp. 47-50, July 2018, doi: 10.1109/ICKII.2018.8569081.
[8] Y. Kim, B. Kim, J. Kim and Y. Kim, “CanvoX: High-resolution VR Painting in Large Volumetric Canvas”. arXiv (Technical Report), pp.1-22. April 2017.
[9] L. Herman and S. Hutka, "Virtual Artistry: Virtual Reality Translations of Two-Dimensional Creativity", C&C '19: Proceedings of the 2019 on Creativity and Cognition, pp.612–618, June 2019.
[10] S. Song, “The Meaning and Structure of Lexical Chumsawis in Korean Traditional Dances: With the Focus on Mok-jung-gwa-jang in Bongsan Mask Dance”, The Korean Journal of Dance, Vol.76, No.6, pp.107-135. December 2018.
[11] D. Youn, “Cultural Heritage Contributing to Performing Art of Korean Dance”, The Journal of Korean Dance, Vol.34, No.4, pp.123-149, December 2016. [12] J. Cho, “A Study on Performing Arts Contents Applying Advanced Media Technologies”. Journal of the Korea Society Design Culture, Vol.21, No.2, pp.637-645, June 2015.
[13] J. Kim, “A Study on Characteristics of Media Performance in Opening Performance - For the Examples of the Domestic Media Performance Management Company Showgle and dotMill”. Journal of the Korean Society Design Culture, Vol.21, No.3, pp.205-217, September 2015.
[14] J. Kang, “Current Situation and the Vision of Convergence between Korean Dance and Information and Communications Technology”, The Korean Society of Culture and Convergence, Vol.40, No.1, pp.127-156, January 2018.
[15] S. Mun, M. Whang, S. Park, D. Lee, H. Kim, “Overview of VR Media Technology and Methods to Reduce Cybersickness”, Journal of Broadcast Engineering, Vol.23, No.6, pp.800-812, November 2018.
[16] K. Kim, “A Study on the Compositions and Applications of Video Solution for Small-sized Theater Performance:Focused on the Musical”, The Journal of the Korea Contents Association, Vol.19, No.8, pp.359-369, August 2019.


Editorial Office
1108, New building, 22, Teheran-ro 7-gil, Gangnam-gu, Seoul, Korea
Homepage: TEL: +82-2-568-3556 FAX: +82-2-568-3557
Copyrightⓒ 2012 The Korean Institute of Broadcast and Media Engineers
All Rights Reserved