Search by item HOME > Access full text > Search by item

JBE, vol. 23, no. 5, pp.622-627, September, 2018


Augmented Reality System in Real Space using Mobile Projection

Moran Kim and Jun-Sik Kim

C.A E-mail:


In this paper, we introduce an integrated augmented reality system using a small camera and a projector. We extract three-dimensional information of an object with a small portable camera and a projector by using a structured light system. We develop the concept of the virtual camera to generalize the projection method so that the image can be projected at a desired position with only the mesh of the object to be projected without computing the mapping between specific point sets. Therefore, it is possible to project not only simple planes but also complex curved surfaces to desired positions without complicated geometric calculation. Based on a robot with a small camera and a projector, it will largely explain the projector-camera system calibration, the calculation of the position of the recognized object, and the image projection method using the virtual camera concept.

Keyword: Projection-Based Augmented Reality, Virtual Camera

[1] H.L. Chi, S.C. Kang, and X. Wang, “Research trends and opportunities of augmented reality applications in architecture, engineering, and construction,“ Automation in Construction, Vol 33, pp.116-122, 2013.
[2] R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. MacIntyre, “Recent Advances in Augmented Reality,” IEEE Computer Graphics and Applications, pp.34-37, 2001.
[3] M. Pollefeys, R. Koch and L. Van Gool “ Self-Calibration and Metric Reconstruction in Spite of Varying and Unknown Internal Camera Parameters,” International Journal of Computer Vision, Vol.32, No.1, pp.7-25, 1999
[4] E. Rosten, and T. Drummond, “Machine learning for high-speed corner detection,” European conference on computer vision, Springer, Berlin, Heidelberg, pp. 430–443, 2006.
[5] D.G. Lowe, “Distinctive Image Features from Scale-Invariant Keypoints,” International Journal of Computer Vision, Vol 60, No 2, pp. 91-110, 2004.
[6] C. Rocchini, P, Cignoni, C. Montani, P. Pingi, and R. Scopigno,“A low cost 3D scanner based on structured light,” EUROGRAPHICS, 20 (2001)3.
[7] F. Moreno-Noguer, V. Lepetit and P. Fua, “EPnP: An Accurate O(n) Solution to the PnP Problem,” International Journal of Computer Vision, Vol. 81, No. 2, pp. 155-166, 2009.
[8] M.R, Kim, and J.-S Kim, “An Automatic Projector-Camera Calibration Method using an Auxiliary RGB-D Camera,” Image Processing and Image Understanding, 2017.
[9] Y. Xu, and D. Aliaga, “Robust pixel classification for 3D modeling with structured light,” Proceeding of Conference on Graphics Interface, pp. 233-240, 2007.
[10] S. Nayar, G. Krishnan, M. Grossberg, and R. Raskar, “Fast separation of direct and global components of a scene using high frequency illumination,” ACM Transactions on Graphics (TOG), Vol.25, No.3. pp.935–944, 2006.


Editorial Office
1108, New building, 22, Teheran-ro 7-gil, Gangnam-gu, Seoul, Korea
Homepage: TEL: +82-2-568-3556 FAX: +82-2-568-3557
Copyrightⓒ 2012 The Korean Institute of Broadcast and Media Engineers
All Rights Reserved