Search by item HOME > Access full text > Search by item

JBE, vol. 25, no. 5, pp.685-697, September, 2020

DOI: https://doi.org/10.5909/JBE.2020.25.5.685

Parallax Distortion Detection and Correction Method for Video Stitching by using LDPM Image Assessment

Seongbae Rhee, Jeonho Kang, and Kyuheon Kim

C.A E-mail: kyuheonkim@khu.ac.kr

Abstract:

Immersive media videos, such as panorama and 360-degree videos, must provide a sense of realism as if the user visited the space in the video, so they should be able to represent the reality of the real world. However, in panorama and 360-degree videos, objects appear to overlap or disappear due to parallax between cameras, and such parallax distortion may interfere with immersion of the user's content. Accordingly, although many video stitching algorithms have been proposed to overcome parallax distortion, parallax distortion still occurs due to the low performance of the Object detection module and limitations of the Seam generation method. Therefore, this paper analyzes the limitations of the existing video stitching technology and proposes a method for detecting and correcting parallax distortion of video stitching using the LDPM (Local Differential Pixel Mean) image evaluation method that overcomes the limitations of the video stitching technique.



Keyword: Video Stitching, Parallax Distortion, Seam Optimization, LDPM, Blending

Reference:
[1] Jeonho Kang, Junsik Kim, SangIL Kim, and Kyuheon Kim, “Method of Video Stitching based on Minimal Error Seam”, The Korean Institute of Broadcast and Media Engineers, Vol.24, No.1, pp.142-152, January, 2019. [2] R. Szeliski, “Image Alignment and Stitching: A Tutorial.” Foundations and Trends in Computer Graphics and Computer Vision, Vol. 2, No.1, 2006. [3] Kang, Jeonho, et al. "Minimum Error Seam-Based Efficient Panorama Video Stitching Method Robust to Parallax." IEEE Access 7 (2019): 167127-167140. [4] Wei, L. Y. U., et al. "A survey on image and video stitching." Virtual Reality & Intelligent Hardware Vol. 1, No.1 pp.55-83, 2019. [5] Levin, Anat, et al. "Seamless image stitching in the gradient domain." European Conference on Computer Vision. Springer, Berlin, Heidelberg, 2004. [6] Bujnák, Martin, and Radim Sara. "A robust graph-based method for the general correspondence problem demonstrated on image stitching." 2007 IEEE 11th International Conference on Computer Vision. IEEE, 2007. [7] Zhi, Qi, and Jeremy R. Cooperstock. "Toward dynamic image mosaic generation with robustness to parallax." IEEE Transactions on Image Processing, pp.366-378, Vol.21, No.1, 2011. [8] Qureshi, H. S., et al. "Quantitative quality assessment of stitched pan- oramic images." IET image processing, Vol.6, no.9, pp.1348-1358, 2012. [9] Zaragoza, Julio, et al. "As-projective-as-possible image stitching with moving DLT." Proceedings of the IEEE conference on computer vision and pattern recognition. 2013. [10] Zhang, Guofeng, et al. "Multi-viewpoint panorama construction with wide-baseline images." IEEE Transactions on Image Processing, Vol.25, No.7, pp.3099-3111, 2016. [11] Lin, Kaimo, et al. "Seagull: Seam-guided local alignment for parallax-tolerant image stitching." European conference on computer vision. Springer, Cham, 2016. [12] Gao, Junhong, et al. "Seam-Driven Image Stitching." Eurographics (Short Papers). 2013. [13] Abdukholikov, Murodjon, and Taegkeun Whangbo. "Fast image stitching method for handling dynamic object problems in Panoramic Images." KSII Transactions on Internet & Information Systems, Vol.11, No.11, 2017. [14] Kwatra, Vivek, et al. "Graphcut textures: image and video synthesis using graph cuts." ACM Transactions on Graphics (ToG), Vol.22, No.3, pp.277-286. 2003. [15] Rhee, Seongbae, Jeonho Kang, and Kyuheon Kim. "Local Differential Pixel Assessment Method for Image Stitching." Journal of Broadcast Engineering, Vol.24, No.5, pp.775-784, 2019 [16] Wang, Zhou, et al. "Image quality assessment: from error visibility to structural similarity." IEEE transactions on image processing, Vol.13, No.4, pp.600-612, 2004.

Comment


Editorial Office
1108, New building, 22, Teheran-ro 7-gil, Gangnam-gu, Seoul, Korea
Homepage: www.kibme.org TEL: +82-2-568-3556 FAX: +82-2-568-3557
Copyrightⓒ 2012 The Korean Institute of Broadcast and Media Engineers
All Rights Reserved