Search by item HOME > Access full text > Search by item

JBE, vol. 25, no. 5, pp.770-775, September, 2020


Activated Viewport based Surveillance Event Detection in 360-degree Video

Yoo-jeong Shim and Myeong-jin Lee

C.A E-mail:


Since 360-degree ERP frame structure has location-dependent distortion, existing video surveillance algorithms cannot be applied to 360-degree video. In this paper, an activated viewport based event detection method is proposed for 360-degree video. After extracting activated viewports enclosing object candidates, objects are finally detected in the viewports. These objects are tracked in 360-degree video space for region-based event detection. The proposed method is shown to improve the recall and the false negative rate more than 30% compared to the conventional method without activated viewports.

Keyword: 360-degree video, activated viewport, surveillance event detection, object tracking

[1] J. Redmon and A. Farhadi, “Yolov3: An incremental improvement,” arXiv preprint arXiv:1804.02767, 2018.
[2] N. Wojke, A. Bewley, and D. Paulus, “Simple online and realtime tracking with a deep association metric,” IEEE International Conference on Image Processing, pp. 3464-3468, Sep 2017.
[3] Lee, Yeonkun, Jaeseok Jeong, Jongseob Yun, Wonjune Cho, and Kuk-Jin Yoon, “SpherePHD: Applying CNNs on a Spherical PolyHeDron Representation of 360° Images,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 9181-9189, 2019.
[4] Su, Yu-Chuan, and Kristen Grauman. "Kernel transformer networks for compact spherical convolution," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 9442-9451, 2019.
[5] Yoo-jeong Shim, Min-seok Lee, Seok-ho Baek , Myeong-jin Lee. “Multi-object tracking method and system for 360-degree video,” Summer Annual conference of IEIE, Jun:700-701, 2019.
[6] Nayak, Rashmiranjan, Mohini Mohan Behera, Vaisyaraju Girish, Umesh Chandra Pati, and Santos Kumar Das, “Deep Learning Based Loitering Detection System Using Multi-Camera Video Surveillance Network,” IEEE International Symposium on Smart Electronic Systems, pp. 215-220, 2019.
[7] Park, Keon-woo, Doo-sik Kang, Jun-sik Kim, and Myeong-jin Lee, “Loitering Detection based on Regional Histogram and Object Velocity,” Summer Annual conference of KICS, pp.1304-1305, 2016.
[8] Kim, Seajin, Byung-jin Lee, Jae-won Jeong, and Myeong-jin Lee. “Multi-object tracking coprocessor for multi-channel embedded DVR systems,” IEEE Transactions on Consumer Electronics, pp.1366- 1374, 2012.
[9] Korea Internet&Security Agency, "Intelligent CCTV Solution Performance Test and Certification Guide," pp. 30, 2018.
[10] Bernardin, Keni, and Rainer Stiefelhagen. "Evaluating multiple object tracking performance: the CLEAR MOT metrics," EURASIP Journal on Image and Video Processing, pp. 1-10, Dec 2008.


Editorial Office
1108, New building, 22, Teheran-ro 7-gil, Gangnam-gu, Seoul, Korea
Homepage: TEL: +82-2-568-3556 FAX: +82-2-568-3557
Copyrightⓒ 2012 The Korean Institute of Broadcast and Media Engineers
All Rights Reserved