Search by item HOME > Access full text > Search by item

JBE, vol. 23, no. 6, pp.886-895, November, 2018


Detection of Frame Deletion Using Convolutional Neural Network

Jin Hyung Hong, Yoonmo Yang, and Byung Tae Oh

C.A E-mail:


In this paper, we introduce a technique to detect the video forgery by using the regularity that occurs in the video compression process. The proposed method uses the hierarchical regularity lost by the video double compression and the frame deletion. In order to extract such irregularities, the depth information of CU and TU, which are basic units of HEVC, is used. For improving performance, we make a depth map of CU and TU using local information, and then create input data by grouping them in GoP units. We made a decision whether or not the video is double-compressed and forged by using a general three-dimensional convolutional neural network. Experimental results show that it is more effective to detect whether or not the video is forged compared with the results using the existing machine learning algorithm.

Keyword: Video Forensics, Frame Deletion, HEVC, CNN, Coding Pattern

[1] S. Milani, M. Fontani, P. Bestagini, M. Barni, A. Piva, M. Tagliasa- cchi, and S. Tubaro, “An overview on video forensics,” APSIPA Tran- sactions on Signal and Information Processing, 1, 2012.
[2] T. Shanableh, “No-reference PSNR identification of MPEG video using spectral regression and reduced model polynomial networks,” IEEE Signal Processing Letters, 17.8, 2010.
[3] J. Lukas, J. Fridrich, and M. Goljan, “Digital camera identification from sensor pattern noise,” IEEE Transactions on Information Foren- sics and Security, 1.2: 205-214, 2006.
[4] W. Wang, and H. Farid, “Exposing digital forgeries in video by detecting double MPEG compression,” In: Proceedings of the 8th workshop on Multimedia and security. ACM, 37-47, 2006.
[5] W, Wang, and H. Farid, “Exposing digital forgeries in video by detecting double quantization,” In: Proceedings of the 11th ACM workshop on Multimedia and security. ACM, 39-48, 2009.
[6] Y. Su and J. Xu, “Detection of double-compression in MPEG-2 videos,” Intelligent Systems and Applications (ISA), 2010 2nd Interna- tional Workshop on. IEEE, 1-4, 2010.
[7] T. Shanableh, “Prediction of structural similarity index of compressed video at a macroblock level,” IEEE Signal Processing Letters, May, 18.5, 2011
[8] D. Vazquez-Padin, M. Fontani, T. Bianchi, P. Comesaña, A. Piva, and M. Barni, “Detection of video double encoding with GOP size estimation,” In: Information Forensics and Security (WIFS), 2012 IEEE International Workshop on. IEEE, 151-156, 2012.
[9] A. Gironi, M. Fontani, T. Bianchi, A. Piva, and M. Barni, “A video forensic technique for detecting frame deletion and insertion,” In: Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 6226-6230, 2014.
[10] Q. Dong, G. Yang, and N. Zhu, “A MCEA based passive forensics scheme for detecting frame-based video tampering,” Digital Investigation, 9.2: 151-159, 2012.
[11] Y. Su, J. Zhang, J. Liu, “Exposing digital video forgery by detecting motion-compensated edge artifact,” In: Computational Intelligence and Software Engineering, 2009. CiSE 2009. International Conference on. IEEE, 1-4, 2009.
[12] P. He, X. Jiang, T. Sun, S. Wang, B. Li, and Y. Dong, “Frame-wise detection of relocated I-frames in double compressed H.264 videos based on convolutional neural network,” Journal of Visual Communication and Image Representation 48: 149-158, 2017.
[13] X. Jiang, W. Wang, T. Sun, YQ. Shi, and S. Wang, “Detection of double compression in MPEG-4 videos based on Markov statistics,” IEEE Signal Processing Letters, 20.5: 447-450, 2013.
[14] T. Shanableh, “Detection of frame deletion for digital video forensics,” Digital Investigation, 10.4: 350-360, 2013.
[15] L. Yu, H. Wang, Q. Han, X. Niu, SM. Yiu, J. Fang, and Z. Wang, “Exposing frame deletion by detecting abrupt changes in video streams,” Neurocomputing, 205: 84-91, 2016.
[16] J. H. Hong, Y. Yang, B. T. Oh, “Detection of frame deletion using coding pattern analysis,” Journal of Broadcast Engineering, 22.6, 734-743, 2017.


Editorial Office
1108, New building, 22, Teheran-ro 7-gil, Gangnam-gu, Seoul, Korea
Homepage: TEL: +82-2-568-3556 FAX: +82-2-568-3557
Copyrightⓒ 2012 The Korean Institute of Broadcast and Media Engineers
All Rights Reserved