Comparative Evaluation of Color-Based Video Signatures in the Presence of Various Distortion Types

The robustness of color-based signatures in the presence of a selection of representative distortions is investigated. Considered are five signatures that have been developed and evaluated within a new modular framework. Two signatures presented in this work are directly derived from histograms gathered from video frames. The other three signatures are based on temporal information by computing difference histograms between adjacent frames. In order to obtain objective and reproducible results, the evaluations are conducted based on several randomly assembled test sets. These test sets are extracted from a video repository that contains a wide range of broadcast content including documentaries, sports, news, movies, etc. Overall, the experimental results show the adequacy of color-histogram-based signatures for video fingerprinting applications and indicate which type of signature should be preferred in the presence of certain distortions.

• Aritz Sánchez de la Fuente
• Patrick Ndjiki-Nya
• Karsten Sühring
• Tobias Hinz
• Karsten Müller
• Thomas Wiegand

• color histograms
• robust hashing
• video retrieval
• video signature

[1] B. Preneel, R. Govaerts, and J. Vandewalle, "Cryptographic hash
functions", Proceedings of the 3rd Symposium on State and Progress of Research in Cryptography, W. Wolfowicz (ed.), Fondazione Ugo
Bordoni, pp. 161-171, 1993.
[2] B. Coskun, and B. Sankur, "Robust Video Hash Extraction", EUSIPCO
2004, pp. 2295-2298, Vienna, April 2004.
[3] R. Radhakrishnan, and C. Bauer, "Content-Based Video Signatures based on Projections of Difference Images", IEEE 9th Workshop on Multimedia Signal Processing, pp. 341-344, Greece, 1-3 Oct. 2007.
[4] T.C. Hoad, and J. Zobel, "Detection of Video Sequences Using
Compact Signatures", ACM Transactions on Information Systems (TOIS), Volume 24, Issue 1, pp. 1-50, January 2006.
[5] B.S. Manjunath, P. Salembier, and T. Sikora, "Introduction to MPEG-7:
Multimedia Content Description Interface", John Wiley & Sons, Inc.,
New York, NY, 2002.
[6] A. Yamada, M. Pickering, S. Jeannin, L. Cieplinski, J.R. Ohm, and M.
Kim, "MPEG-7 Visual Part of eXperimentation Model Version 10.0”,
ISO/IEC JTC1/SC29/WG11/N4063, Singapore, March 2001.