Gradual Shot Boundary Detection and Classification Based on Fractal Analysis
Shot boundary detection is a fundamental step for the organization of large video data. In this paper, we propose a new method for video gradual shots detection and classification, using advantages of fractal analysis and AIS-based classifier. Proposed features are “vertical intercept" and “fractal dimension" of each frame of videos which are computed using Fourier transform coefficients. We also used a classifier based on Clonal Selection Algorithm. We have carried out our solution and assessed it according to the TRECVID2006 benchmark dataset.
[1] S. W. Smoliar and H.-J. Zhang, "Content-based video indexing and
retrieval," IEEE Multimedia, vol. 1, no. 2, 1994, pp. 62-72.
[2] R. Lienhart, S. Pfeiffer, and W. Effelsberg, "Video abstracting,"
Commun. ACM, vol. 40, no. 12, 1997, pp. 55-62.
[3] X. U. Cabedo and S. K. Bhattacharjee, "Shot detection tools in digital
video," in Proc. Non-Linear Model based Image Analysis, 1998,
pp.121-126.
[4] V. Kobla, D. DeMenthon, and D. Doermann, "Special effect edit
detection using videotrails: a comparison with existing techniques," in
Proc. SPIE Conf. Storage Retrieval Image Video Databases VII, Jan.
1999, pp. 302-313.
[5] A. Nagasaka and Y. Tanaka, "Automatic Video Indexing and Full-Video
Search for Object Appearances," Proceedings of the IFIP TC2/WG 2.6
Second Working Conference on Visual Database Systems II, North-
Holland Publishing Co., 1992, pp. 113-127.
[6] H. Zhang, A. Kankanhalli, and S.W. Smoliar, "Automatic partitioning of
full-motion video," Multimedia Systems, vol. 1, Jan. 1993, pp. 10-28.
[7] B. Shahraray, "Scene change detection and content-based sampling of
video sequences," Apr. 1995.
[8] A. Nagasaka and Y. Tanaka, "Automatic Video Indexing and Full-Video
Search for Object Appearances," Proceedings of the IFIP TC2/WG 2.6
Second Working Conference on Visual Database Systems II, North-
Holland Publishing Co., 1992, pp. 113-127.
[9] W. Xiong, J. C.-M. Lee, "Efficient Scene Change Detection and Camera
Motion Annotation for Video Classification", Computer Vision and
Image Understanding, Vol.71, Issue 2,1998, pp.166-181.
[10] A.M. Ferman and A.M. Tekalp, "Efficient Filtering and Clustering
Methods for Temporal Video Segmentation and Visual Summarization,"
Journal of Visual Communication and Image Representation, vol. 9,
Dec. 1998, pp. 336-351.
[11] F. Arman, A. Hsu, and M. Chiu, "Image processing on compressed data
for large video databases," Proceedings of the first ACM international
conference on Multimedia, Anaheim, California, United States: ACM,
1993, pp. 267-272.
[12] B. Yeo and B. Liu, "Rapid scene analysis on compressed video,"
Circuits and Systems for Video Technology, IEEE Transactions on, vol.
5, 1995, pp. 544, 533.
[13] K. Shen and E.J. Delp, "A fast algorithm for video parsing using MPEG
compressed sequences," Proceedings of the 1995 International
Conference on Image Processing (Vol.2)-Volume 2 - Volume 2, IEEE
Computer Society, 1995, p. 2252.
[14] Z. Cernekova, I. Pitas, and C. Nikou, "Information theory-based
shot cut/fade detection and video summarization," Circuits and
Systems for Video Technology, IEEE Transactions on, vol. 16,
2006, pp. 82-91.
[15] P. Chiu, A. Girgensohn, W. Polak, E. Rieffel, and L. Wilcox, "A genetic
algorithm for video segmentation and summarization," Multimedia and
Expo, 2000. ICME 2000. 2000 IEEE International Conference on, 2000,
pp. 1329-1332 vol.3.
[16] . Lienhart, "Reliable transition detection in videos: a survey and
practitioner-s guide," Int. J. Image Graph., vol. 1, no. 3, 2001, pp. 469-
486.
[17] M. Albanese, A. Chianese, V. Moscato, and L. Sansone, "A Formal
Model for Video Shot Segmentation and its Application via Animate
Vision," Multimedia Tools and Applications, vol. 24, Dec. 2004, pp.
253-272.
[18] Jinhui Yuan, Huiyi Wang, Lan Xiao, Wujie Zheng, Jianmin Li, Fuzong
Lin, and Bo Zhang, "A Formal Study of Shot Boundary Detection,"
Circuits and Systems for Video Technology, IEEE Transactions on, vol.
17, 2007, pp. 168-186.
[19] Sarkar N., B.B. Chaudhuri, "An efficient differential box-counting
approach to compute fractal dimension of image", IEEE Transaction on
System Man and Cybernet, vol.24, no.1, 1994, pp.115-120.
[20] Zhang J. , Regtien P.P.L. , Korsten M.J. , "Monitoring of dry sliding
wear using fractal analysis", 10th TC-10 IMEKO Conference on
Technical Diagnostics, 9-10 June, 2005, Budapest, Hungary
[21] Russ J. C.: Fractal Surfaces. New York (etc.), Plenum Press 1994.
[22] Rawers J., Tylczak J.: Fractal characterization of wear-erosion surfaces,
Journal of Materials Engineering and Performance, vol. 8, no.6, 1999,
pp. 669-676.
[23] R.C. Gonzalez and R.E. Woods, Digital Image Processing, Prentice
Hall, 2002.
[24] Z. Cernekov'a, N. Nikolaidis, I. Pitas. AIIA shot boundary detection at
TRECVID 2006, TREC Video Retrieval Evaluation(C), 2006
[25] NIST, Homepage of Trecvid Evaluation, http://wwwnlpir.
nist.gov/projects/trecvid/
[1] S. W. Smoliar and H.-J. Zhang, "Content-based video indexing and
retrieval," IEEE Multimedia, vol. 1, no. 2, 1994, pp. 62-72.
[2] R. Lienhart, S. Pfeiffer, and W. Effelsberg, "Video abstracting,"
Commun. ACM, vol. 40, no. 12, 1997, pp. 55-62.
[3] X. U. Cabedo and S. K. Bhattacharjee, "Shot detection tools in digital
video," in Proc. Non-Linear Model based Image Analysis, 1998,
pp.121-126.
[4] V. Kobla, D. DeMenthon, and D. Doermann, "Special effect edit
detection using videotrails: a comparison with existing techniques," in
Proc. SPIE Conf. Storage Retrieval Image Video Databases VII, Jan.
1999, pp. 302-313.
[5] A. Nagasaka and Y. Tanaka, "Automatic Video Indexing and Full-Video
Search for Object Appearances," Proceedings of the IFIP TC2/WG 2.6
Second Working Conference on Visual Database Systems II, North-
Holland Publishing Co., 1992, pp. 113-127.
[6] H. Zhang, A. Kankanhalli, and S.W. Smoliar, "Automatic partitioning of
full-motion video," Multimedia Systems, vol. 1, Jan. 1993, pp. 10-28.
[7] B. Shahraray, "Scene change detection and content-based sampling of
video sequences," Apr. 1995.
[8] A. Nagasaka and Y. Tanaka, "Automatic Video Indexing and Full-Video
Search for Object Appearances," Proceedings of the IFIP TC2/WG 2.6
Second Working Conference on Visual Database Systems II, North-
Holland Publishing Co., 1992, pp. 113-127.
[9] W. Xiong, J. C.-M. Lee, "Efficient Scene Change Detection and Camera
Motion Annotation for Video Classification", Computer Vision and
Image Understanding, Vol.71, Issue 2,1998, pp.166-181.
[10] A.M. Ferman and A.M. Tekalp, "Efficient Filtering and Clustering
Methods for Temporal Video Segmentation and Visual Summarization,"
Journal of Visual Communication and Image Representation, vol. 9,
Dec. 1998, pp. 336-351.
[11] F. Arman, A. Hsu, and M. Chiu, "Image processing on compressed data
for large video databases," Proceedings of the first ACM international
conference on Multimedia, Anaheim, California, United States: ACM,
1993, pp. 267-272.
[12] B. Yeo and B. Liu, "Rapid scene analysis on compressed video,"
Circuits and Systems for Video Technology, IEEE Transactions on, vol.
5, 1995, pp. 544, 533.
[13] K. Shen and E.J. Delp, "A fast algorithm for video parsing using MPEG
compressed sequences," Proceedings of the 1995 International
Conference on Image Processing (Vol.2)-Volume 2 - Volume 2, IEEE
Computer Society, 1995, p. 2252.
[14] Z. Cernekova, I. Pitas, and C. Nikou, "Information theory-based
shot cut/fade detection and video summarization," Circuits and
Systems for Video Technology, IEEE Transactions on, vol. 16,
2006, pp. 82-91.
[15] P. Chiu, A. Girgensohn, W. Polak, E. Rieffel, and L. Wilcox, "A genetic
algorithm for video segmentation and summarization," Multimedia and
Expo, 2000. ICME 2000. 2000 IEEE International Conference on, 2000,
pp. 1329-1332 vol.3.
[16] . Lienhart, "Reliable transition detection in videos: a survey and
practitioner-s guide," Int. J. Image Graph., vol. 1, no. 3, 2001, pp. 469-
486.
[17] M. Albanese, A. Chianese, V. Moscato, and L. Sansone, "A Formal
Model for Video Shot Segmentation and its Application via Animate
Vision," Multimedia Tools and Applications, vol. 24, Dec. 2004, pp.
253-272.
[18] Jinhui Yuan, Huiyi Wang, Lan Xiao, Wujie Zheng, Jianmin Li, Fuzong
Lin, and Bo Zhang, "A Formal Study of Shot Boundary Detection,"
Circuits and Systems for Video Technology, IEEE Transactions on, vol.
17, 2007, pp. 168-186.
[19] Sarkar N., B.B. Chaudhuri, "An efficient differential box-counting
approach to compute fractal dimension of image", IEEE Transaction on
System Man and Cybernet, vol.24, no.1, 1994, pp.115-120.
[20] Zhang J. , Regtien P.P.L. , Korsten M.J. , "Monitoring of dry sliding
wear using fractal analysis", 10th TC-10 IMEKO Conference on
Technical Diagnostics, 9-10 June, 2005, Budapest, Hungary
[21] Russ J. C.: Fractal Surfaces. New York (etc.), Plenum Press 1994.
[22] Rawers J., Tylczak J.: Fractal characterization of wear-erosion surfaces,
Journal of Materials Engineering and Performance, vol. 8, no.6, 1999,
pp. 669-676.
[23] R.C. Gonzalez and R.E. Woods, Digital Image Processing, Prentice
Hall, 2002.
[24] Z. Cernekov'a, N. Nikolaidis, I. Pitas. AIIA shot boundary detection at
TRECVID 2006, TREC Video Retrieval Evaluation(C), 2006
[25] NIST, Homepage of Trecvid Evaluation, http://wwwnlpir.
nist.gov/projects/trecvid/
@article{"International Journal of Information, Control and Computer Sciences:63140", author = "Zeinab Zeinalpour-Tabrizi and Faeze Asdaghi and Mahmooh Fathy and Mohammad Reza Jahed-Motlagh", title = "Gradual Shot Boundary Detection and Classification Based on Fractal Analysis", abstract = "Shot boundary detection is a fundamental step for the organization of large video data. In this paper, we propose a new method for video gradual shots detection and classification, using advantages of fractal analysis and AIS-based classifier. Proposed features are “vertical intercept" and “fractal dimension" of each frame of videos which are computed using Fourier transform coefficients. We also used a classifier based on Clonal Selection Algorithm. We have carried out our solution and assessed it according to the TRECVID2006 benchmark dataset.
", keywords = "shot boundary detection, gradual shots, fractal analysis, artificial immune system, choose Clooney.", volume = "4", number = "8", pages = "1354-6", }
