Skip to main content
Springer Nature Link
Log in

To accelerate shot boundary detection by reducing detection region and scope

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Video Shot Boundary Detection (SBD) is the fundamental process towards video summarization and retrieval. A fast and efficient SBD algorithm is necessary for real-time video processing applications. Extensive work has focused on accurate shot boundary detection at the expense of demanding computational costs. In this paper, we propose a fast SBD approach that reduces the computation pixel-wise and frame-wise while still giving satisfactory accuracy. The proposed approach substantially speeds up the computation through reducing both detection region and scope. Color histogram and mutual information are used together to measure the difference between frames. Corner distribution of frames is utilized to exclude most of false boundaries. We conduct extensive experiments to evaluate the proposed approach, and the results show that our approach can not only speed up SBD, but also detect shot boundaries with high accuracy in both Cut (CUT) and Gradual Transition (GT) boundaries.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Adjeroh D, Lee MC, Banda N, Kandaswamy1 U (2009) Adaptive edge-oriented shot boundary detection. EURASIP J Image Video Process (USA) 2009:1–14

    Article  Google Scholar 

  2. Cabedo XU, Bhattacharjee SK (1998) Shot detection tools in digital video. In: Proceedings of non-liner model based image analysis. Springer, Glasgow, pp 121–126

    Google Scholar 

  3. Chiu S-T, Lin G-S, Chang M-K (2008) An effective shot boundary detection algorithm for movies and sports. In: Proceedings of the 2008 3rd international conference on innovative computer information and control. Dalian, China, pp 173–176

    Chapter  Google Scholar 

  4. Cotsaces C, Gavrielides MA, Pitas I (2005) A survey of recent work in video shot boundary detections. In: Proceedings of 2005 workshop on audio-visual content and information visualization in digital libraries (AVIVDiLib ’05), 4–6 June 2005

  5. Cover TM, Thomas JA (1991) Elements of information theory. Wiley, New York

    Book  MATH  Google Scholar 

  6. Danisman T, Alpkocak A (2006) Dokuz Eyl’́ul University video shot boundary detection at trecvid 2006. In: Proceedings of the TREC video retrieval evaluation (TRECVID)

  7. Danisman T, Alpkocak A (2007) Bupt at trecvid 2007: shot boundary detection. In: Proceedings of the 2007 TREC video retrieval evaluation (TRECVID)

  8. Derpanis KG (2004) The harris corner detector, New York

  9. Han SH, Yoon KJ, Kweon IS (2000) A new technique for shot detection and key frames selection in histogram space. In: 12th workshop on image proceeding and image understanding, 2000

  10. Hanjalic, A (2002) Shot-boundary detection: unraveled and resolved? IEEE Trans Circuits Syst Video Technol 12(2):90–105

    Article  Google Scholar 

  11. Henga WJ, Ngan KN (2001) An object-based shot boundary detection using edge tracing and tracking. Vis Commun Image Represent 12(3):217–239

    Article  Google Scholar 

  12. Hu W, Xie N, Li L, Zeng X, Maybank S (2011) A survey on visual content-based video indexing and retrieval. IEEE Trans Syst Man Cybern, Part C Appl Rev 41(6):797–819

    Article  Google Scholar 

  13. Huang C-L, Liao B-Y (2001) A robust scene-change detection method for video segmentation. IEEE Trans Circuits Syst Video Technol 11(12):1281–1288

    Article  Google Scholar 

  14. Huang C-R, Lee H-P, Chen C-S (2008) Shot change detection via local keypoint matching. IEEE Trans Multimedia 10(6):1097–1108

    Article  Google Scholar 

  15. Huang X, Ma H, Yuan H (2008) A hidden markov model approach to parsing mtv video shot. In: Proceedings of the 2008 congress on image and signal processing, vol 2, pp 276–280

  16. Lefévre S, Holler J, Vincent N (2003) A review of real-time segmentation of uncompressed video sequences for content-based search and retrieval. Real-Time Imaging 9(1):73–98

    Article  Google Scholar 

  17. Li Y, Lu Z, Niu X (2009) Fast video shot boundary detection framework employing pre-processing techniques. Image Process, IET 3(3):121–134

    Article  MATH  Google Scholar 

  18. Lienhart RW (2001) Reliable dissolve detection. Storage Retr Media Databases. In: Proceedings of the SPIE Conference on storage and retrieval for media databases, vol 4315, pp 219–230

  19. Ling X, Yuanxin O, Huan L, Zhang X (2008) A method for fast shot boundary detection based on svm. In: Proceedings of the 2008 congress on image and signal processing, vol 2. Sanya, China, pp 445–449

  20. Mas J, Fernandez G (2003) Video shot boundary detection based on color histogram. In: Proceedings of the TREC video retrieval evaluation conference (TRECVID2003)

  21. Pei S-C, Chou Y-Z (1999) Efficient mpeg compressed video analysis using macroblock type information. IEEE Trans Multimedia 1(4):321–333

    Article  Google Scholar 

  22. Pei SC, Chou Y-Z (2002) Effective wipe detection in mpeg compressed video using macro block type information. IEEE Trans Multimedia 4(3):309–319

    Article  Google Scholar 

  23. Qin T, Gu J, Chen H, Tang Z (2010) A fast shot-boundary detection based on k-step slipped window. In: Proceedings of 2010 IEEE international conference on network infrastructure and digital content, pp 190–195

  24. Ren W, Sharma M, Singh S (2001) Automated video segmentation. In: International conference on information, communication, and signal processing, Singapore

  25. Su C-W, Liao H-Y, Tyan H-R, Fan K-C, Chen L (2005) A motion-tolerant dissolve detection algorithm. IEEE Trans Multimedia 7(6):1106–1113

    Article  Google Scholar 

  26. Tapu R, Zaharia T (2011) A complete framework for temporal video segmentation. In: Proceedings of 2011 IEEE international conference on consumer electronics. Berlin, pp 156–160

  27. Wolf MWW, Liu B (1998) An algorithm for wipe detection. In: Proceedings of international conference on image processing, vol 1, pp 893–897

  28. Xia D, Deng X, Zeng Q (2007) Shot boundary detection based on difference sequences of mutual information. In: Proceedings of the fourth international conference on image and graphics. Chengdu, China, pp 389–394

    Chapter  Google Scholar 

  29. Xiong W, Lee JC-M (1998) Efficient scene change detection and camera motion annotation for video classification. Comput Vis Image Underst 71(2):166–181

    Article  Google Scholar 

  30. Yeo B-L, Liu B (1995) Rapid scene analysis on compressed video. IEEE Trans Circuits Syst Video Technol 5(6):533–544

    Article  Google Scholar 

  31. Yuan J, Li J, Lin F, Zhang B (2005) A unified shot boundary detection framework based on graph partition model. In: Proceedings of the 13th annual ACM international conference on multimedia. Hilton, Singapore, pp 539–542

  32. Zhu S, Liu Y (2009) Automatic scene detection for advanced story retrieval. Expert Syst Appl 36(3, Part 2):5976–5986

    Article  Google Scholar 

  33. Zuzana C, Ioannis P, Nikou C (2006) Information theory-based shot cut or fade detection and video summarization. IEEE Trans Circuits Syst Video Technol 16(1):82–91

    Article  Google Scholar 

Download references

Acknowledgements

The work reported in this paper is supported by the National Science Foundation for Distinguished Young Scholars of China under Grant No.60925010, the Foundation for Innovative Research Groups of the National Natural Science Foundation of China under Grant No. 61121001, the Program for Changjiang Scholars and Innovative Research Team in University under Grant No. IRT1049, the Co-sponsored Project of Beijing Committee of Education.

Author information

Authors and Affiliations

  1. Beijing Key Laboratory of Intelligent Telecommunications Software and Multimedia, Beijing University of Posts and Telecommunications, Beijing, 100876, China

    Guangyu Gao & Huadong Ma

Authors
  1. Guangyu Gao
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Huadong Ma
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Huadong Ma.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gao, G., Ma, H. To accelerate shot boundary detection by reducing detection region and scope. Multimed Tools Appl 71, 1749–1770 (2014). https://doi.org/10.1007/s11042-012-1301-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-012-1301-z

Keywords