Ebook: Scene detection in Hollywood movies and TV shows

Rasheed, Z.; Shah, M., Scene detection in Hollywood movies and TV shows, Computer Vision and Pattern Recognition, 2003. Proceedings. 2003 IEEE Computer Society Conference on , vol.2, no., pp.II,343-8 vol.2, 18-20 June 2003
doi: 10.1109/CVPR.2003.1211489
Abstract: A scene can be defined as one of the subdivisions of a play in which the setting is fixed, or when it presents continuous action in one place. We propose a novel two-pass algorithm for scene boundary detection, which utilizes the motion content, shot length and color properties of shots as the features. In our approach, shots are first clustered by computing Backward Shot Coherence (BSC) - a shot color similarity measure that detects Potential Scene Boundaries (PSBs) in the videos. In the second pass we compute Scene Dynamics (SD), a function of shot length and the motion content in the potential scenes. In this pass, a scene merging criteria has been developed to remove weak PSBs in order to reduce over segmentation. We also propose a method to describe the content of each scene by selecting one representative image. The segmentation of video data into number of scenes facilitates an improved browsing of videos in electronic form, such as video on demand, digital libraries, Internet. The proposed algorithm has been tested on a variety of videos that include five Hollywood movies, one sitcom, and one interview program and promising results have been obtained.
Keywords: coherence; edge detection; image colour analysis; image segmentation; video signal processing; BSC; Backward Shot Coherence; Hollywood movie; Internet; PSB; Potential Scene Boundary; SD; Scene Dynamics; TV show; color property; continuous action; digital library; fixed setting; image representation; interview program; play subdivision; scene boundary detection; scene detection; scene merging criteria; shot clustering; shot color similarity measuring; shot feature; shot length; sitcom; two-pass algorithm; video browsing; video data; video on demand; video segmentation; Clustering algorithms; Gunshot detection systems; Image segmentation; Layout; Merging; Motion detection; Motion pictures; Software libraries; TV; Video on demandURL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=1211489&isnumber=27266