RELIABLE TRANSITION DETECTION IN VIDEOS: A SURVEY AND PRACTITIONER'S GUIDE
International Journal of Image and GraphicsPublished 1 July 2001
Rainer Lienhart
Citations276
SJR quartileQ3
SJR score0.25
SNIP0.44
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This survey emphasizes those different core concepts underlying the different detection schemes for the three most widely used video transition effects: hard cuts, fades and dissolves.
Abstract
A large number of shot boundary detection, or equivalently, transition detection techniques have been developed in recent years. They all can be classified based on a few core concepts underlying the different detection schemes. This survey emphasizes those different core concepts underlying the different detection schemes for the three most widely used video transition effects: hard cuts, fades and dissolves. Representative of each concept one or a few very sound and thoroughly tested approaches are present in detail, while others are just listed. Whenever reliable performance numbers could be found in the literature, they are mentioned. Guidelines for practitioners in video processing are also given.
Keywords
Computer Science
IEEE Transactions on Pattern Analysis and Machine IntelligenceA Computational Approach to Edge Detection
29,107 Citations1986John Canny
There is a natural uncertainty principle between detection and localization performance, which are the two main goals, and with this principle a single operator shape is derived which is optimal at any scale.
Multimedia SystemsAutomatic partitioning of full-motion video
1,275 Citations1993HongJiang Zhang, Atreyi Kankanhalli +1 more
A twin-comparison approach has been developed to solve the problem of detecting transitions implemented by special effects, and a motion analysis algorithm is applied to determine whether an actual transition has occurred.
IEEE Transactions on Circuits and Systems for Video TechnologyRapid scene analysis on compressed video
718 Citations1995Boon-Lock Yeo, Bede Liu
Experimental results show that the proposed rapid scene analysis algorithms are fast and effective in detecting abrupt scene changes, gradual transitions including fade-ins and fade-outs, flashlight scenes and in deriving intrashot variations.
A feature-based algorithm for detecting and classifying scene breaks
491 Citations1995Ramin Zabih, Justin Miller +1 more
A new approach to the detection and classification of scene breaks in video sequences that can withstand compression artifacts such as those introduced by JPEG and MPEG, even at very high compression rates.
IEEE Transactions on Circuits and Systems for Video TechnologyPerformance characterization of video-shot-change detection methods
425 Citations2000Ullas Gargi, Rangachar Kasturi +1 more
The results of a performance evaluation and characterization of a number of shot-change detection methods that use color histograms, block motion matching, or MPEG compressed data are presented.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Comparison of automatic shot boundary detection algorithms</title>
396 Citations1998Rainer Lienhart
Comparative investigations on early shot boundary detection algorithms designed explicitly to detect specific complex editing operations, such as fades and dissolves, are taken into account and show that while hard cuts and fades can be detected reliably, dissolves are still an open research issue.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Scene change detection in an MPEG-compressed video sequence</title>
299 Citations1995Jianhao Meng, Yujen Juan +1 more
An algorithm is proposed for the detection of abrupt scene change and special editing effects such as dissolve in a compressed MPEG/MPEG-2 bitstream with minimal decoding of the bitstream to improve the processing speed for searching a video database of compressed image sequences.
IEEE Transactions on Circuits and Systems for Video TechnologyVideo visualization for compact presentation and fast browsing of pictorial content
285 Citations1997Minerva M. Yeung, Boon-Lock Yeo
This work proposes techniques to analyze video and build a compact pictorial summary for visual presentation and presents a set of video posters, each of which is a compact, visually pleasant, and intuitive representation of the story content.
Communications of the ACMVideo abstracting
278 Citations1997Rainer Lienhart, Silvia Pfeiffer +1 more
The algorithms discussed here for automatically generating video abstracts first decompose the input video into semantic units, called “shot clusters” or “scenes,” then detect and extract semantically rich pieces, especially text from the title sequence and special events, such as dialog, gunfire, and explosions.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Scene change detection and content-based sampling of video sequences</title>
245 Citations1995Behzad Shahraray
Multimedia SystemsA feature-based algorithm for detecting and classifying production effects
235 Citations1999Ramin Zabih, Justin Miller +1 more
The algorithm proposed withstands JPEG and MPEG artifacts, even at high compression rates, and can detect and classify production effects that are difficult to detect with previous approaches.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Comparison of video shot boundary detection techniques</title>
212 Citations1996John Boreczky, Lawrence A. Rowe
This paper presents a comparison of several shot boundary detection and classification techniques and their variations including histograms, discrete cosine transform, motion vector, and block matching methods.
Multimedia Tools and ApplicationsProduction model based digital video segmentation
205 Citations1995Arun Hampapur, Ramesh Jain +1 more
The approach proposed here is inspired and influenced by well established video production processes and is used to classify the transition effects used in video and to design automatic edit effect detection algorithms.
Automatic recognition of film genres
162 Citations1995Stephan Fischer, Rainer Lienhart +1 more
It is the goal to automatically classify the large body of existing video for easier access in digital video-on-demand databases.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Video indexing using motion vectors</title>
146 Citations1992Akihito Akutsu, Yoshinobu Tonomura +2 more
A video indexing method that uses motion vectors to 'identify' video sequences and corresponding icons is presented, based on the identification of discrete cut points and camera operations made possible by analyzing motion vectors.
New enhancements to cut, fade, and dissolve detection processes in video segmentation
139 Citations2000Ba Tu Truong, Chitra Dorai +1 more
A new adaptive threshold determination method is proposed that is shown to reduce artifacts created by noise and motion in scene cut detection and introduced a method for eliminating false positives from a list of detected candidate transitions.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Comparison of automatic video segmentation algorithms</title>
95 Citations1996Apostolos Dailianas, Robert B. Allen +1 more
This work examines several segmentation techniques across different types of videos that can identify over 90% of the real shot transitions but have a high percentage of false positives.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Reliable dissolve detection</title>
95 Citations2001Rainer Lienhart
This paper presents the first robust and reliable dissolve detection system, which combines the creation of a dissolve synthesizer capable of creating in principle an infinite number of dissolve examples of any duration form a video database of raw video footage.
Scene break detection: a comparison
77 Citations2002G. Lupatini, C. Saraceno +1 more
In this work, two new parameters are proposed that characterize the precision of boundaries of special effects when the scene change involves more than two frames, combined with the common recall and precision parameters.
Fade and dissolve detection in uncompressed and compressed video sequences
73 Citations2003W.A.C. Fernando, C.N. Canagarajah +1 more
An algorithm for fade and dissolve scene change detection in video sequences is presented and results show that these special effects can be identified accurately with the proposed scheme.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Dynamic video summarization of home video</title>
67 Citations1999Rainer Lienhart
New algorithms for generating amusing, visually appealing and variable video abstracts of home video material automatically are presented and a new, empirically motivated approach to cluster time-stamped shots hierarchically into meaningful units is presented.
1993 IEEE International Symposium on Circuits and SystemsDetecting and compressing dissolve regions in video sequences with a DVI multimedia image compression algorithm
53 Citations2002A.M. Alattar
A dissolve detector and dissolve handling mechanism are developed that exploits the parabolic behavior of the variances of the frames in a dissolve region to eliminate blockiness when the images in such a region are compressed with a motion compensation-based algorithm.
Detecting fade regions in uncompressed video sequences
43 Citations2002A.M. Alattar
A fade detector that exploits the changes in the average luminosities as well as the semi-parabolic behavior of the variances of the frames in the fade region is developed and results indicate that the developed detector has over a 95% reliability rate.
Performance characterization and comparison of video indexing algorithms
42 Citations2002Ullas Gargi, Rangachar Kasturi +1 more
The present results of evaluating a number of video temporal segmentation algorithms and characterizing their performance, specifically with respect to robustness to encoder and bitrate changes, have relevance to algorithm development and evaluation in general.
Feature-based hierarchical video segmentation
39 Citations2002John Yu, G. Bozdagi +1 more
Experimental results indicate that the proposed discontinuous cut, dissolve and fade detection method is both computationally low and robust to local changes within the sequences.
Improved fade and dissolve detection for reliable video segmentation
30 Citations2002B.T. Truong, C. Dorai +1 more
The objective of this detailed study of gradual shot transitions has been to accurately classify the type of transitions (fade-in, fade-out, and dissolve) and to precisely locate the boundary of the transitions.
Dissolve transition detection using B-splines interpolation
18 Citations2002Jeonghun Nam, Ahmed H. Tewfik
This work presents a novel identification technique for dissolve transitions in video sequences that is able to recover the original transition behavior of a dissolve edit effect even if it was distorted by various post-processing stages.
Dissolve detection in MPEG compressed video
16 Citations2002Lifang Gu, Ken Tsui +1 more
By analysing characteristics exhibited by a typical dissolve, two methods of detecting dissolves directly in MPEG compressed video are proposed and shown to be much more efficient than some pixel domain methods.