• Journal of Internet Computing and Services
• /
• v.5 no.6
• /
• pp.59-66
• /
• 2004

In this paper, we propose a transmission rate prediction method of video data. The proposed method checks shot transition characteristics after dividing MPEG video data into a GoP unit and then uses Kalman filter. It used algorithm to detect shot transition information by high speed in compressed domain in order to check a correct shot transition of video data and classified into a abrupt shot transition type and a gradual shot transition type. Information to have been classifying is used as factors of Kalman filter and predicts a transmission rate of video data. Also, the proposed method decreased processing time with detecting shot transition and predicting a transmission rate of video data in compressed domain. It predicted a transmission rate with 96.2- 97.6% in the experiment that used three kinds of 911 1frames of different video data.

• The KIPS Transactions:PartB
• /
• v.12B no.4 s.100
• /
• pp.403-412
• /
• 2005

In this paper, we propose an effective method for detecting and classifying shot transitions in video sequences. The proposed method detects and classifies shot transitions including cuts, fades and dissolves by compensating camera operations in video sequences, so that our method prevents false positives resulting from camera operations. Also, our method eliminates local moving objects in the process of compensating camera operations, so that our method prevents errors resulting from moving objects. In the experiments, we show that our shot transition approach can work as a promising solution by comparing the proposed method with previously known methods in terms of performance.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.12 no.8
• /
• pp.3670-3676
• /
• 2011

A cell animation is represented by one background cell, and there is much difference of images when its shot is changed. Also, it does not have a lot of colors since people themselves draw it. In order to effectively detect shot transitions of cell animations while fully considering their intrinsic characteristics, in this paper, we propose a animation shot boundary detection algorithm that utilizes color and block-based histograms step by step. The suggested algorithm first converts RGB color space into HSI color one, and coarsely decides if adjacent frames contains a shot transition by performing color difference operation between two images. If they are considered to have a shot transition candidate, we calculate color histograms for 9 sub-regions of the adjacent images and apply weights to them. Finally, we determine whether there is a real shot transition by analyzing the weighted sum of histogram values. In experiments, we show that our method is superior to others.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2019.06a
• /
• pp.29-31
• /
• 2019

샷 경계 검출(Shot Boundary Detection)은 영상 콘텐츠 분석을 위한 필수적인 기술이며, 다양한 방식으로 편집된 영상의 샷 경계를 정확하게 검출하기 위한 연구가 지속되어 왔다. 그러나 기존에 연구들은 고정된 샷 경계 검출 알고리즘이나 매뉴얼한 작업과 같이 학습이 불가능한 과정이 포함되어 있어 성능 개선에 한계가 있었다. 본 논문에서는 이러한 과정을 제거한 End-to-End 모델을 제안한다. 제안하는 모델은 시공간 정보 추출성능을 높이기 위해 행동 인식 데이터셋을 이용한 전이학습을 사용하고, 샷 경계 검출 성능을 높이기 위해 개선된 지식의 증류기법(Knowledge Distillation)을 결합한다. 제안하는 모델은 ClipShots 데이터셋에서 DeepSBD 에 비해 cut transition 과 gradual transition 이 각각 5.4%, 41.29% 높은 성능을 보였고, DSM 과의 비교에서 cut transition 의 정확도가 1.3% 더 높은 결과를 보였다.

• Proceedings of the Korea Institute of Convergence Signal Processing
• /
• 2000.08a
• /
• pp.249-252
• /
• 2000

본 논문에서는 MPEG으로 압축된 영상에 대해서 급격한 장면 변화에 의한 shot 경계(cut)와 점진적 장면 변화에 의한 shot 경계(dissolve)를 검출하여 비디오 shot을 분할하는 기법을 제안한다. 기존의 방법으로 잘 검출하지 못하였던 점진적 장면 변화에 의한 shot의 경계를 검출하기 위한 기법을 제안한다. 먼저 압축영역의 기법 중 DCT DC 값을 비교하는 방법을 이용하여 cut에 의한 shot 경계를 검출한다 그리고 움직임 벡터(MV)의 비를 비교하는 방법을 사용하여 dissolve에 의한 shot 경계의 후보지들을 얻어내고, 선택된 후보지들 중 n번째와 n＋2번째 후보지 영상으로 dissolve 영상을 만들어 n＋1번째 후보지의 영상과 유사도를 비교하여 dissolve를 검출한다. 이와 같이 압축영역에서 cut에 의한 shot 경계와 dissolve에 의한 shot 경계의 후보지를 검출해 내고, 검출된 shot 경계 후보지들에서 dissolve에 의한 shot 경계를 검출하는 방법을 함으로서 MPEG 비디오 영상의 복원량을 최소화하여 수행 속도를 높이면서도 cut과 dissolve 두 가지 모두를 효과적으로 검출할 수 있었다.

• The KIPS Transactions:PartB
• /
• v.10B no.6
• /
• pp.611-618
• /
• 2003

In this paper, we describe a fuzzy inference approach for detecting and classifying shot transitions in video sequences. Our approach basically extends FAM (Fuzzy Associative Memory) to detect and classify shot transitions, including cuts, fades and dissolves. We consider a set of feature values that characterize differences between two consecutive frames as input fuzzy sets, and the types of shot transitions as output fuzzy sets. The inference system proposed in this paper is mainly composed of a learning phase and an inferring phase. In the learning phase, the system initializes its basic structure by determining fuzzy membership functions and constructs fuzzy rules. In the inferring phase, the system conducts actual inference using the constructed fuzzy rules. In order to verify the performance of the proposed shot transition detection method experiments have been carried out with a video database that includes news, movies, advertisements, documentaries and music videos.

• Proceedings of the IEEK Conference
• /
• 2000.06d
• /
• pp.7-10
• /
• 2000

There are many Problems such as low detection ratio, velocity and increase of false hit ratio on the detection of gradual scene changes with the previous shot transition detection algorithms. In this paper, we Propose an improved dissolve detection method using color information on low-frequency subband and edge elements on high-frequency subband. The Possible dissolve transition are found by analyzing the edge change ratio in the high-frequency subband with edge elements of each direction. Using the double chromatic difference on the lowest frequency subband, we have the improvement of the dissolve detection ratio. The simulation results show that the performance of the proposed algorithm is better than the conventional one for dissolve detection on a diverse set of uncompressed video sequences.

• Journal of KIISE:Software and Applications
• /
• v.29 no.8
• /
• pp.565-572
• /
• 2002

학습과 추론을 위하여 유용한 방법으로 퍼지연상기억장치가 있다. 본 논문에서는 보다 효과적으로 추론결과를 유도하기 위하여 퍼지연상기억장치를 학습하는 단계에서 오류 역전파를 통하여 노드들 사이의 연결가중치를 재조정하는 방법과 퍼지규칙들을 간결화하는 방법을 제안한다. 제안된 방법은 비디오 데이타의 장면전환을 검출하는 분야에 적용하여 성능평가를 수행한다.

• Journal of KIISE:Software and Applications
• /
• v.31 no.3
• /
• pp.379-386
• /
• 2004

Video segmentation is a fundamental task in video indexing and it includes two kinds of shot change detections such as the abrupt transition and the gradual transition. The abrupt shot boundaries are detected by computing the image-based distance between adjacent frames and comparing this distance with a pre-determined threshold value. However, the gradual shot boundaries are difficult to detect with this approach. To overcome this difficulty, we propose the method that detects gradual transition in the MPEG compressed video using the HMM (Hidden Markov Model). We take two different HMMs such as a discrete HMM and a continuous HMM with a Gaussian mixture model. As image features for HMM's observations, we use two distinct features such as the difference of histogram of DC images between two adjacent frames and the difference of each individual macroblock's deviations at the corresponding macroblock's between two adjacent frames, where deviation means an arithmetic difference of each macroblock's DC value from the mean of DC values in the given frame. Furthermore, we obtain the DC sequences of P and B frame by the first order approximation for a fast and effective computation. Experiment results show that we obtain the best detection and classification performance of gradual transitions when a continuous HMM with one Gaussian model is taken and two image features are used together.

• Journal of KIISE:Software and Applications
• /
• v.30 no.7_8
• /
• pp.727-743
• /
• 2003

This paper proposes an automatic highlight building algorithm for soccer video by using the structural characteristics of broadcasted sports video that an interesting (or important) event (such as goal or foul) in sports video has a continuous replay shot surrounded by gradual shot change effect like wipe. This shot editing rule is used in this paper to analyze the structure of broadcated soccer video and extracts shot involving the important events to build a highlight. It first uses the spatial-temporal image of video to detect wipe transition effects and zoom out/in shot changes. They are used to detect the replay shot. However, using spatial-temporal image alone to detect the wipe transition effect requires too much computational resources and need to change algorithm if the wipe pattern is changed. For solving these problems, a two-pass detection algorithm and a pixel sub-sampling technique are proposed in this paper. Furthermore, to detect the zoom out/in shot change and replay shots more precisely, the green-area-ratio and the motion energy are also computed in the proposed scheme. Finally, highlight shots composed of event and player shot are extracted by using these pre-detected replay shot and zoom out/in shot change point. Proposed algorithm will be useful for web services or broadcasting services requiring abstracted soccer video.