• Title/Summary/Keyword: frame detection

Search Result 920, Processing Time 0.034 seconds

Deep Learning and Color Histogram based Fire and Smoke Detection Research

  • Lee, Yeunghak;Shim, Jaechang
    • International journal of advanced smart convergence
    • /
    • v.8 no.2
    • /
    • pp.116-125
    • /
    • 2019
  • The fire should extinguish as soon as possible because it causes economic loss and loses precious life. In this study, we propose a new atypical fire and smoke detection algorithm using deep learning and color histogram of fire and smoke. First, input frame images obtain from the ONVIF surveillance camera mounted in factory search motion candidate frame by motion detection algorithm and mean square error (MSE). Second deep learning (Faster R-CNN) is used to extract the fire and smoke candidate area of motion frame. Third, we apply a novel algorithm to detect the fire and smoke using color histogram algorithm with local area motion, similarity, and MSE. In this study, we developed a novel fire and smoke detection algorithm applied the local motion and color histogram method. Experimental results show that the surveillance camera with the proposed algorithm showed good fire and smoke detection results with very few false positives.

Video Shot Detection Based on Video Frame Types (비디오 프레임 타입을 이용한 비디오 셧 검출)

  • Kim, Young-Bin;Ryu, Kwang-Ryol;Sclabassi, Robert J.
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2007.06a
    • /
    • pp.145-148
    • /
    • 2007
  • The video shot detection based on video picture type is presented in this paper. The detection algorithm is used MPEG compressed video frame directly, not reconstructed the original image. For shot detection, I and P frame of MPEG video bit stream are classified. The detecting scene cuts at I pictures are detected by reconstructed DC image. While scene cuts at P picture frame by monitoring the percentage of Intra-macroblocks per P picture. Experimental results on the test video bit stream is shown the detection rate of $85\sim98%$ and searching time is 4 times faster than the previously known video shot detection algorithm on the decompressed video shot.

  • PDF

Gradual Scene Change Detection Using Variance of Edge Image (에지 영상의 분산을 이용한 비디오의 점진적 장면전환 검출)

  • Ryoo, Han-Jin;Yoo, Hun-Woo;Jang, Dong-Sik;Kim, Mun-Hwa
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.8 no.3
    • /
    • pp.275-280
    • /
    • 2002
  • A new algorithm for gradual scene change detection in MPEG based frame sequences is proposed in this paper. The proposed algorithm is based on the fact that most of gradual curves can be characterized by variance distributions of edge information in the frame sequences. Average edge frame sequences are obtained by performing "sober" edge detection. Features are extracted by comparing variances with those of local blocks in the average edge frames. Those features are further processed by the opening operation to obtain smoothing variance curves. The lowest variance in the local frame sequences is chosen as a gradual detection point. Experimental results show that the proposed method provides 85% precision and 86% recall rate fur gradual scene changes.

A Study on Detecting Glasses in Facial Image

  • Jung, Sung-Gi;Paik, Doo-Won;Choi, Hyung-Il
    • Journal of the Korea Society of Computer and Information
    • /
    • v.20 no.12
    • /
    • pp.21-28
    • /
    • 2015
  • In this paper, we propose a method of glasses detection in facial image. we develop a detection method of glasses with a weighted sum of the results that detected by facial element detection and glasses frame candidate region. Component of the face detection method detects the glasses, by defining the detection probability of the glasses according to the detection of a face component. Method using the candidate region of the glasses frame detects the glasses, by defining feature of the glasses frame in the candidate region. finally, The results of the combined weight of both methods are obtained. The proposed method in this paper is expected to increase security system's recognition on facial accessories by raising detection performance of glasses or sunglasses for using ATM.

Key Frame Detection Using Contrastive Learning (대조적 학습을 활용한 주요 프레임 검출 방법)

  • Kyoungtae, Park;Wonjun, Kim;Ryong, Lee;Rae-young, Lee;Myung-Seok, Choi
    • Journal of Broadcast Engineering
    • /
    • v.27 no.6
    • /
    • pp.897-905
    • /
    • 2022
  • Research for video key frame detection has been actively conducted in the fields of computer vision. Recently with the advances on deep learning techniques, performance of key frame detection has been improved, but the various type of video content and complicated background are still a problem for efficient learning. In this paper, we propose a novel method for key frame detection, witch utilizes contrastive learning and memory bank module. The proposed method trains the feature extracting network based on the difference between neighboring frames and frames from separate videos. Founded on the contrastive learning, the method saves and updates key frames in the memory bank, witch efficiently reduce redundancy from the video. Experimental results on video dataset show the effectiveness of the proposed method for key frame detection.

Shortcut Shot Detection Based on Compressed Video Bitstream

  • Ryu, Kwang-Ryol;Kim, Young-Bin
    • Journal of information and communication convergence engineering
    • /
    • v.5 no.3
    • /
    • pp.269-272
    • /
    • 2007
  • The shortcut shot detection based on MPEG compressed video bitstream is presented in this paper. The detection algorithm is used the video picture frame from MPEG compressed video directly not to be decompressed the original image. For shortcut detection, I and P frame of MPEG video bitstream are classified. The changing scene cuts at I pictures are detected by the decompressed DC image and scene cuts at P picture frame by monitoring the percentage of intra-macroblocks per P picture are detected. Experimental results using test video bitstream QVGA results in average 92% detection rate, searching time is taken around 4.5 times faster in comparison with changing scene shot detection algorithm which is decompressed the compressed bitstream.

Anomaly detection of isolating switch based on single shot multibox detector and improved frame differencing

  • Duan, Yuanfeng;Zhu, Qi;Zhang, Hongmei;Wei, Wei;Yun, Chung Bang
    • Smart Structures and Systems
    • /
    • v.28 no.6
    • /
    • pp.811-825
    • /
    • 2021
  • High-voltage isolating switches play a paramount role in ensuring the safety of power supply systems. However, their exposure to outdoor environmental conditions may cause serious physical defects, which may result in great risk to power supply systems and society. Image processing-based methods have been used for anomaly detection. However, their accuracy is affected by numerous uncertainties due to manually extracted features, which makes the anomaly detection of isolating switches still challenging. In this paper, a vision-based anomaly detection method for isolating switches, which uses the rotational angle of the switch system for more accurate and direct anomaly detection with the help of deep learning (DL) and image processing methods (Single Shot Multibox Detector (SSD), improved frame differencing method, and Hough transform), is proposed. The SSD is a deep learning method for object classification and localization. In addition, an improved frame differencing method is introduced for better feature extraction and a hough transform method is adopted for rotational angle calculation. A number of experiments are conducted for anomaly detection of single and multiple switches using video frames. The results of the experiments demonstrate that the SSD outperforms the You-Only-Look-Once network. The effectiveness and robustness of the proposed method have been proven under various conditions, such as different illumination and camera locations using 96 videos from the experiments.

CUDA based parallel design of a shot change detection algorithm using frame segmentation and object movement

  • Kim, Seung-Hyun;Lee, Joon-Goo;Hwang, Doo-Sung
    • Journal of the Korea Society of Computer and Information
    • /
    • v.20 no.7
    • /
    • pp.9-16
    • /
    • 2015
  • This paper proposes the parallel design of a shot change detection algorithm using frame segmentation and moving blocks. In the proposed approach, the high parallel processing components, such as frame histogram calculation, block histogram calculation, Otsu threshold setting function, frame moving operation, and block histogram comparison, are designed in parallel for NVIDIA GPU. In order to minimize memory access delay time and guarantee fast computation, the output of a GPU kernel becomes the input data of another kernel in a pipeline way using the shared memory of GPU. In addition, the optimal sizes of CUDA processing blocks and threads are estimated through the prior experiments. In the experimental test of the proposed shot change detection algorithm, the detection rate of the GPU based parallel algorithm is the same as that of the CPU based algorithm, but the average of processing time speeds up about 6~8 times.

Consecutive-Frame Super-Resolution considering Moving Object Region

  • Cho, Sung Min;Jeong, Woo Jin;Jang, Kyung Hyun;Choi, Byung In;Moon, Young Shik
    • Journal of the Korea Society of Computer and Information
    • /
    • v.22 no.3
    • /
    • pp.45-51
    • /
    • 2017
  • In this paper, we propose a consecutive-frame super-resolution method to tackle a moving object problem. The super-resolution is a method restoring a high resolution image from a low resolution image. The super-resolution is classified into two types, briefly, single-frame super-resolution and consecutive-frame super-resolution. Typically, the consecutive-frame super-resolution recovers a better than the single-frame super-resolution, because it use more information from consecutive frames. However, the consecutive-frame super-resolution failed to recover the moving object. Therefore, we proposed an improved method via moving object detection. Experimental results showed that the proposed method restored both the moving object and the background properly.

Video Shot Boundary Detection Using Correlation of Luminance and Edge Information (명도와 에지정보의 상관계수를 이용한 비디오샷 경계검출)

  • Yu, Heon-U;Jeong, Dong-Sik;Na, Yun-Gyun
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.7 no.4
    • /
    • pp.304-308
    • /
    • 2001
  • The increase of video data makes the demand of efficient retrieval, storing, and browsing technologies necessary. In this paper, a video segmentation method (scene change detection method, or shot boundary detection method) for the development of such systems is proposed. For abrupt cut detection, inter-frame similarities are computed using luminance and edge histograms and a cut is declared when the similarities are under th predetermined threshold values. A gradual scene change detection is based on the similarities between the current frame and the previous shot boundary frame. A correlation method is used to obtain universal threshold values, which are applied to various video data. Experimental results show that propose method provides 90% precision and 98% recall rates for abrupt cut, and 59% precision and 79% recall rates for gradual change.

  • PDF