DOI QR코드

DOI QR Code

Spatiotemporal Patched Frames for Human Abnormal Behavior Classification in Low-Light Environment

저조도 환경 감시 영상에서 시공간 패치 프레임을 이용한 이상행동 분류

  • Widia A. Samosir (Dept. of Computer Science and Engineering, Sejong University) ;
  • Seong G. Kong (Dept. of Computer Science and Engineering, Sejong University)
  • ;
  • 공성곤 (세종대학교 컴퓨터공학과)
  • Published : 2023.11.02

Abstract

Surveillance systems play a pivotal role in ensuring the safety and security of various environments, including public spaces, critical infrastructure, and private properties. However, detecting abnormal human behavior in lowlight conditions is a critical yet challenging task due to the inherent limitations of visual data acquisition in such scenarios. This paper introduces a spatiotemporal framework designed to address the unique challenges posed by low-light environments, enhancing the accuracy and efficiency of human abnormality detection in surveillance camera systems. We proposed the pre-processing using lightweight exposure correction, patched frames pose estimation, and optical flow to extract the human behavior flow through t-seconds of frames. After that, we train the estimated-action-flow into autoencoder for abnormal behavior classification to get normal loss as metrics decision for normal/abnormal behavior.

Keywords

Acknowledgement

This work was supported in part by the Institute of Information and Communications Technology Planning and Evaluation (IITP) Grant funded by the Korean Government (MSIT) under Grant 2019-0-00231, and in part by the Development of artificial Intelligence-Based Video Security Technology and Systems for Public Infrastructure Safety.