Client-driven Animated Keyframe Generation System Using Music Analysis

음악 분석을 이용한 클라이언트 중심의 키프레임 생성 시스템

  • Mujtaba, Ghulam (Department of Computer Engineering, Gachon University) ;
  • Kim, Seondae (Department of Computer Engineering, Gachon University) ;
  • Park, Eunsoo (Department of Computer Engineering, Gachon University) ;
  • Kim, Seunghwan (Department of Computer Engineering, Gachon University) ;
  • Ryu, Jaesung (Department of Computer Engineering, Gachon University) ;
  • Ryu, Eun-Seok (Department of Computer Engineering, Gachon University)
  • Published : 2019.06.19

Abstract

Animated images formats such as WebP are highly portable graphics formats that are being used everywhere on the Internet. Despite their small sizes and duration, WebP image previews the video without watching the entire content with minimum bandwidth. This paper proposed a novel method to generate personalized WebP images in the client side using its computation resources. The proposed system automatically extracts the WebP image from climax point using music analysis. Based on user interest, the system predicts the genre using Convolutional Neural Network (CNN). The proposed method can easily integrate with streaming platforms such as YouTube, Netflix, Hulu, and others.

Keywords