• Title/Summary/Keyword: 이미지-투-비디오

Search Result 3, Processing Time 0.016 seconds

Style Synthesis of Speech Videos Through Generative Adversarial Neural Networks (적대적 생성 신경망을 통한 얼굴 비디오 스타일 합성 연구)

  • Choi, Hee Jo;Park, Goo Man
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.11 no.11
    • /
    • pp.465-472
    • /
    • 2022
  • In this paper, the style synthesis network is trained to generate style-synthesized video through the style synthesis through training Stylegan and the video synthesis network for video synthesis. In order to improve the point that the gaze or expression does not transfer stably, 3D face restoration technology is applied to control important features such as the pose, gaze, and expression of the head using 3D face information. In addition, by training the discriminators for the dynamics, mouth shape, image, and gaze of the Head2head network, it is possible to create a stable style synthesis video that maintains more probabilities and consistency. Using the FaceForensic dataset and the MetFace dataset, it was confirmed that the performance was increased by converting one video into another video while maintaining the consistent movement of the target face, and generating natural data through video synthesis using 3D face information from the source video's face.

Analysis of the possibility of utilizing customized video production using generative AI

  • Hyun Kyung Seo
    • Journal of the Korea Society of Computer and Information
    • /
    • v.29 no.11
    • /
    • pp.127-136
    • /
    • 2024
  • As generative AI technology develops, the paradigm of video production is also changing. After going through an initial stage where it could not be used as actual video footage due to low quality and difficulties with consistency and continuity, various videos produced with generative AI are being used in the video industry. Following these changes, this paper identifies the potential of customized generative AI. It examines the direction of technological development of generative AI in the video industry and analyzes recent cases in advertising, film, and animation to reveal that the reason for the increased utilization of generative AI is to achieve the essential purpose of content as well as quality results. Through this process, we expect the potential of generative AI in the video industry.

Pose Creation of Character in Two-Dimensional Cartoon through Human Pose Estimation (인간자세 추정방법에 의한 2차원 웹툰 캐릭터 포즈 생성)

  • Jeong, Hieyong;Shin, Choonsung
    • Journal of Broadcast Engineering
    • /
    • v.27 no.5
    • /
    • pp.718-727
    • /
    • 2022
  • The Korean domestic cartoon industry has grown explosively by 65% compared to the previous year. Then the market size is expected to exceed KRW 1 trillion. However, excessive work results in health deterioration. Moreover, this working environment makes the production of human resources insufficient, repeating a vicious cycle. Although some tasks require creation activity during cartoon production, there are still a lot of simple repetitive tasks. Therefore, this study aimed to develop a method for creating a character pose through human pose estimation (HPE). The HPE is to detect key points for each joint of a user. The primary role of the proposed method was to make each joint of the character match that of the human. The proposed method enabled us to create the pose of the two-dimensional cartoon character through the results. Furthermore, it was possible to save the static image for one character pose and the video for continuous character pose.