• Title/Summary/Keyword: lip-sync

Search Result 22, Processing Time 0.018 seconds

Commercial 4K UHD Streaming Device over 5G Mobile Communication Network (5G 이동통신망을 통한 상용 4K UHD 스트리밍 장치)

  • Junghoon, Paik;Yongsuk, Kim
    • Journal of Broadcast Engineering
    • /
    • v.27 no.6
    • /
    • pp.914-922
    • /
    • 2022
  • In this paper, we construct a commercial 4K UHD(Ultra High Definition) streaming device that utilizes a 5G mobile communication network as a transport channel and conduct a streaming performance test. It uses RTP(Realtime Transport Protocol) which has transmission quality monitoring capability as a transmission protocol to apply adaptive streaming. In addition, it provides the function to adjust the encoding rate of the video signal so that encoding can be optimized for the change in the bandwidth of the transmission channel. Through the performance test, it is confirmed that the H.265 encoding rate for 4K UHD signal is 48.69Mbps, the average glass-to-glass delay time is 293.60ms, and the average time difference between video and audio for lip sync is 120ms. With the result of performance test, it is shown that the streaming device is applied to 4K UHD Streaming device over 5G mobile communication network.

Case Study : Cinematography using Digital Human in Tiny Virtual Production (초소형 버추얼 프로덕션 환경에서 디지털 휴먼을 이용한 촬영 사례)

  • Jaeho Im;Minjung Jang;Sang Wook Chun;Subin Lee;Minsoo Park;Yujin Kim
    • Journal of the Korea Computer Graphics Society
    • /
    • v.29 no.3
    • /
    • pp.21-31
    • /
    • 2023
  • In this paper, we introduce a case study of cinematography using digital human in virtual production. This case study deals with the system overview of virtual production using LEDs and an efficient filming pipeline using digital human. Unlike virtual production using LEDs, which mainly project the background on LEDs, in this case, we use digital human as a virtual actor to film scenes communicating with a real actor. In addition, to film the dialogue scene between the real actor and the digital human using a real-time engine, we automatically generated speech animation of the digital human in advance by applying our Korean lip-sync technology based on audio and text. We verified this filming case by using a real-time engine to produce short drama content using real actor and digital human in an LED-based virtual production environment.