• Title/Summary/Keyword: Immersive video

Search Result 129, Processing Time 0.025 seconds

An Advanced QER Selection Algorithm Based on MMT Protocol for 360-Degree VR Video Streaming (MMT 프로토콜 기반의 360도 VR 비디오 전송을 위한 개선된 QER 선택 알고리듬)

  • Kim, A-young;An, Eun-bin;Seo, Kwang-deok
    • Journal of Broadcast Engineering
    • /
    • v.24 no.6
    • /
    • pp.948-955
    • /
    • 2019
  • As interests in 360-degree VR (Virtual Reality) video services enormously grow, compression and streaming technologies for VR video data have been rapidly developed. Quality Emphasized Region (QER) based streaming scheme has been developed as a kind of viewport-adaptive 360-degree video streaming technology for maintaining immersive experience and reducing bandwidth waste. For selecting a QER corresponding to the user's gaze coordinate, QER-based streaming scheme requires the calculation of Quality Emphasis Center (QEC) distance and signaling message delivery for requesting QER switching. QEC distance calculations require high computational complexity because of repeated calculations as many times as the number of QERs. Furthermore, the signaling message interval results in a trade-off relationship between efficient bandwidth usage and flexible QER switching. In this paper, we propose an improved QER selection algorithm based on MMT protocol to solve this problem. The proposed algorithm could achieve computational complexity reduction by using preprocessed QER_ID_MAP. Also, flexible QER switching could be achieved, as well as efficient bandwidth utilization by an adaptive adjustment of the signaling interval.

A Study on Determinants of VR Video Content Popularity (VR 영상 조회수 결정요인 연구)

  • Soojeong Kim;Chanhee Kwak;Minhyung Lee;Junyeong Lee;Heeseok Lee
    • Information Systems Review
    • /
    • v.22 no.2
    • /
    • pp.25-41
    • /
    • 2020
  • Along with the expectation about 5G network commercialization, interests in realistic and immersive media industries such as virtual reality (VR) are increasing. However, most of studies on VR still focus on video technologies instead of factors for popularity and consumption. Thus, the main objective of this research is to identify meaningful factors, which affect the view counts of VR videos and to provide business implications of the content strategies for VR video creators and service providers. Using a regression analysis with 700 VR videos, this study tries to find major factors that affect the view counts of VR videos. As a result, user assessment factors such as number of likes and sicknesses have a strong influence on the view counts. In addition, the result shows that both general information factors (video length and age) and content characteristic factors (series, one source multi use (OSMU), and category) are all influential factors. The findings suggest that it is necessary to support recommendation and curation based on user assessments for increasing popularity and diffusion of VR video streaming.

Region Selective Transmission Method of MMT based 3D Point Cloud Content (MMT 기반 3차원 포인트 클라우드 콘텐츠의 영역 선별적 전송 방안)

  • Kim, Doohwan;Kim, Junsik;Kim, Kyuheon
    • Journal of Broadcast Engineering
    • /
    • v.25 no.1
    • /
    • pp.25-35
    • /
    • 2020
  • Recently, the development of image processing technology, as well as hardware performance, has been continuing the research on 3D point processing technology that provides users with free viewing angle and stereoscopic effect in various fields. Point cloud technology, which is a type of representation of 3D point, has attracted attention in various fields because it can acquired/expressed point precisely. However, since Hundreds of thousands, millions of point are required to represent one 3D point cloud content, there is a disadvantage that a larger amount of storage space is required than a conventional 2D content. For this reason, the MPEG (Moving Picture Experts Group), an international standardization organization, is continuing to research how to efficiently compress, store, and transmit 3D point cloud content to users. In this paper, a V-PCC bitstream generated by a V-PCC (Video-based Point Cloud Compression) encoder proposed by the MPEG-I (Immersive) group is composed of an MPU (Media Processing Unit) defined by the MMT. In addition, by extending the signaling message defined in the MMT standard, a parameter for a segmented transmission method of the 3D point cloud content by area and quality parameters considering the characteristic of the 3D point cloud content, so that the quality parameters can be selectively determined according to the user's request. Finally, in this paper, we verify the result through design/implementation of the verification platform based on the proposed technology.

The Effect of Matching between Odor and Color on Video Reality and Sense of Immersion (향과 색의 어울림이 영상 실감과 몰입감에 미치는 효과)

  • Lee, Guk-Hee;Li, Hyung-Chul O.;Bang, Dongmin;Ahn, ChungHyun;Ki, MyungSeok;Kim, ShinWoo
    • Journal of Broadcast Engineering
    • /
    • v.19 no.6
    • /
    • pp.877-895
    • /
    • 2014
  • It is common sense that providing specific odor can increase the video reality when video scene has an object having specific odor. However, people still do not know how to increase video reality and emotional immersion when there is no information on specific odor in the scene. So, present study explores how we improve video reality and immersion when the scene has no concrete odor information from some objects. Especially, this research focuses on diverse previous studies about matching between odor and color and then we expect providing odor can increase video reality if the odor is well-matched with the video's color. To do this, we collected 48 odors and investigated which color was well-matched with each odor. As a result, we get 5 odors which had clearly well-matched colors and decide ill-matched colors of those 5 odors as complementary colors of well-matched colors (Experiment 1). After that, we organize 3 conditions such as coloring image and video clip with well-matched color (color-odor match condition), coloring those with ill-matched color (color-odor mismatch condition), and coloring those with achromatic color by removing color saturation (color-odor neutral condition). Under each of these three conditions, image-odor matching, increment of reality with the odor, increment of immersion with the odor, and odor preference are asked (Experiment 2; 3). The results showed that the scores of all 4 questions in color-odor match condition were higher than color-odor mismatch condition and neutral condition. These results mean that providing matching odor with the scene's color in video is very effective to increase video reality and immersion. We expect experiencing better reality and immersion with olfactory information by adding various future research.

Adaptive Spatio-Temporal Prediction for Multi-view Coding in 3D-Video (3차원 비디오 압축에서의 다시점 부호화를 위한 적응적 시공간적 예측 부호화)

  • 성우철;이영렬
    • Journal of Broadcast Engineering
    • /
    • v.9 no.3
    • /
    • pp.214-224
    • /
    • 2004
  • In this paper, an adaptive spatio-temporal predictive coding based on the H.264 is proposed for 3D immersive media encoding, such as 3D image processing, 3DTV, and 3D videoconferencing. First, we propose a spatio-temporal predictive coding using the same view and inter-view images for the two TPPP, IBBP GOP (group of picture) structures 4hat are different from the conventional simulcast method. Second, an 2D inter-view direct mode for the efficient prediction is proposed when the proposed spatio-temporal prediction uses the IBBP structure. The 2D inter-view direct mode is applied when the temporal direct mode in B(hi-Predictive) picture of the H.264 refers to an inter-view image, since the current temporal direct mode in the H.264 standard could no: be applied to the inter-view image. The proposed method is compared to the conventional simulcast method in terms of PSNR (peak signal to noise ratio) for the various 3D test video sequences. The proposed method shows better PSNR results than the conventional simulcast mode.

3DTIP: 3D Stereoscopic Tour-Into-Picture of Korean Traditional Paintings (3DTIP: 한국 고전화의 3차원 입체 Tour-Into-Picture)

  • Jo, Cheol-Yong;Kim, Man-Bae
    • Journal of Broadcast Engineering
    • /
    • v.14 no.5
    • /
    • pp.616-624
    • /
    • 2009
  • This paper presents a 3D stereoscopic TIP (Tour Into Picture) for Korean classical paintings being composed of persons, boat, and landscape. Unlike conventional TIP methods providing 2D image or video, our proposed TIP can provide users with 3D stereoscopic contents. Navigating a picture with stereoscopic viewing can deliver more realistic and immersive perception. The method firstly makes input data being composed of foreground mask, background image, and depth map. The second step is to navigate the picture and to obtain rendered images by orthographic or perspective projection. Then, two depth enhancement schemes such as depth template and Laws depth are utilized in order to reduce a cardboard effect and thus to enhance 3D perceived depth of the foreground objects. In experiments, the proposed method was tested on 'Danopungjun' and 'Muyigido' that are famous paintings made in Chosun Dynasty. The stereoscopic animation was proved to deliver new 3D perception compared with 2D video.

Narrative Strategy of UHD TV Human Documentary:Focusing on (UHD TV휴먼다큐멘터리 서사전략: <순례-집으로 가는 길>을 중심으로)

  • Kwon, Sang-Jung;Chang, Woo-Jin
    • The Journal of the Korea Contents Association
    • /
    • v.19 no.11
    • /
    • pp.516-526
    • /
    • 2019
  • As with all narrative forms based on media, the narrative method of TV human documentary is closely related to the change of broadcasting environment. In 2017, the world's first terrestrial UHD broadcast was launched in Korea, and in September of that year, KBS broadcasted the UHD special documentary series. , made of UHD capable of ultra-high definition video and immersive audio, showed a narrative approach completely different from the existing TV human documentary. Instead of all-out narration, which was considered an essential element in the TV human documentary, it used the modest first-person narration of the characters, while actively using drones capable of various compositions to express the psychology of the characters in detail and enable viewers' immersion. In addition, the Montage editing technique, an editing method that has not been attempted in TV human documentaries, utilizes the narrative development method of 'showing' as a video without 'explaining' with narration. After , many similar narrative documentaries are broadcast, and the flow and direction of TV human documentaries are changing under UHD broadcasting environment.

Improved Extraction of Representative Motion Vector Using Background Information in Digital Cinema Environment (디지털 시네마 환경에서 배경정보를 이용한 대표 움직임 정보 추출)

  • Park, Il-Cheol;Kwon, Goo-Rak
    • Journal of Korea Multimedia Society
    • /
    • v.15 no.6
    • /
    • pp.731-736
    • /
    • 2012
  • Latest digital cinema is getting more interest on recent days. The combination of visually immersive 3D movie with chair movements and other physical effects has added more enjoyment. The movement of the chair is controlled manually in these digital cinemas. By the analysis of the digital cinema's video sequences, movement of the chair can be controlled automatically. In the proposed method first of all the motion of focused object and the background is identified and then the motion vector information is extracted by using the 9-search range. The motion vector is determined only for the movement of background while the object is stationary. The extracted Motion information from the digital cinemas is used for the movement control of the chair. The experimental results show that the proposed method outperforms the existing methods in terms of accuracy.

The Virtual Model House System using Modeling-based Eyetracking (모델링 기반 시선추적을 이용한 가상모델하우스 시스템)

  • Lee, Dong-Jin;Lee, Ki-Young
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.10 no.5
    • /
    • pp.223-227
    • /
    • 2010
  • Since the most of existing virtual model house used non-immersive type virtual reality technology, it was made to control using direct input type device such as keyboard and mouse. But in this paper realized not only direct data entry method but also indirect data entry method using eyetracking technology through universal webcam for virtual model house based upon modeling. In this paper showed the position of pointer controlled according to the relative movement of pupils or the part of function related to the equipment entry called by comparing the value of gray after extracting the area of pupil in the user' video data received from webcam. Such a method provided the convenience of navigation and interface to the user.

Reinforcement Learning based Inactive Region Padding Method (강화학습 기반 비활성 영역 패딩 기술)

  • Kim, Dongsin;Uddin, Kutub;Oh, Byung Tae
    • Journal of Broadcast Engineering
    • /
    • v.26 no.5
    • /
    • pp.599-607
    • /
    • 2021
  • Inactive region means a region filled with invalid pixel values to represent a specific image. Generally, inactive regions are occurred when the non-rectangular formatted images are converted to the rectangular shaped image, especially when 3D images are represented in 2D format. Because these inactive regions highly degrade the compression efficiency, filtering approaches are often applied to the boundaries between active and inactive regions. However, the image characteristics are not carefully considered during filtering. In the proposed method, inactive regions are padded through reinforcement learning that can consider the compression process and the image characteristics. Experimental results show that the proposed method performs an average of 3.4% better than the conventional padding method.