• Title/Summary/Keyword: 2D Video

Search Result 910, Processing Time 0.03 seconds

MPEG-DASH Services for 3D Contents Based on DMB AF (DMB AF 기반 3D 콘텐츠의 MPEG-DASH 서비스)

  • Kim, Yong Han;Park, Minkyu
    • Journal of Broadcast Engineering
    • /
    • v.18 no.1
    • /
    • pp.115-121
    • /
    • 2013
  • Recently an extension to DMB AF (Digital Multimedia Broadcasting Application Format) standard has been proposed in such a way that the extended DMB AF can include stereoscopic video and stereoscopic images for interactive service data, i.e., MPEG-4 BIFS (Binary Format for Scene) data, in addition to the existing 2D video and 2D images for BIFS services. In this paper we developed a service that provides the streaming of 3D contents in DMB AF by using MPEG-DASH (Dynamic Adaptive Streaming over HTTP) standard and validated it by implementing the client software.

Video Augmentation by Image-based Rendering

  • Seo, Yong-Duek;Kim, Seung-Jin;Sang, Hong-Ki
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 1998.06b
    • /
    • pp.147-153
    • /
    • 1998
  • This paper provides a method for video augmentation using image interpolation. In computer graphics or augmented reality, 3D information of a model object is necessary to generate 2D views of the model, which are then inserted into or overlayed on environmental views or real video frames. However, we do not require any three dimensional model but images of the model object at some locations to render views according to the motion of video camera which is calculated by an SFM algorithm using point matches under weak-perspective (scaled-orthographic) projection model. Thus, a linear view interpolation algorithm is applied rather than a 3D ray-tracing method to get a view of the model at different viewpoints from model views. In order to get novel views in a way that agrees with the camera motion the camera coordinate system is embedded into model coordinate system at initialization time on the basis of 3D information recovered from video images and model views, respectively. During the sequence, motion parameters from video frames are used to compute interpolation parameters, and rendered model views are overlayed on corresponding video frames. Experimental results for real video frames and model views are given. Finally, discussion on the limitations of the method and subjects for future research are provided.

  • PDF

Fast Stereoscopic 3D Broadcasting System using x264 and GPU (x264와 GPU를 이용한 고속 양안식 3차원 방송 시스템)

  • Choi, Jung-Ah;Shin, In-Yong;Ho, Yo-Sung
    • Journal of Broadcast Engineering
    • /
    • v.15 no.4
    • /
    • pp.540-546
    • /
    • 2010
  • Since the stereoscopic 3-dimensional (3D) video that provides users with a realistic multimedia service requires twice as much data as 2-dimensional (2D) video, it is difficult to construct the fast system. In this paper, we propose a fast stereoscopic 3D broadcasting system based on the depth information. Before the transmission, we encode the input 2D+depth video using x264, an open source H.264/AVC fast encoder to reduce the size of the data. At the receiver, we decode the transmitted bitstream in real time using a compute unified device architecture (CUDA) video decoder API on NVIDIA graphics processing unit (GPU). Then, we apply a fast view synthesis method that generates the virtual view using GPU. The proposed system can display the output video in both 2DTV and 3DTV. From the experiment, we verified that the proposed system can service the stereoscopic 3D contents in 24 frames per second at most.

Geometry Padding for Segmented Sphere Projection (SSP) in 360 Video (360 비디오의 SSP를 위한 기하학적 패딩)

  • Kim, Hyun-Ho;Myeong, Sang-Jin;Yoon, Yong-Uk;Kim, Jae-Gon
    • Journal of Broadcast Engineering
    • /
    • v.24 no.1
    • /
    • pp.25-31
    • /
    • 2019
  • 360 video is attracting attention as immersive media, and is also considered in VVC (Versatile Video Coding), which is being developed in JVET (Joint Video Expert Team) as a new video coding standard of post-HEVC. A 2D image projected from 360 video for its compression may has discontinuities between the projected faces and inactive regions, and they may cause the visual artifacts in the reconstructed video as well as decrease of coding efficiency. In this paper, we propose a method of efficient geometric padding to reduce these discontinuities and inactive regions in the projection format of SSP (Segmented Sphere Projection). Experimental results show that the proposed method improves subjective quality compared to the existing padding of SSP that uses copy padding with minor loss of coding gain.

2D Adjacency Matrix Generation using DCT for UWV Contents (DCT를 통한 UWV 콘텐츠의 2D 인접도 행렬 생성)

  • Xiaorui, Li;Kim, Kyuheon
    • Journal of Broadcast Engineering
    • /
    • v.22 no.3
    • /
    • pp.366-374
    • /
    • 2017
  • Since a display device such as TV or digital signage is getting larger, the types of media is getting changed into wider view one such as UHD, panoramic and jigsaw-like media. Especially, panoramic and jigsaw-like media is realized by stitching video clips, which are captured by different camera or devices. However, a stitching process takes long time, and has difficulties in applying for a real-time process. Thus, this paper suggests to find out 2D Adjacency Matrix, which tells spatial relationships among those video clips in order to decrease a stitching processing time. Using the Discrete Cosine Transform (DCT), we convert the each frame of video source from the spatial domain (2D) into frequency domain. Based on the aforementioned features, 2D Adjacency Matrix of images could be found that we can efficiently make the spatial map of the images by using DCT. This paper proposes a new method of generating 2D adjacency matrix by using DCT for producing a panoramic and jigsaw-like media through various individual video clips.

3D Conversion of 2D H.264 Video (2D H.264 동영상의 3D 입체 변환)

  • Hong, Ho-Ki;Baek, Yun-Ki;Lee, Seung-Hyun;Kim, Dong-Wook;Yoo, Ji-Sang
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.31 no.12C
    • /
    • pp.1208-1215
    • /
    • 2006
  • In this paper, we propose an algorithm that creates three-dimensional (3D) stereoscopic video from two-dimensional (2D) video encoded by H.264 instead of using the conventional stereo-camera process. Motion information of each frame can be obtained by the given motion vectors in most of videos encoded by MPEG standards. Especially, we have accurate motion vectors for H.264 streams because of the availability of a variety of block sizes. 2D/3D video conversion algorithm proposed in this paper can create the left and right images that correspond to the original image by using cut detection method, delay factors, motion types, and image types. We usually have consistent motion type na direction in a given cut because each frame in the same cut has high correlation. We show the improved performance of the proposed algorithm through experimental results.

Study on the Development of Linearity of Broad-Band SDLVA Using Clamping Op-Amp (Clamping Op-Amp를 이용한 광대역 로그 비디오 증폭기의 선형성 개선에 관한 연구)

  • Park, Jong-Sul;Kim, Jong-Geon;Kim, Jum-Sik
    • The Journal of Korean Institute of Electromagnetic Engineering and Science
    • /
    • v.22 no.6
    • /
    • pp.641-647
    • /
    • 2011
  • This paper describes a design and fabrication of SDLVA. The SDLVA operates 0.5~2.0 GHz with -70~0 dBm dynamic range. The SDLVA is consisted of 5-stage RF block, 2-stage detector block and summation circuit using clamping op-amp to improve video linearity. The result of measure, SDLVA of RF path has over 73 dB small-signal gain and 10.1~12.2 dBm saturation power. The video path has 25 mV/ dB${\pm}$1.0 mV and under ${\pm}$1.5 dB video linearity.

Design and Implementation of 2D Image-Based Implant Placement Guide System (2D 영상 기반의 임플란트 식립 가이드 시스템 설계 및 구현)

  • Minwoo Kang;Jiwoo Shin;Seongmin Lee;Soungjun Yoon;Jinman Jung
    • The Transactions of the Korea Information Processing Society
    • /
    • v.13 no.10
    • /
    • pp.568-573
    • /
    • 2024
  • Accurate placement of prosthetics represents a critical aspect of dental implant surgery. however, it heavily depends on the dentist's decision and visual obstructions caused by various factors can lead to errors during the procedure. This paper proposes a 2D image-based real-time implant placement guiding system that predicts the implant position using 2D surgical video without the need for preoperative oral scans or 3D model generation. In the initial phase of the surgical video, two segmentation models are employed to measure prior statistics of the occlusal and incisal surfaces for each tooth. Subsequently, a single segmentation model is used to separate the occlusal and incisal surfaces, and the implant placement is predicted and guided based on the axis and length of adjacent teeth as well as the center of the prosthesis to be implanted. The system was designed and implemented using a dental phantom model, which replicates the oral structure of an actual human. The algorithm's average execution time for guiding implant placement on 10 images was measured to be 12.14 ms, demonstrating its feasibility for real-time application in surgical video.

Evaluation of Coding Performance and Design of Spatial Multiplexer or 3D Endoscopic Image Processing (3D 내시경 영상처리를 위한 다중화기 설계와 부호화 성능평가)

  • Song, C.G.;Lee, S.M.;Lee, Y.M.;Kim, W.K.;Hwang, J.D.;Kim, J.H.;Lee, M.H.
    • Proceedings of the KOSOMBE Conference
    • /
    • v.1997 no.11
    • /
    • pp.137-141
    • /
    • 1997
  • In this study, in order to improve visualization and enhance the ability of the surgeon to perform delicate endoscopic surgery, three dimensional endoscopic system is designed. These 3D systems have our features of stereoendoscopic image processing: real time image capture and retrieve; presentation of left and right image on a single monitor; separable processing of the left and right eye images; coding of the 3D endoscopic video. For 3D endoscopic video coding, three approaches are presented based on interlaced picture structure, side-field format structure, and simulcast technique. Experimental results and performances comparisons are presented and analyzed or these approaches. Digital video coding techniques are presented or 3D endoscopic video sequences by means of an MPEG-2 video coding.

  • PDF

HEVC Encoder Optimization using Depth Information (깊이정보를 이용한 HEVC의 인코더 고속화 방법)

  • Lee, Yoon Jin;Bae, Dong In;Park, Gwang Hoon
    • Journal of Broadcast Engineering
    • /
    • v.19 no.5
    • /
    • pp.640-655
    • /
    • 2014
  • Many of today's video systems have additional depth camera to provide extra features such as 3D support. Thanks to these changes made in multimedia system, it is now much easier to obtain depth information of the video. Depth information can be used in various areas such as object classification, background area recognition, and so on. With depth information, we can achieve even higher coding efficiency compared to only using conventional method. Thus, in this paper, we propose the 2D video coding algorithm which uses depth information on top of the next generation 2D video codec HEVC. Background area can be recognized with depth information and by performing HEVC with it, coding complexity can be reduced. If current CU is background area, we propose the following three methods, 1) Earlier stop split structure of CU with PU SKIP mode, 2) Limiting split structure of CU with CU information in temporal position, 3) Limiting the range of motion searching. We implement our proposal using HEVC HM 12.0 reference software. With these methods results shows that encoding complexity is reduced more than 40% with only 0.5% BD-Bitrate loss. Especially, in case of video acquired through the Kinect developed by Microsoft Corp., encoding complexity is reduced by max 53% without a loss of quality. So, it is expected that these techniques can apply real-time online communication, mobile or handheld video service and so on.