• Title/Summary/Keyword: 2-D Coding

Search Result 564, Processing Time 0.027 seconds

Rate-Distortion Based Selective Encoding in Distributed Video Coding (율-왜곡 기반 선택적 분산 비디오 부호화 기법)

  • Lee, Byung-Tak;Kim, Jae-Gon;Kim, Jin-Soo;Seo, Kwang-Deok
    • Journal of Broadcast Engineering
    • /
    • v.16 no.1
    • /
    • pp.123-132
    • /
    • 2011
  • Recently, DVC (Distributed Video Coding) is receiving a lot of attention as one of the low complexity video encoding techniques suitable for various applications with computation-limited and/or power-limited environment, and is being actively studied for improving the coding efficiency. This paper proposes a rate-distortion based selective block encoding scheme. First, the motion information is obtained in the process of generating side information at decoder and received through the feedback channel, and then, based on this information, the proposed method performs a selective block encoding based on rate-distortion optimization. Experimental results show that the performance of the proposed scheme reaches up to 2.2 dB PSNR gain over the existing scheme. Moreover, it is shown that the complexity can be reduced by encoding parts of region considering rate-distortion cost.

Improvement of Inter prediction by using Homography Reference Picture (Homography 참조 픽처를 사용한 화면 간 예측 효율 향상 방법)

  • Kim, Tae Hyun;Park, Gwang Hoon
    • Journal of Broadcast Engineering
    • /
    • v.22 no.3
    • /
    • pp.397-400
    • /
    • 2017
  • Recently, a lot of images containing various global movements have been generated by the activation of the photographic equipment such as the drone and the action cam. In this case, when the motion such as rotation, scaling is generated, it is difficult to expect a high coding efficiency in the conventional inter-picture prediction method using the 2D motion vector. In this paper, we propose a video coding method that reflects global motion through homography reference pictures. As a proposed method, there are 1) a method of generating a new reference picture by grasping a global motion relation between a current picture and a reference picture by homography, and 2) a method of utilizing a homography reference picture for inter-picture prediction. The experiment was applied to the HEVC reference software HM 14.0, and the experimental result showed an increase in encoding efficiency of 6.6% based on RA. Especially, the results using the videos with rotational motion have a maximum coding efficiency of 32.6%, which is expected to show high efficiency in video, which is often represented by complex global motion such as drones.

LCU-Level Rate Control for HEVC Considering Hierarchical Coding Structure (HEVC의 계층적 부호화 구조를 고려한 LCU 단위의 비트율 제어 기법)

  • Park, Dong-Il;Kim, Jae-Gon;Lim, Sung-Chang;Kim, Jong-Ho;Kim, Hui-Yong
    • Journal of Broadcast Engineering
    • /
    • v.16 no.5
    • /
    • pp.762-772
    • /
    • 2011
  • In this paper, a method of rate control for constant bitrate (CBR) coding of High Efficiency Video Coding (HEVC) is addressed. The existing rate control of H.264/AVC may not provide exact rate control in the case of hierarchical coding structure since it doesn't consider the characteristics of the hierarchical coding structure. It is expected that a rate control is added to the reference software called HM for CBR encoding in the near future. More accurate rate control may be required in a hierarchical structure of random access (RA) mode defined in the common test condition of HM. In this paper, we propose a method of rate control based on quadratic Rate-Distortion (R-D) model considering temporal layers and frame types in hierarchical coding structure for efficient rate control. In the consideration of the trade-off relationship between the bit fluctuation and the average PSNR, both of frame and coding unit (CU) are set as the basic unit of rate control. The performance of the proposed rate control method is verified by simulations along with the trade-off relationships for the both cases of basic unit.

3D Face Modeling based on FACS (Facial Action Coding System) (FACS 기반을 둔 3D 얼굴 모델링)

  • Oh, Du-Sik;Kim, Yu-Sung;Kim, Jae-Min;Cho, Seoung-Won;Chung, Sun-Tae
    • Proceedings of the IEEK Conference
    • /
    • 2008.06a
    • /
    • pp.1015-1016
    • /
    • 2008
  • In this paper, the method which searchs a character of face and transforms it by FACS(Facial Action Coding System) for face modeling is suggested. FACS has a function to build an expression of face to AUs(Action Units) and make various face expressions. The system performs to find accurate Action Units of sample face and use setted AUs. Consequently it carries out the coefficient for transforming face model by 2D AUs matching.

  • PDF

Fast PU Decision Method Using Coding Information of Co-Located Sub-CU in Upper Depth for HEVC (상위깊이의 Sub-CU 부호화 정보를 이용한 HEVC의 고속 PU 결정 기법)

  • Jang, Jae-Kyu;Choi, Ho-Youl;Kim, Jae-Gon
    • Journal of Broadcast Engineering
    • /
    • v.20 no.2
    • /
    • pp.340-347
    • /
    • 2015
  • HEVC (High Efficiency Video Coding) achieves high coding efficiency by employing a quadtree-based coding unit (CU) block partitioning structure and various prediction units (PUs), and the determination of the best CU partition structure and the best PU mode based on rate-distortion (R-D) cost. However, the computation complexity of encoding also dramatically increases. In this paper, to reduce such encoding computational complexity, we propose three fast PU mode decision methods based on encoding information of upper depth as follows. In the first method, the search of PU mode of the current CU is early terminated based on the sub-CBF (Coded Block Flag) of upper depth. In the second method, the search of intra prediction modes of PU in the current CU is skipped based on the sub-Intra R-D cost of upper depth. In the last method, the search of intra prediction modes of PU in the lower depth's CUs is skipped based on the sub-CBF of the current depth's CU. Experimental results show that the three proposed methods reduce the computational complexity of HM 14.0 to 31.4%, 2.5%, and 23.4% with BD-rate increase of 1.2%, 0.11%, and 0.9%, respectively. The three methods can be applied in a combined way to be applied to both of inter prediction and intra prediction, which results in the complexity reduction of 34.2% with 1.9% BD-rate increase.

Transform domain Wyner-Ziv Coding based on the frequency-adaptive channel noise modeling (주파수 적응 채널 잡음 모델링에 기반한 변환영역 Wyner-Ziv 부호화 방법)

  • Kim, Byung-Hee;Ko, Bong-Hyuck;Jeon, Byeung-Woo
    • Journal of Broadcast Engineering
    • /
    • v.14 no.2
    • /
    • pp.144-153
    • /
    • 2009
  • Recently, as the necessity of a light-weighted video encoding technique has been rising for applications such as UCC(User Created Contents) or Multiview Video, Distributed Video Coding(DVC) where a decoder, not an encoder, performs the motion estimation/compensation taking most of computational complexity has been vigorously investigated. Wyner-Ziv coding reconstructs an image by eliminating the noise on side information which is decoder-side prediction of original image using channel code. Generally the side information of Wyner-Ziv coding is generated by using frame interpolation between key frames. The channel code such as Turbo code or LDPC code which shows a performance close to the Shannon's limit is employed. The noise model of Wyner-Ziv coding for channel decoding is called Virtual Channel Noise and is generally modeled by Laplacian or Gaussian distribution. In this paper, we propose a Wyner-Ziv coding method based on the frequency-adaptive channel noise modeling in transform domain. The experimental results with various sequences prove that the proposed method makes the channel noise model more accurate compared to the conventional scheme, resulting in improvement of the rate-distortion performance by up to 0.52dB.

Distributed Multi-view Video Coding Based on Illumination Compensation (조명보상 기반 분산 다시점 비디오 코딩)

  • Park, Sea-Nae;Sim, Dong-Gyu;Jeon, Byeung-Woo
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.45 no.6
    • /
    • pp.17-26
    • /
    • 2008
  • In this paper, we propose a distributed multi-view video coding method employing illumination compensation for multi-view video coding. Distributed multi-view video coding (DMVC) methods can be classified either into a temporal or an inter-view interpolation-based ones according to ways to generate side information. DMVC with inter-view interpolation utilizes characteristics of multi-view videos to improve coding efficiency of the DMVC by using side information based on the inter-view interpolation. However, mismatch of camera parameters and illumination change between two views could bring about inaccurate side information generation. In this paper, a modified distributed multi-view coding method is presented by applying illumination compensation in generating the side information. In the proposed encoder system, in addition to parity bits for AC coefficients, DC coefficients are transmitted as well to the decoder side. By doing so, the decoder can generate more accurate side information by compensating illumination changes with the transmitted DC coefficients. We found that the proposed algorithm is $0.1{\sim}0.2\;dB$ better than the conventional algorithm that does not make use of illumination compensation.

A study on decision on scalable coding method for IPTV service over heterogeneous network (혼재망에서 IPTV 서비스를 위한 계층부호화 방식 결정 방법에 대한 연구)

  • Kim, Dae-Yeon;Suh, Doug-Young;Kim, Young-Soo;Kim, Jin-Sang
    • Journal of Broadcast Engineering
    • /
    • v.12 no.2
    • /
    • pp.93-101
    • /
    • 2007
  • In heterogeneous networks SVC (Scalabile Video Coding) will be used for IPTV service. This paper analyses how to determine the optimal inter-layer reference scheme according to final level to be displayed in hybrid scalable coding which consists of spatial, quality and temporal layer. It determines where to stop layering quality layer stacks in lower spatial layer according to the relationship between noise induced by loss of high frequency component eliminated by filter in order to get rid of aliasing when spatial layering is processed and noise induced by quantization when quality layering is processed. This paper shows the choice of the level of layering between spatial and quality to get better coding efficiency and then presents what is needed for determining it.

Intra residual DPCM for H.264 lossless coding (H.264 무손실 부호화를 위한 Intra residual DPCM)

  • Han Ki-Hun;Lee Yung-Lyul
    • Journal of Broadcast Engineering
    • /
    • v.11 no.2 s.31
    • /
    • pp.174-180
    • /
    • 2006
  • H.264/MPEG-4 AVC is jointly developed by ITU-T and ISO/IEC. It provides efficient coding efficiency compared with previous video standards. It reduced the bit rate by approximately $30%{\sim}70%$ while providing the same or better image quality. And, H.264/MPEG-4 AVC supports not only lossy coding but also lossless coding. In this paper, we suggest a method to improve lossless coding efficiency. Proposed method is based on Intra residual DPCM, it has same effect with the prediction from spatially nearest pixel. Also, proposed method does not broken decoder pipe-line. Experimental results, the method reduced the bit rate by approximately 12% in comparison with the H.264 Intra lossless coding. As a result, it is adopted into the H.264/MPEG-4 AVC Advanced 4:4:4 profile.

Inactive Regions Padding Methods for Rotated Sphere Projection of 360 Video

  • Yoon, Yong-Uk;Kim, Hyun-Ho;Kim, Jae-Gon
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2018.06a
    • /
    • pp.200-201
    • /
    • 2018
  • In the workflow of 360 video coding of JVET (Joint Video Experts Team), firstly the 360 videos are projected onto the 2D plane with diverse projection formats, such as Equi-Rectangular Projection (ERP), Cubemap Projection (CMP), Rotated Sphere Projection (RSP), etc. The projection format of RSP has inactive regions in the converted 2D plane. The inactive regions may cause visual artifact as well as the reduction of the coding efficiency due to discontinuity at boundaries between active and inactive regions. In this paper, to overcome these problems, the inactive regions are padded by using two types of adjacent pixels. Then padded regions of RSP are blended with inactive regions padded by proposed method. The experimental results demonstrate that, in terms of end-to-end WS-PSNR-NN, the proposed method achieves 0.1% BD-rate reduction. In addition, the visual artifacts along the borders between discontinuous faces are noticeably reduced.

  • PDF