• Title/Summary/Keyword: 적응영상복원

Search Result 186, Processing Time 0.021 seconds

Group-based Adaptive Rendering for 6DoF Immersive Video Streaming (6DoF 몰입형 비디오 스트리밍을 위한 그룹 분할 기반 적응적 렌더링 기법)

  • Lee, Soonbin;Jeong, Jong-Beom;Ryu, Eun-Seok
    • Journal of Broadcast Engineering
    • /
    • v.27 no.2
    • /
    • pp.216-227
    • /
    • 2022
  • The MPEG-I (Immersive) group is working on a standardization project for immersive video that provides 6 degrees of freedom (6DoF). The MPEG Immersion Video (MIV) standard technology is intended to provide limited 6DoF based on depth map-based image rendering (DIBR) technique. Many efficient coding methods have been suggested for MIV, but efficient transmission strategies have received little attention in MPEG-I. This paper proposes group-based adaptive rendering method for immersive video streaming. Each group can be transmitted independently using group-based encoding, enabling adaptive transmission depending on the user's viewport. In the rendering process, the proposed method derives weights of group for view synthesis and allocate high quality bitstream according to a given viewport. The proposed method is implemented through the Test Model for Immersive Video (TMIV) test model. The proposed method demonstrates 17.0% Bjontegaard-delta rate (BD-rate) savings on the peak signalto-noise ratio (PSNR) and 14.6% on the Immersive Video PSNR(IV-PSNR) in terms of various end-to-end evaluation metrics in the experiment.

Implementing 3DoF+ 360 Video Compression System for Immersive Media (실감형 미디어를 위한 3DoF+ 360 비디오 압축 시스템 구현)

  • Jeong, Jong-Beom;Lee, Soonbin;Jang, Dongmin;Lee, Sangsoon;Ryu, Eun-Seok
    • Journal of Broadcast Engineering
    • /
    • v.24 no.5
    • /
    • pp.743-754
    • /
    • 2019
  • System for three degrees of freedom plus (3DoF+) and 6DoF requires multi-view high resolution 360 video transmission to provide user viewport adaptive 360 video streaming. In this paper, we implement 3DoF+ 360 video compression system which removes the redundancy between multi-view videos and merges the residual into one video to provide high quality 360 video corresponding to an user's head movement efficiently. Implementations about 3D warping based redundancy removal method between 3DoF+ 360 videos and residual extraction and merger are explained in this paper. With the proposed system, 20.14% of BD-rate reduction in maximum is shown compared to traditional high-efficiency video coding (HEVC) based system.

Revision after Instability Surgery (수술 후 재발한 견관절 불안정증의 치료)

  • Kim, Paul Shinil;Jo, Chris Hyunchul
    • Journal of the Korean Orthopaedic Association
    • /
    • v.55 no.5
    • /
    • pp.374-382
    • /
    • 2020
  • Recurrence is the most common complication after shoulder instability surgery, and the main causes of the postoperative recurrence of instability are trauma, misdiagnosis, and technical errors. The risk factors of recurrence may be classified as patient related, anatomical or technical. Causes of failure should be thoroughly evaluated by meticulous history taking, physical examination, and imaging studies, and followed by proper treatment of pathologic lesions. Nonoperative treatment should be considered initially in cases of recurred instability after shoulder instability surgery, but if this fails, repeated recurrence is prevented by performing appropriate anatomical reconstruction of ruptured Bankart lesions, capsular laxities, glenoid deficiencies and humeral head bone defects.

A Study on the Improvement of Wavefront Sensing Accuracy for Shack-Hartmann Sensors (Shack-Hartmann 센서를 이용한 파면측정의 정확도 향상에 관한 연구)

  • Roh, Kyung-Wan;Uhm, Tae-Kyoung;Kim, Ji-Yeon;Park, Sang-Hoon;Youn, Sung-Kie;Lee, Jun-Ho
    • Korean Journal of Optics and Photonics
    • /
    • v.17 no.5
    • /
    • pp.383-390
    • /
    • 2006
  • The SharkHartmann wavefront sensors are the most popular devices to measure wavefront in the field of adaptive optics. The Shack-Hartmann sensors measure the centroids of spot irradiance distribution formed by each corresponding micro-lens. The centroids are linearly proportional to the local mean slopes of the wavefront defined within the corresponding sub-aperture. The wavefront is then reconstructed from the evaluated local mean slopes. The uncertainty of the Shack-Hartmann sensor is caused by various factors including the detector noise, the limited size of the detector, the magnitude and profile of spot irradiance distribution, etc. This paper investigates the noise propagation in two major centroid evaluation algorithms through computer simulation; 1st order moments of the irradiance algorithms i.e. center of gravity algorithm, and correlation algorithm. First, the center of gravity algorithm is shown to have relatively large dependence on the magnitudes of noises and the shape & size of irradiance sidelobes, whose effects are also shown to be minimized by optimal thresholding. Second, the correlation algorithm is shown to be robust over those effects, while its measurement accuracy is vulnerable to the size variation of the reference spot. The investigation is finally confirmed by experimental measurements of defocus wavefront aberrations using a Shack-Hartmann sensor using those two algorithms.

A study on non-local image denoising method based on noise estimation (노이즈 수준 추정에 기반한 비지역적 영상 디노이징 방법 연구)

  • Lim, Jae Sung
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.18 no.5
    • /
    • pp.518-523
    • /
    • 2017
  • This paper proposes a novel denoising method based on non-local(NL) means. The NL-means algorithm is effective for removing an additive Gaussian noise, but the denoising parameter should be controlled depending on the noise level for proper noise elimination. Therefore, the proposed method optimizes the denoising parameter according to the noise levels. The proposed method consists of two processes: off-line and on-line. In the off-line process, the relations between the noise level and the denoising parameter of the NL-means filter are analyzed. For a given noise level, the various denoising parameters are applied to the NL-means algorithm, and then the qualities of resulting images are quantified using a structural similarity index(SSIM). The parameter with the highest SSIM is chosen as the optimal denoising parameter for the given noise level. In the on-line process, we estimate the noise level for a given noisy image and select the optimal denoising parameter according to the estimated noise level. Finally, NL-means filtering is performed using the selected denoising parameter. As shown in the experimental results, the proposed method accurately estimated the noise level and effectively eliminated noise for various noise levels. The accuracy of noise estimation is 90.0% and the highest Peak Signal-to-noise ratio(PSNR), SSIM value.

Hardware Design of In-loop Filter for High Performance HEVC Encoder (고성능 HEVC 부호기를 위한 루프 내 필터 하드웨어 설계)

  • Park, Seungyong;Im, Junseong;Ryoo, Kwangki
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.20 no.2
    • /
    • pp.335-342
    • /
    • 2016
  • This paper proposes efficient hardware structure of in-loop filter for a high-performance HEVC (High Efficiency Video Coding) encoder. HEVC uses in-loop filter consisting of deblocking filter and SAO (Sample Adaptive Offset) to improve the picture quality in a reconstructed image due to a quantization error. However, in-loop filter causes an increase in complexity due to the additional encoder and decoder operations. A proposed in-loop filter is implemented as a three-stage pipeline to perform the deblocking filtering and SAO operation with a reduced number of cycles. The proposed deblocking filter is also implemented as a six-stage pipeline to improve efficiency and performs a new filtering order for efficient memory architecture. The proposed SAO processes six pixels parallelly at a time to reduce execution cycles. The proposed in-loop filter encoder architecture is designed by Verilog HDL, and implemented by 131K logic gates in TSMC $0.13{\mu}m$ process. At 164MHz, the proposed in-loop filter encoder can support 4K Ultra HD video encoding at 60fps in real time.