Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Spatio-Temporal Video De-interlacing Algorithm Based on MAP Estimation

MAP 예측기 기반의 시공간 동영상 순차주사화 알고리즘

  • Received : 2011.06.09
  • Accepted : 2012.01.19
  • Published : 2012.03.25
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents a novel de-interlacing algorithm that can make up motion compensation errors by using maximum a posteriori (MAP) estimator. First, a proper registration is performed between a current field and its adjacent fields, and the progressive frame corresponding to the current field is found via MAP estimator based on the computed registration information. Here, in order to obtain a stable solution, well-known bilateral total variation (BTV)-based regularization is employed. Next, so-called feathering artifacts are detected on a block basis effectively. So, edge-directional interpolation is applied to the pixels where feathering artifact may happen, instead of the above-mentioned temporal de-interlacing. Experimental results show that the PSNR of the proposed algorithm is on average 4dB higher than that of previous studies and provides the better subjective quality than the previous works.

본 논문은 MAP (maximum a posterior) 예측기에 기반하여 움직임 보상 예측 오차를 보정해주는 방식의 순차주사화 (de-interlacing) 알고리즘을 제안한다. 먼저, 현재 필드와 인접한 필드 간의 적절한 정합 (registration)을 수행 한 후, 계산된 정합 정보에 기반한 MAP 예측기를 통해 현재 필드에 대응하는 순차 주사 (progressive) 프레임을 찾아낸다. 안정적인 결과를 얻기 위하여 잘 알려진 BTV (bilateral total variation) 기반의 평활화 (regularization) 과정이 추가된다. 한편, 잘못된 정합 정보로 인한 소위 깃털 현상 (feathering artifact)을 억제하기 위하여 블록 단위로 깃털 현상 발생 여부를 판단하여 발생되었다고 판단된 블록 영역에 대해서는 앞서 설명한 MAP기반 순차주사화 대신 에지 방향성에 기반한 공간적 순차주사화를 적용한다. 실험 결과에 따르면, 제안된 기법은 종래 기법들에 비하여 평균 약 4dB의 PSNR 성능 개선을 보이고 있으며, 우수한 주관적 화질을 보여주고 있다.

Keywords

References

  1. M. Park, M. Kang, K. Nam, and S. Oh, "New Edge Dependent De-interlacing Algorithm Based on Horizontal Edge Pattern," IEEE Trans. Consum., Electron., vol. 49, no. 4, pp. 1508-1512. Nov. 2003. https://doi.org/10.1109/TCE.2003.1261260
  2. M. Park, M. Byun, J. Park, and M. Kang, "Edge-dependent Interpolation Based De-interlac ing Using Edge Patterns," SPIE Electron. Imaging., vol. 15, no. 4, pp. 043003-1-043003-8, Oct. 2006.
  3. D. Lee, "A New Edge-based Intra-field Interpolation Method for Deinterlacing Using Locally Adaptive-thresholded Binary Image," IEEE Trans. Consum., Electron., vol. 54, no. 1, pp.110-115, Feb 2008. https://doi.org/10.1109/TCE.2008.4470032
  4. H. Lee, J. Park, S. Choi, T. Bae, and Y. Ha, "Adaptive Scan Rate Up-conversion System Based on Human Visual Characteristics," IEEE Trans. Consum., Electron., vol. 46, no. 4, pp. 999-1006, Nov. 2000. https://doi.org/10.1109/30.920453
  5. C. Kuo, C. Liao, and C. Lin, "Adaptive Interpolation Technique for Scanning Rate Conversion," IEEE Trans. Circuits Syst. Video Technol., vol. 6, no. 3, pp. 317-321, Jun. 1996. https://doi.org/10.1109/76.499841
  6. Y. Kim, "De-interlacing Algorithm Based on Sparse Wide Vector Correlations," in Proc. SPIE Optical Eng., vol. 2727. pp. 89-99, 1996
  7. Y. Chang, S. Lin, C. Y. Chen, and L. Chen, "Video De-Interlacing by Adaptive 4-Field Global/Local Motion Compensated Approach," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 12, pp. 1569-1582, Dec. 2005. https://doi.org/10.1109/TCSVT.2005.858746
  8. Y. Chen and S. Tai, "True Motion-Compensated De-Interlacing Algorithm," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no, 10, pp. 1489-1498, Oct. 2009. https://doi.org/10.1109/TCSVT.2009.2022782
  9. J. Chang, Y. Kim, G. Shin, and M. Kang, "Adaptive Arbitration of Intra-Field and Motion Compensation Methods for De-interlacing," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 8, pp. 1214-1220, Aug. 2009. https://doi.org/10.1109/TCSVT.2009.2020341
  10. K. Lee, J. Lee, C. Lee, "Deinterlacing with Motion Adaptive Vertical Temporal Filtering," IEEE Trans. Consum. Electron., vol. 55, no. 2, pp. 636-643, May. 2009. https://doi.org/10.1109/TCE.2009.5174433
  11. S. Lin, Y. Chang, and L. Chen, "Motion Adaptive Interpolation with Horizontal Motion Detection for Deinterlacing", IEEE Trans. Consum. Electron., vol. 49, no. 4, pp. 1256-1264, Nov. 2003. https://doi.org/10.1109/TCE.2003.1261227
  12. Q. Huang, D. Zhao, S. Ma, and W. Gao, "Deinterlacing Using Hierarchical Motion Analysis," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 5, pp. 673-686, May 2010. https://doi.org/10.1109/TCSVT.2010.2045807
  13. Y. Fan, and C. Chung, "De-interlacing Algorithm Using Spatial-Temporal Correlation-Assisted Motion Estimation," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 7, pp. 932-944, Jul. 2009. https://doi.org/10.1109/TCSVT.2009.2020327
  14. 김영덕, 장준영, 강문기, "관심영역 단위의 적분 프로젝션기반 움직임 추정을 사용한 순차주사화 알고리즘," 전자공학회 논문지, 제45권, SP편, 제3호, 20-29쪽, 2008년 5월.
  15. 장준영, 김영덕, 강문기, "움직임 보상의 신뢰도에 기반 한 순차주사화 알고리즘," 전자공학회 논문지, 제 46권, SP편, 제6호, 102-111쪽, 2009년 11월.
  16. S. Farsiu, M. Robinson, M. Elad, and P. Milanfar, "Fast and Robust Multiframe Super Resolution," IEEE Trans. Image Processing, vol. 13, no. 10, pp. 1327-1344, Oct. 2004. https://doi.org/10.1109/TIP.2004.834669
  17. S. Park, M. Park, and M. Kang, "Super-Resolution Image Reconstruction: A Technical Overview," IEEE Signal Processing Magazine, pp. 21-36, May. 2003.
  18. S. Lin, Y. Chang, and L. Chen, "Motion Adaptive Interpolation with Morphological Operation and 3:2 Pull-downed Recovery for de-interlacing," IEEE Int. Conf. Multimedia Expo, Lausanne, Switzerland, Aug. 2002, CD-ROM.