Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Motion Vector Recovery Based on Optical Flow for Error Concealment

전송 오류를 은닉하기 위한 옵티컬 플로우 기반의 움직임 벡터 복원

  • Suh, Jae-Won (Dept. of Information and Communications, Kwangju Institute of Science and Technology) ;
  • Ho, Yo-Sung (Dept. of Information and Communications, Kwangju Institute of Science and Technology)
  • 서재원 (光州科學技術院 情報通信工學科) ;
  • 호요성 (光州科學技術院 情報通信工學科)
  • Published : 2002.11.01
Download PDF
⟨ Previous Next ⟩

Abstract

The compressed video bitstream is very sensitive to transmission errors. If we lost packet or received with errors during the transmission, not only the current frame will be corrupted, but also errors will propagate to succeeding frames. Error concealment is a data recovery technique that enables the decoder to conceal effects of transmission errors by predicting the lost or corrupted video data from the previously reconstructed error free information. Motion vection recovery and motion compensation with the estimated motion vector is a good approach to conceal the corrupted macroblock data. In this paper, we prove that it is reasonable to use the estimated motion vector to conceal the lost macroblock by providing macroblock distortion models. After we propose a new motion vector recovery algorithm based on optical flow fields, we compare its performance to those of conventional error concealment methods. The proposed algorithm has smaller computational complexity than those of conventional algorithms.

동영상 압축 비트열은 전송 오류에 매우 민감하다. 만일 전송열 패킷이 손실되거나 손상되어 수신되면, 현재 복호하는 화면 뿐만 아니라, 연속적으로 복호될 화면들에도 화질 저하를 초래한다. 오류은닉 기술은 오류가 없이 수신된 영상 정보를 이용하여 손상된 부분을 은폐하여 화질 저하를 최소화시키는 기법이다. 한가지 방법은 손상된 매크로블록의 움직임 벡터를 추정하고 추정된 움직임 벡터를 이용하여 움직임 보상함으로써 손상된 부분을 은닉시키는 방법이 있다. 본 논문에서는 매크로블록의 왜곡 모델을 제시하여 손상된 매크로블록의 추정된 움직임 벡터로 움직임 보상하여 은폐하는 방법이 타당함을 증명한다. 오류은닉의 성능을 향상시키기위해 옵티컬 플로우 기반의 움직임 벡터 추정 방법을 제안하고 다른 움직임 벡터 복원에 의한 오류은닉 방법들과 성능을 비교한다. 또한 제안된 방법은 기존의 방법들보다 계산량이 적은 장점이있다.

Keywords

References

  1. ISO/IEC IS 13818-2 (MPEG-2 Video): Information Technology-Generic Coding of Moving Pictures and Associated Audio Information, April 1996
  2. Y. Wang, S. Wenger, J. Wen, and A.K. Katsaggelos, 'Error Resilient Video Coding Techniques,' IEEE Signal Processing Magazine, Vol. 17, No. 4, pp. 61-82, July 2000 https://doi.org/10.1109/79.855913
  3. M. Ghanbari and V. Seferidis, 'Cell-loss Concealment in ATM Video Codecs, ' IEEE Transactions on Circuits and Systems for Video Technology, Vol. 3, No. 3, pp. 238-247, June 1993 https://doi.org/10.1109/76.224234
  4. S. Aign and K. Fazel, 'Temporal and Spatial Error Concealment Techniques for Hierarchical MPEG-2 Video Codec,' Proc. ICC, Vol. 3, pp. 1778-1783, June 1995
  5. J.W. Suh and Y.S. Ho, 'Error Concealment Based on Directional Interpolation,' IEEE Transactions on Consumer Electronics, Vol. 43, No. 3, pp. 295-302, Aug. 1997 https://doi.org/10.1109/30.628616
  6. Q. Zhu, Y. Wang and L. Shaw, 'Coding and Cell-Loss Recovery in DCT-Based Packet Video,' IEEE Transactions on Circuits and Systems for Video Technology, Vol. 3, No. 3, pp. 248-258, June 1993 https://doi.org/10.1109/76.224235
  7. H. Sun, K. Challapali and J. Zdepski, 'Error Concealment in Digital Simulcast AD-HDTV Decoder,' IEEE Transactions on Consumer Electronics, Vol. 38, No. 3, pp. 108-116, Aug. 1992 https://doi.org/10.1109/30.156671
  8. W.M. Lam, A.R. Reilbman, and B. Liu, 'Recovery of Lost or Erroneously Received Motion Vectors,' Proc. ICASSP, pp. V417-V420, Apr. 1993 https://doi.org/10.1109/ICASSP.1993.319836
  9. J. Zhang, J.F. Arnold, and M.R. Frater, 'A Cell-Loss Concealment Technique for MPEG-2 Coded Video,' IEEE Transactions on Circuits and Systems for Video Technology, Vol. 10, No. 4, pp. 659-665, June 2000 https://doi.org/10.1109/76.845011
  10. J.W. Suh and Y.S. Ho, 'Motion Vector Recovery Using Optical Flow,' Proc. ICCE. pp. 234-235, 2000 https://doi.org/10.1109/ICCE.2000.854600
  11. B. Horn, Robot Vision, The MIT Press, 1986
  12. B. K. P. Horn, B. B. Schunck, 'Determining optical flow,' Artificial Intelligence, Vol. 17, pp. 185-203, 1981 https://doi.org/10.1016/0004-3702(81)90024-2