KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Joint Overlapped Block Motion Compensation Using Eight-Neighbor Block Motion Vectors for Frame Rate Up-Conversion

  • Li, Ran (Jisangsu Key Lab on Image Processing & Image Communication, Nanjing University of Posts and Telecommunications) ;
  • Wu, Minghu (Jisangsu Key Lab on Image Processing & Image Communication, Nanjing University of Posts and Telecommunications) ;
  • Gan, Zongliang (Jisangsu Key Lab on Image Processing & Image Communication, Nanjing University of Posts and Telecommunications) ;
  • Cui, Ziguan (Jisangsu Key Lab on Image Processing & Image Communication, Nanjing University of Posts and Telecommunications) ;
  • Zhu, Xiuchang (Jisangsu Key Lab on Image Processing & Image Communication, Nanjing University of Posts and Telecommunications)
  • Received : 2013.04.17
  • Accepted : 2013.09.22
  • Published : 2013.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

The traditional block-based motion compensation methods in frame rate up-conversion (FRUC) only use a single uniquely motion vector field. However, there will always be some mistakes in the motion vector field whether the advanced motion estimation (ME) and motion vector analysis (MA) algorithms are performed or not. Once the motion vector field has many mistakes, the quality of the interpolated frame is severely affected. In order to solve the problem, this paper proposes a novel joint overlapped block motion compensation method (8J-OBMC) which adopts motion vectors of the interpolated block and its 8-neighbor blocks to jointly interpolate the target block. Since the smoothness of motion filed makes the motion vectors of 8-neighbor blocks around the interpolated block quite close to the true motion vector of the interpolated block, the proposed compensation algorithm has the better fault-tolerant capability than traditional ones. Besides, the annoying blocking artifacts can also be effectively suppressed by using overlapped blocks. Experimental results show that the proposed method is not only robust to motion vectors estimated wrongly, but also can to reduce blocking artifacts in comparison with existing popular compensation methods.

Keywords

References

  1. K. Hilman, Y. W. Park and Y. Kim. "Using motion compensated frame rate conversion for the correction of 3:2 pulldown artifacts in video sequence," IEEE Transaction on Circuits and Systems for Video Technology, vol.10, no.6, pp.869-877, 2000. https://doi.org/10.1109/76.867925
  2. Z. L. Gan and X. C. Zhu. "Study of frame-rate up conversion based on H.264," The Journal of China Universities of Posts and Telecommunications, vol.14, no.1, pp.106-110, 2007.
  3. J. Hwang, Y. Choi and Y. Choe. "Frame rate up-conversion technique using hardware-efficient motion estimator architecture for motion blur reduction for TFT-LCD," IEICE Transaction on Electronics, vol.E94-C, no.5, pp.896-904, 2001.
  4. B. Girod, A. Aaron and S. Rane, et al.. "Distributed video coding," Processing of the IEEE , vol.93, no.1, pp. 71-83, 2005.
  5. Y. K. Chen and S. Y. Kung. "Rate optimization by true motion estimation." in Proc. of IEEE Workshop Myltimedia Signal Process, pp.187-194, 23-25 June, 1997.
  6. C. C. Cheng, W. L. Hwang and Z. Shen, et al.. "Advanced motion compensation techniques ofr blocking artifacts reduction in 3-D vides coding systems," in Proc. of IEEE International Conference on Image Processing, pp.89-92, 11-14 September, 2005.
  7. B. T. Choi, S. H. Lee and S. J. Ko. "New frame rate up-conversion using bi-directional motion estimation," IEEE Transaction on Consumer and Electron, vol. 46, no. 3, pp. 603-609, 2000. https://doi.org/10.1109/30.883418
  8. S. J. Kang, S. J. Yoo and Y. H. Kim. "Dual motion estimation for frame rate up-conversion," IEEE Transaction on Circuits System and Video Technology, vol.20, no.12, pp.1909-1914, 2010. https://doi.org/10.1109/TCSVT.2010.2087832
  9. D. M. Wang, Zhang L and A. Vincent. "Motion-compensated frame rate up-conversion, part I: Fast multi-frame motion estimation," IEEE Transaction on Broadcast, vol.56, no.2, pp.133-141, 2010. https://doi.org/10.1109/TBC.2010.2043896
  10. G. D. Haan, P. W. A. C. Biezen and H. Huijgen, et al.. "True motion estimation with 3-D recursive search block matching," IEEE Transaction on Circuits System and Video Technology, vol.3, no.5, pp. 368-379, 1993. https://doi.org/10.1109/76.246088
  11. L. Alparone, M. Barni and F. Bartolini, et al.. "Adaptively weighted vector-median filters for motion fields smoothing," in Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 2267-2270, May, 1996.
  12. G. Dane and T. Nguyen. "Motion vector processing for frame rate up conversion," in Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing, pp.309-312, 17-21 May, 2004.
  13. M. T. Orchard and C. J. Sullivan. "Overlapped block motion compensation: an estimation-theoretic approach," IEEE Transaction on Image Processing, vol. 3, no.9, pp. 693-699, 1994. https://doi.org/10.1109/83.334974
  14. Su K J and Mersereau R M. "Motion estimation methods for overlapped block motion compensation," IEEE Transaction on Image Processing, vol.9, no.1, pp. 1509-1521, 2000. https://doi.org/10.1109/83.862628
  15. B. D. Choi, J. W. Han and C. S. Kim, et al.. "Motion-compensated frame interpolation using bilateral motion estimation and aadaptive overlapped block motion compensation," IEEE Transaction on Circuits System and Video Technology, vol.17, no.7, pp. 407-416, ,2007. https://doi.org/10.1109/TCSVT.2007.893835
  16. Y. Zhang, D. Zhao and X. Ji, et al.. "A motion-aligned auto-regressive model for frame rate up-conversion," IEEE Transaction on Circuits System and Video Technology, vol.19, no.9, pp.1289-1301, 2009. https://doi.org/10.1109/TCSVT.2009.2022798
  17. Y. B. Zhang, D. B. Zhao and S. W. Ma, et al.. " A motion-aligned auto-regressive model for frame rate up-conversion," IEEE Transaction on Image Processing, vol.19, no.5, pp.1248-1258, 2010. https://doi.org/10.1109/TIP.2009.2039055
  18. H . Liu, R. Xiong and B. Zhao, et al.. "Multiple hypotheses Bayesian frame rate up-conversion by adaptive fusion of motions-compensated interpolations," IEEE Transaction on Circuits System and Video Technology, vol.22, no.8, pp.1188-1198, 2012. https://doi.org/10.1109/TCSVT.2012.2197081
  19. R. Li, Z. L. Gan, and Z. G. Cui, et al.. "Joint motion-compensated Interpolation using eight-neighbor block motion vectors." IEICE Transaction on Information and System, vol.E96-D, no.4, pp.976-979, 2013. https://doi.org/10.1587/transinf.E96.D.976
  20. J. Ascenso, C. Brites and F. Pereira. "Improving frame interpolation with spatial motion smoothing for pixel domain distributed video coding," in Proc. of 5th EURASIP Conference on Speech and Image Processing, Multimedia Communications and Services, pp.1-6, July, 2005.
  21. A. N. Tikhoneov and V. Y. Arsenin, "Solutions of Ill-Posed Problems," V. H. Winston & Sons, Washington, D. C.. 1977.
  22. J. Zhai, K. Yu and S Li. "A low complexity motion compensated frame inperpolation method," in Proc. of IEEE International Symposium on Ciruits and Systems, pp.4927-4930, 23-26 May, 2005.