딥러닝 기반 동영상 객체 분할 기술 동향

  • Published : 2020.04.30

Abstract

동영상 프레임 내 객체 영역들을 배경으로부터 분할하는 기술인 동영상 객체 분할(video object segmentation)은 다양한 컴퓨터 비전 분야에 활용 가능한 연구 분야이다. 최근, 동영상 객체 분할과 관련된 연구 내용으로 CVPR, ICCV, ECCV의 컴퓨터 비전 최우수 학회에 매년 20편 가까이 발표될 정도로 많은 관심을 받고 있다. 동영상 객체 분할은 사용자가 제공하는 정보에 따라 비지도(unsupervised) 동영상 객체 분할, 준지도(semi-supervised) 동영상 객체 분할, 인터렉티브(interactive) 동영상 객체 분할의 세 카테고리로 분류할 수 있다. 본 고에서는 최근 연구가 활발하게 수행되고 있는 비지도 동영상 객체 분할과 준지도 동영상 객체 분할 연구의 최신 동향에 대해 소개하고자 한다.

Keywords

References

  1. A. papazoglou and V. Ferrari, "Fast Object Segmentation in Unconstrained Video," ICCV, 2013.
  2. Y. J. Koh and C.-S. Kim, "Primary Object Segmentation in Videos Based on Region Augmentation and Reduction," CVPR, 2017.
  3. A. Faktor and M. Irani, "Video Segmentation by Non-Local Consensus voting," BMVC, 2014.
  4. S. Jain, B. Xiong, and K. Grauman, "FusionSeg: Learning to combine motion and appearance for fully automatic segmentation of generic objects in videos," CVPR, 2017
  5. H. Li, G. Chen, G. Li, and Y. Yu, "Motion Guided Attention for Video Salient Object Detection," ICCV, 2019.
  6. X. Lu, W. Wang, C. Ma, J. Shen, L. Shao, and F. Porikli, "See More, Know More: Unsupervised Video Object Segmentation with Co-Attention Siamese Networks," CVPR, 2019.
  7. Z. Yang, Q. Wang, L. Bertinetto, W. Hu, S. Bai, and P. H.S. Torr, "Anchor Diffusion for Unsupervised Video Object Segmentation," ICCV, 2019.
  8. W. Wang, H. Song, S. Zhao, J. Shen, S. Zhao, S. C. H. Hoi, and H. Ling, "Learning Unsupervised Video Object Segmentation through Visual Attention," CVPR, 2019.
  9. S. Caelles, K.K. Maninis, J. Pont-Tuset, L. Leal-Taixe, D. Cremers, and L. Van Gool, "One-Shot Video Object Segmentation," CVPR, 2017.
  10. W.-D. Jang and C.-S Kim, "Online Video Object Segmentation via Convolutional Trident Network," CVPR, 2017.
  11. P. Hu, G. Wang, X. Kong, J. Kuen, and T.-P. Tan "Motion-Guided Cascaded Refinement Network for Video Object Segmentation," CVPR, 2018.
  12. S. W. Oh, J.-Y. Lee, K. Sunkavalli, S. J. Kim, "RGMP: Fast video object segmentation by reference-guided mask propagation," CVPR, 2018.
  13. H. Lin, X. Qi, and J. Jia, "AGSS-VOS: Attention Guided Single-Shot Video Object Segmentation," ICCV, 2019.
  14. Y. Chen, J. Pong-Tuset, A. Montes, and L. Van Gool, "PML: Blazingly Fast Video Object Segmentation with Pixel-Wise Metric Learning," CVPR, 2018.
  15. P. Voigtlaender, Y. Chai, F. Schroff, H. Adam, B. Leibe, and L.-C. Chen, "FEELVOS: Fast End-To-End Embedding Learning for Video Object Segmentation," CVPR, 2019.
  16. S. W. Oh, J.-Y. Lee, N. Xu, S. J. Lim, "Video Object Segmentation using Space-Time Memory Networks," ICCV, 2019.
  17. X. Wang, R. Girshick, A. Gupta, and K. He, "Non-local Neural Networks", CVPR, 2018.
  18. J. Luiten, P. Voigtlaender, and B. Leibe, "PReMVOS: Proposal-generation, Refinement and Merging for Video Object Segmentation," ACCV, 2018.
  19. S. Xu, D. Liu, L. Bao, W. Liu, and P. Zhou, "MHP-VOS: Multiple Hypotheses Propagation for Video Object Segmentation," CVPR, 2019.
  20. N. Xu, L. Yang, Y. Fan, J. Yang, D. Yue, Y. Liang, B. Price, S. Cohen, and T. Huang, "YouTube-VOS: Sequence-to-Sequence Video Object Segmentation," ECCV, 2018.
  21. C. Ventura, M. Bellver, A. Girbau, A. Salvador, "RVOS: End-to-End Recurrent Network for Video Object Segmentation," CVPR, 2019.
  22. T. Zhou, S. Wang, Y. Zhou, Y. Yao, J. Li, L. Shao, "Motion-Attentive Transition for Zero-Shot Video Object Segmentation, AAAI 2020," AAAI, 2020.