DOI QR코드

DOI QR Code

Visual Information Selection Mechanism Based on Human Visual Attention

인간의 주의시각에 기반한 시각정보 선택 방법

  • 최경주 (충북대학교 전자정보대학 소프트웨어학과) ;
  • 박민철 (한국과학기술연구원 포토닉스센서 시스템센터)
  • Received : 2009.10.05
  • Accepted : 2010.11.02
  • Published : 2011.03.31

Abstract

In this paper, we suggest a novel method of selecting visual information based on bottom-up visual attention of human. We propose a new model that improve accuracy of detecting attention region by using depth information in addition to low-level spatial features such as color, lightness, orientation, form and temporal feature such as motion. Motion is important cue when we derive temporal saliency. But noise obtained during the input and computation process deteriorates accuracy of temporal saliency Our system exploited the result of psychological studies in order to remove the noise from motion information. Although typical systems get problems in determining the saliency if several salient regions are partially occluded and/or have almost equal saliency, our system is able to separate the regions with high accuracy. Spatiotemporally separated prominent regions in the first stage are prioritized using depth value one by one in the second stage. Experiment result shows that our system can describe the salient regions with higher accuracy than the previous approaches do.

본 논문에서는 입력장치로 들어오는 수많은 시각정보 중 현 시점에서 가장 유용하다고 생각되는 정보를 인간의 상향식 주의시각에 기반하여 선택하는 시각정보 선택기법에 대해 소개한다. 제안하는 시스템은 색상, 명도, 방위, 형태 등 저수준의 공간특징 외에 시간특징으로서 움직임 정보와 3차원 정보인 깊이 정보를 추가적으로 사용함으로써 기존방법에 비해 정보 선택의 정확도를 높혔다. 움직임 정보 추출 시 발생할 수 있는 노이즈를 제거하기 위해 인간의 움직임 인지에 대한 연구결과를 이용하는 새로운 접근법을 사용하였으며, 입력 영상 내 객체들이 부분적으로 겹쳐있다거나 동일한 현저도를 가지고 있을 때에도 현저한 영역을 제대로 선택해낼 수 있도록 깊이 정보를 사용하여 유의미한 영역을 선별하고 우선순위를 부여하였다. 실험결과를 통해 제안하는 방법이 기존의 방법에 비해 높은 정확도를 가짐을 확인할 수 있었다.

Keywords

References

  1. L. Itti and C. Koch, "A saliency-based search mechanism for overt and covert shifts of visual attention," Vision Research, Vol.40, pp.1489-1506, 2000. https://doi.org/10.1016/S0042-6989(99)00163-7
  2. A. Hiroshi, "Visual Psychophysics (8) : Visual Motion Perception and Motion Pictures," Journal of Image Information and Television Engineers, Vol.58, No.8, pp.1151-1156, 2004. https://doi.org/10.3169/itej.58.1151
  3. E. Niebur and C. Koch. "Computational architectures for attention," The Attentive Brain, MIT Press, 1997.
  4. S. Kwak, B. Ko and H. Byun "Automatic salient-object extraction using the contrast map and salient point," LNCS, Vol.3332, pp.138-145, 2004
  5. S. Kwak , B. Ko and H. Byun, "Salient human detection for robot vision," Pattern Analysis and Applications, Vol.10, No.4, pp.291-299, 2007. https://doi.org/10.1007/s10044-007-0068-8
  6. K. Rapantzikos, Y. Avrithis, and S. Kollias, "Handling Uncertainty in Video Analysis with Spatiotemporal Visual Attention," The 14th IEEE International Conference on Fuzzy Systems, pp.213-217, 2005.
  7. S. Li and M. Lee, "An Efficient Spatiotemporal Attention Model and Its Application to Shot Matching," IEEE Transactions on Circuits and Systems for Video Technology, Vol.17, No.10, pp.1383-1387, 2007. https://doi.org/10.1109/TCSVT.2007.903798
  8. M. Park and K. Cheoi, "An Adaptive ROI Detection System for Spatiotemporal Features," J. of the Korea Contents Association, Vol.6, No.1, pp.41-53, 2006.
  9. M. Park and K. Cheoi, "Selective Visual Attention System Based on Spatiotemporal Features," LNCS, Vol.5068, pp.203-212, 2008.
  10. F. Tombari, S. Mattoccia and L. Stefano, "Segmentation-based adaptive support for accurate stereo correspondence," In Proc. IEEE Pacific-Rim Symposium on Image and Video Technology, 2007.
  11. K. Yoon and I. Kweon, "Adaptive Support- Weight Approach for Correspondence Search," IEEE Tranansactions on PAMI, Vol.28, No.4, pp.650-656, 2006. https://doi.org/10.1109/TPAMI.2006.70
  12. L. Spillmann and J. Werner, "Visual Perception: the neurophysiological foundations," Academinc Press Inc., 1990.
  13. A.Treisman and G.Gelad, "A Feature-integration theory of Attention," Congnitive Psychology, Vol.12, No.1, pp.97-136, 1980. https://doi.org/10.1016/0010-0285(80)90005-5
  14. 차명희, 김기협, 조경은, 엄기현, "시각적 특징 맵을 이용한 자율 가상 캐릭터의 실시간 주목 시스템," 한국멀티미디어학회논문지, v.12, no.5, pp.745-756, 2009.

Cited by

  1. A New Covert Visual Attention System by Object-based Spatiotemporal Cues and Their Dynamic Fusioned Saliency Map vol.18, pp.4, 2015, https://doi.org/10.9717/kmms.2015.18.4.460
  2. Adaptive Spatiotemporal Feature Extraction and Dynamic Combining Methods for Selective Visual Attention System 2017, https://doi.org/10.1007/s11277-017-5043-0
  3. An Analysis of Elementary Students' Attention Characteristics through Attention Test and the Eye Tracking on Real Science Classes vol.36, pp.4, 2016, https://doi.org/10.14697/jkase.2016.36.4.0705
  4. 시각주의 탐색 시스템을 위한 새로운 성능 평가 기법 vol.16, pp.1, 2011, https://doi.org/10.9716/kits.2017.16.1.055
  5. Virtual Reality 콘텐츠 제작 유형이 고객 만족에 미치는 영향 vol.48, pp.3, 2011, https://doi.org/10.7469/jksqm.2020.48.3.433