DOI QR코드

DOI QR Code

A Signature-based Video Indexing Scheme using Spatio-Temporal Modeling for Content-based and Concept-based Retrieval on Moving Objects

이동 객체의 내용 및 개념 기반 검색을 위한 시공간 모델링에 근거한 시그니쳐 기반 비디오 색인 기법

  • Published : 2002.02.01

Abstract

In this paper, we propose a new spatio-temporal representation scheme which can model moving objets trajectories effectively in video data and a new signature-based access method for moving objects trajectories which can support efficient retrieval on user query based on moving objects trajectories. The proposed spatio-temporal representation scheme supports content-based retrieval based on moving objects trajectories and concept-based retrieval based on concepts(semantics) which are acquired through the location information of moving objects trajectories. Also, compared with the sequential search, our signature-based access method can improve retrieval performance by reducing a large number of disk accesses because it access disk using only retrieved candidate signatures after it first scans all signatures and performs filtering before accessing the data file. Finally, we show the experimental results that proposed scheme is superior to the Li and Shan's scheme in terns of both retrieval effectiveness and efficiency.

본 논문에서는 비디오 데이터가 지니는 이동 객체의 궤적(Moving Object's Trajectory)을 효과적으로 모델링할 수 있는 시공간 표현 기법(Spatio-Temporal Representation Scheme)과 궤적을 이용한 사용자 질의에 대해 효율적인 검색을 위한 새로운 시그니쳐 기반 접근 기법을 제안한다. 제안하는 시공간 표현 기법은 궤적을 기반으로 하는 내용 기반 검색(Content-based Retrieval)과 궤적에서 일어나는 위치 정보를 통해 얻어진 개념(의미)을 이용한 개념 기반 검색(Concept-based Retrieval)을 지원한다. 아울러, 제안하는 시그니쳐 기반 접근 기법은 데이터 파일을 직접 접근하기 전에 전체 시그니쳐들은 탐색하여 필터링을 수행한 후, 검색된 후보 시그니쳐들에 대해서만 디스크를 접근하기 때문에 순차 탐색에 비해 많은 수의 디스크 접근 횟수를 감소시킴으로써 검색 성능을 향상시킨다. 마지막으로, 성능 평가를 통해 제안하는 방법이 검색 효과(Retrieval Effectiveness) 및 효율(Retrieval Efficiency) 측면에서 기존의 방법인 Li나 Shan의 방법에 비해 우수함을 보인다.

Keywords

References

  1. W. Niblack, et. al., 'The QBIC project : Quering by Iamge Content Using Color, Texture, and Shape,' in Procceedings of SPIE Storage and Retrieval for Image and Video Databases, pp.173-187, 1993 https://doi.org/10.1117/12.143648
  2. J. R. Smith, S. F. Chang, 'VisualSEEk : a Fully Automated Content-Based Image Query System,' in Procceedings of ACM Multimedia 96, pp.87-98, 1996 https://doi.org/10.1145/244130.244151
  3. T. D. C. Little, G. Ahanger, R. J. Folz, et. al., 'A Digital On-Demand Video Service Supporting Content-Based Queries,' in Proceedings of ACM Multimedia 93, pp.427-436, 1993 https://doi.org/10.1145/166266.168450
  4. Virginia, E. Ogle and Michael Stonebraker, 'Chabot : Retrieval from a Relational Database of images,' IEEE Computer, Vol.28, No.9, pp.40-48, 1995 https://doi.org/10.1109/2.410150
  5. G. Ahanger, D. Benson, and T. D. C. Little, 'Video query formulation,' in Proceedings of SPIE Electronic Imaging Science and Technology, pp.280-291, 1995
  6. A. Yoshitaka, M. Yoshimitsu, M. Hirakawa, and T. Ichikawa, 'V-QBE : Video database retrieval by means of example motion of objects,' in Proceedings of IEEE International Conference on Multimedia Computing and Systems, pp.453-457, 1996 https://doi.org/10.1109/MMCS.1996.535013
  7. John Z. Li, M. Tamer Ozsu, Duane Szafron, 'Modeling Video Temporal Relationships in an Object Database Management System,' in Proceedings of Multimedia Computing and Networking(MMCN97), pp.80-91, 1997 https://doi.org/10.1117/12.264311
  8. John Z. Li, M. Tamer Ozsu, Duane Szafron, 'Modeling of Video Spatial Relationships in an Objectbase Management System,' in Proceedings of International Workshop on Multimedia DBMS, pp.124-133, 1996
  9. Man-Kwan Shan and Suh-Yin Lee, 'Content-based Video Retrieval via Motion Trajectories,' in Proceedings of SPIE Electronic Imaging and Multimedia System II, Vol.3561, pp.52-61, 1998 https://doi.org/10.1117/12.319738
  10. Z. Aghbari, K. Kaneko, A. Makinouchi, 'Modeling and Querying Videos by Content Trajectories,' In Proceedings of the International Conference and Multimedia Expo, pp.463-466. 2000 https://doi.org/10.1109/ICME.2000.869639
  11. C. Faloutsos and S. Christodoulakis, 'Signature files : An access methods for documents and its analytical performance evaluation,' ACM Transaction on Database Systems, Vol.2, No.4, pp.267-288, 1984 https://doi.org/10.1145/2275.357411
  12. S. K. Chang, Q. Y. Shi and C. W. Yan, 'Iconic Indexing by 2D Strings,' IEEE Trans. Pattern Analysis, Machine Intelligence, Vol.9, No.3, pp.413-428, 1987 https://doi.org/10.1109/TPAMI.1987.4767923
  13. J. W. Chang, Y. J. Kim and K. J. Chang, 'A Spatial Match Reprensentation Scheme Indexing and Querying in Icnoic Image Databases,' ACM International Conference on Information and Knowledge Management, pp.169-176, 1997
  14. J. F. Allen, 'Maintaining Knowledge about Temporal Intervals,' Communication of the ACM, Vol.26, No.11, pp. 832-843, 1983 https://doi.org/10.1145/182.358434
  15. C. C. Chang and J. H. Jiang, 'A fast spatial match retrieval using a superimposed coding technique,' In Proc. of the Int's Symposium on Advanced database Technologies and Their Integration, pp.71-78, 1994
  16. G. Salton, 'A New Comparison between Conventional Indexing(MEDLARS) and Automatic Text Processing(SMART),' Journal of the American Society for Information Science, Vol.23, No.2, pp.75-84, 1972 https://doi.org/10.1002/asi.4630230202
  17. Salton, G., M. McGill, An introduction to Modem Information Retrieval, McGraw-Hill, 1993