The KIPS Transactions:PartB (정보처리학회논문지B)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

MPEG-7 based Video/Image Retrieval System (VIRS)

MPEG-7 기반 비디오/이미지 검색 시스템(VIRS)

  • 이재호 (한양대학교 대학원 전자전기컴퓨터공학부) ;
  • 김형준 (한양대학교 대학원 전자전기컴퓨터공학부) ;
  • 김회율 (한양대학교 전자전기공학부)
  • Published : 2003.08.01
Download PDF
⟨ Previous Next ⟩

Abstract

An increasing in quantity of multimedia data brought a new problem that expected data should be retrieved fast and exactly. The adequate representation is a key element for the efficient retrieval. For this reason, MPEG-7 standard was established for description of multimedia data in 2001. However, the content of the standard is massive and the approach method is not clear for real application system yet, because of properties of MPEG-7 standard that has to include a lot of potential cases. In this paper, we suggested implementation scheme of retrieval system with using of only visual descriptors and presented the performance results of developed system. From the result of developed system, MPEG-7 VIRS (Video/Image Retrieval System), we analyzed the retrieval results between using individual descriptor and using multiple descriptors, and showed a layout for real application system.

멀티미디어데이터의 급격한 양적 팽창은 원하는 데이터를 빠르고 정확하게 검색해야 한다는 새로운 과제를 안겨주었다. 이러한 효율적 검색을 위해서 가장 중요한 기반이 되는 것이 바로 데이터의 적절한 표현이다. 2001년 국제 표준으로 제정된 MPEG-7은 바로 이러한 이유로 멀티미디어 데이터의 표현에 대한 표준화를 다루고 있다. 그러나 MPEG-7의 내용은 표준의 특성상 포함하는 범위가 방대하고 실제 검색시스템을 구축하려는 이들에게 다루기 힘든 것이 사실이다. 이에 본 논문에서는 MPEG-7에 제시되어 있는 표준 중 비주얼 기술자들만을 이용하여 간단한 검색시스템을 구축하는 방법에 대하여 제시하고 그 검색 결과를 도시하였다. 또한 개발된 시스템인 MPEG-7 VIRS(Video/Image Retrieval System)의 검색 결과를 통하여 각 비주얼 기술자를 이용한 검색과 다중 기술자들의 조합을 이용한 검색간의 결과를 분석하였으며 앞으로 MPEG-7을 이용한 검색 시스템이 나아갈 방향에 대한 간단한 제시를 하고 있다.

Keywords

References

  1. S. F. Chang, 'Overview of the MPEG-7 Standard,' IEEE Trans. On Circuits and Systems for Video Technology, Vol.11, No.6, pp.799-695, June, 2001 https://doi.org/10.1109/76.927421
  2. R. B. Johnson, 'Multimedia databases and MPEG-7,' Electronics & Communication Engineering Journal, issue 3, Vol.13, pp.98-99, June, 2001 https://doi.org/10.1049/ecej:20010305
  3. S. Jeannin and A. Divakaran, 'MPEG-7 visual motion descriptors,' IEEE Transactions on Circuits and Systems for Video Technology, Vol.11, No.6, pp.720-724, June, 2001 https://doi.org/10.1109/76.927428
  4. M. Bober, 'MPEG-7 visual shape descriptors,' IEEE Trans. on Circuits and Systems for Video Technology, Vol.11, No.6, pp.716-719, June, 2001 https://doi.org/10.1109/76.927426
  5. D. S. Messing, P. Van Beek and J. H. Errico, 'The MPEG-7 colour structure descriptor : image description using colour and local spatial information,' PROC. International Conference on Image Proccessing, Vol.1, pp.670-673, 2001 https://doi.org/10.1109/ICIP.2001.959134
  6. T. Echigo, K. Masumitsu, M. Teraguchi, M. Etoch and S. Sekihuchi, 'Personalized delivery of digest video managed or MPEG-7,' Information Technology : Proc. Coding and Computing, pp.216-210, 2001 https://doi.org/10.1109/ITCC.2001.918794
  7. N. Fatemi and O. A. Khaled, 'Indexing and retrieval of TV news programs based on MPEG-7,' Proc. International Conference on Consumer Electronics, pp.360-361, 2001 https://doi.org/10.1109/ICCE.2001.935345
  8. T. Ebrahimi, Y. Abdeljaoued, R. M. Figueras i Ventura and O. Divorra Escoda, 'MPEG-7 camera,' Proc. International Conference on Image Processing, Vol.3, pp.600-603, 2001 https://doi.org/10.1109/ICIP.2001.958190
  9. J. R. Smith and S. F. Chang, 'VisualSEEK : A Fully Automated Content-Based Query System,' Proc. ACM Multimedia, pp.87-98, 1996, http://disney.ctr.columbia.edu/WebSEEK https://doi.org/10.1145/244130.244151
  10. S. Mehrotra, Y. Rui, M. Ortega-Binderberger and T. S. Huang, 'Supporting Content-Based Queries over Images in MARS,' Proc. IEEE Int'1 Conf. on Multimedia Computing and Systems, pp.632-633, June, 1997, http://jadzia.iip.uiuc.edu : 8001/. https://doi.org/10.1109/MMCS.1997.609791
  11. M. Thomas, C. Carson and J. M. Hellerstein, 'Creating a Customized Access Method for Blobworld,' Proc. 16th International Conference on Data Engineering, pp.82-82, 2000, http://elib.cs.berkeley.edu/photos/blobworld https://doi.org/10.1109/ICDE.2000.839390
  12. W. Niblack, et al, 'Updates to the QBIC system,' Proc. SPIE on Storage and Retrieval for Image and Video Databases, Vol.6, pp.150-161, 1998, http://wwwqbic.almaden.bm.com/ https://doi.org/10.1117/12.298439
  13. Pentland, R. W. Picard and S. Scarlo, 'Photobook : Tools for Contest-Based Manipulation of image Databases,' Proc.SPIE on Storage and Retrieval for Image and Video Databases II, Vol.2, Issue 185, pp.34-47, 1994, http://whitechapel.media.mit.edu/vismod/demos/photobook https://doi.org/10.1117/12.171786
  14. A. Gupta, et al 'The Virage image search engine : an open framework for image management,' Proc. SPIE on Storage and Retrieval for Image and Video Database Vol.4, pp.76-87, 1996, www.virage.com https://doi.org/10.1117/12.234785
  15. S. Ravela and R. Manmatha, 'On computing global similarity in images,' Proc. IEEE Workshop on Applications of Computer Vision (WACV98), Princeton, NJ, pp.82-87, 1998, http://cowarie.cs.umass.edu/~demo/ https://doi.org/10.1109/ACV.1998.732862
  16. C. Nastar, 'Surfimage : a flexible content-based image retrieval system,' Proc.ACM Multimedia '98, Bristol, UK. 1998, http://www-syntim.inria.fr/htbin/syntim/surfimage/surfimage.cgi https://doi.org/10.1145/290747.290799
  17. W. Y. Ma and B. S. Manjunath, 'NeTra : a toolbox for navigating large image databases,' Proc. International Conference on Image Processing, Vol.1, pp.568-571, 1997, http://vivaldi.ece.ucsb.edu/Netra https://doi.org/10.1109/ICIP.1997.647976
  18. M. G. Christel, R. B. Allen and E. Rasmussen, 'Multimedia abstractions for a digital video library,' Proc. ACM Digital Libraries '97, pp.21-29, http://www.islip.com/fprod.htm https://doi.org/10.1145/263690.263776
  19. I.J. Cox, M.L. Miller, T.P. Minka, T.V. Papathomas and P.N. Yianilos, 'The Bayesian Image Retrieval System;PicHunter: Theory, Implementation and Psychophysical Experiments,' IEEE Trans. Image Processing, Vol.9, No.1, pp.20-37, 2000 https://doi.org/10.1109/83.817596
  20. S. Kulkarni, B. Verma, P. Sharma and H. Selvaraj, 'Content Based Image Retrieval Using a Neuro-Fuzzy Technique,' Proc. IEEE Int'l Joint Conf. on Neural Networks, pp.846-850, July, 1999 https://doi.org/10.1109/IJCNN.1999.830859
  21. B. S. Manjunath, et al., 'Introduce to MPEG-7,' John Wiley & Sons Ltd., West Sussex, England, 2002
  22. ISO/IEC 15938-3, 'Multimedia Content Description Interface-Part 3 : Visual,' version 1, 2001
  23. A. Yamada, M. Pickering, S. Jeannin, L. Cieplinski, J. R. Ohm and M. C. Kim, 'MPEG-7 Visual part of experimentation Model Version 10.0,' ISO/IEC JTCI/SC29/WG11/N4063, Singapore, March 2001
  24. http://www.lis.e-technik.tu-muenchen.de/research/bv/topics/mmdb/e_mpeg7.html, MPEG-7 Experimental Model Software
  25. D. Zier and J-R. Ohm 'Common Datasets and Queries in MPEG-7 Color Core Experiments,' ISO/IEC JTCI/SC29/WG11/M5060, Melbourne, October, 1999
  26. P. Ndjiki-Nya et al., 'Subjective Evaluation of the MPEG-7 Retrieval Accuracy Measure (ANMRR),' ISO/IEC JTC/SC29/WG11/M6029, Geneva, May, 2000
  27. ISO/IEC 15938-3, Multimedia Content Description Interface: MDS,' version 1, 2001