Journal of Korean Institute of Industrial Engineers (대한산업공학회지)

Korean Institute of Industrial Engineers (대한산업공학회)
권호 표지

Emotional Model via Human Psychological Test and Its Application to Image Retrieval

인간심리를 이용한 감성 모델과 영상검색에의 적용

  • Yoo, Hun-Woo (Center for Cognitive Science, Yonsei University) ;
  • Jang, Dong-Sik (Department of Industrial Engineering, Korea University)
  • 유헌우 (연세대학교 인지과학연구소) ;
  • 장동식 (고려대학교 산업시스템정보공학과)
  • Published : 2005.03.30
Download PDF
⟨ Previous Next ⟩

Abstract

A new emotion-based image retrieval method is proposed in this paper. The research was motivated by Soen's evaluation of human emotion on color patterns. Thirteen pairs of adjective words expressing emotion pairs such as like-dislike, beautiful-ugly, natural-unnatural, dynamic-static, warm-cold, gay-sober, cheerful-dismal, unstablestable, light-dark, strong-weak, gaudy-plain, hard-soft, heavy-light are modeled by 19-dimensional color array and $4{\times}3$ gray matrix in off-line. Once the query is presented in text format, emotion model-based query formulation produces the associated color array and gray matrix. Then, images related to the query are retrieved from the database based on the multiplication of color array and gray matrix, each of which is extracted from query and database image. Experiments over 450 images showed an average retrieval rate of 0.61 for the use of color array alone and an average retrieval rate of 0.47 for the use of gray matrix alone.

Keywords

References

  1. Bach, J, R., Fuller, C., Gupta, A., Hampapur, A., Horowitz. B., Humphrey, R., Jain, R., and Shu, C.(1996), The virage image search engine: An open framework for image management, In Proc SPIE Vol. 2670: Storage and Retrieval for Images and Video Databases IV, 76-86
  2. Carson, C., Belongie, S., Greenspan, H., and Malick, J.(2002), Blobworld: Image segmentation using Expectation-Maximization and its application to image querying, IEEE Trans. on Patterrn Analysis and Machine Intelligence, 24(8), 1026-1038 https://doi.org/10.1109/TPAMI.2002.1023800
  3. Cho, S.-B,(2002), Towards creative evolutionary systems with interactive genetic algorithm, Applied Intelligence, 16(2), 129-138 https://doi.org/10.1023/A:1013614519179
  4. Corridoni.J. M., Del Bimbo, A., and Pala, P.(1999), Image retrieval bycolour semantics, ACM Multimedia System, 7(3), 175-183 https://doi.org/10.1007/s005300050120
  5. Corridoni, J. M., Dcl Bimbo, A., and Vicario, E.(1998), Image retrieval by colour semantics with incomplete knowledge, Journal of the American Society for Information Science, 49(3), 267-282 https://doi.org/10.1002/(SICI)1097-4571(199803)49:3<267::AID-ASI7>3.0.CO;2-#
  6. Flickncr, M., Sawhney. H.,Niblack, W., Ashley, J.,Huang, Q.,Dam, B., Gorkani, ., Hafner, J., Lee, D., Petkovic, D., Steele, D., and Yanker, P,(1995), Query by image content: The QBIC system, IEEE Computer, 28(9), 23-31
  7. Itten, J.(1961), Art of color(Kunst der Farbe), Otto Maier Verlag, Ravensburg, Germany(in German)
  8. Joseph, T. and Cardenas, A.(1988), PicQuery: A High-level query language for pictorial database management, IEEE Trans, on Software Engineering, 14(5), 630-638 https://doi.org/10.1109/32.6140
  9. Ma, W,Y. andManjunath, B, S,(1999), Netra: A toolbox for navigatinglarge image databases, Multimedia Systems, 7(3), 184-198 https://doi.org/10.1007/s005300050121
  10. Pentland, A., Picard, R. W., and Sclaroff, S.(1996), Photobook: Content-based manipulation of image databases, International Journal of Computer Vision, 18(3),233-254 https://doi.org/10.1007/BF00123143
  11. Pitas, I.(1993), Digital Image Processing Algorithms, Prentice Hall
  12. Roussopolous, N., Faloutsos, C., and Sellis, T.(1988), An efficient pictorial database system for pictorial structured query language (PSQL), IEEE Trans. on Software Engineering, 14(5),639-650 https://doi.org/10.1109/32.6141
  13. Smith, J. R, and Chang, S.-E,(1996), VisuaI SEEK: A fully automated content-based image query system, in Proc. ACM Multimedia, 87-98
  14. Soen, T., Shimada, T' and Akita, M(1987), Objective evaluation of color design, Color Research and Application, 12(4), 184-194
  15. Takagi, H., Noda, T., and Cho, S.-B,(1999), Psychological space to hold impression among media in common for media database retrieval system, in Proc, IEEE Int'l Conf on System, Man, and Cybernetics.263-268 25-38
  16. Tamura, H., Mori, S., and Yamawaki, T.(1978), Texture features corresponding to visual perception, IEEE Trans on Sys, Man, and Cyb, SMC-8(6), 460-473
  17. Urn, J.-S., Eum, K.-B., and Lee, J.-W.(2002), A study of the emotional evaluation models of color patterns based on the adaptive fuzzy system and the neural network, Color Research and Application, 27(3),208-216 https://doi.org/10.1002/col.10052
  18. Yoo, H.-W,. Jang, D,-S., Jung, S.-H., Park, J.-H., and Song, K.-S. (2002), Visual information retrieval system via content-based approach, Pattern Recognition, 35( 3), 749-769 https://doi.org/10.1016/S0031-3203(01)00072-3
  19. Yoo, H,-W' lang, D.-S., and Na, Y,-K.(2002), Extraction of major object features using VQ clustering for content-based image retrieval, Pattern Recognition, 35(5),1115-1126 https://doi.org/10.1016/S0031-3203(01)00105-4