Observable Behavior for Implicit User Modeling -A Framework and User Studies-

  • Published : 2001.09.30

Abstract

This paper presents a framework for observable behavior that can be used as a basis for user modeling, and it reports the results of a pair of user studies that examine the joint utility of two specific behaviors. User models can be constructed by hand, or they can be teamed automatically based on feedback provided by the user about the relevance of documents that they have examined. By observing user behavior, it is possible to obtain implicit feedback without requiring explicit relevance judgments. Four broad categories of potentially observable behavior are identified : examine, retain, reference, and annotate, and examples of specific behaviors within a category are further subdivided based on the natural scope of information objects being manipulated . segment object, or class. Previous studies using Internet discussion groups (USENET news) have shown reading time to be a useful source of implicit feedback for predicting a user's preferences. The experiments reported in this paper extend that work to academic and professional journal articles and abstracts, and explore the relationship between printing behavior and reading time. Two user studies were conducted in which undergraduate students examined articles or abstracts from the telecommunications or pharmaceutical literature. The results showed that reading time can be used to predict the user's assessment of relevance, that the mean reading time for journal articles and technical abstracts is longer than has been reported for USENET news documents, and that printing events provide additional useful evidence about relevance beyond that which can be inferred from reading time. The paper concludes with a brief discussion of the implications of the reported results.

Keywords

References

  1. Page Rank Citation Ranking: Bringing Order to the Web, Stanford Digital Library Working Paper Brin, S.;Page L.
  2. The anatomy of a large-scale hypertextual Web search engine Brin, S.;Page L.
  3. Communications of the ACM v.40 no.3 Special Issue on Recommender Systems CACM
  4. technology and humanities Citation indexing:Its theory and application in science Garfield, E.
  5. Communication of the ACM v.35 no.12 Using collaborative filtering to weave an information Tapestry Goldberg, D.;Nichols, D.;Oki, B.M.;Terry, D.
  6. In proceedings of the Third ISKO=France no.July 5-6 User modeling for information filtering based on implicit feedback Kim, J.;Oard, D. W.;Romanik, K.
  7. Technical Report, college of Information Studies Using implicit feedback for user modeling in Internet and Intranet searching Kim, J.;Oard, D.W.;Romnik, K.
  8. Konstan, J. A.;Miller, B. N.;Maltz, D.;Herlocker, J.L.;Gordon, L. R.;Riedl.J.
  9. Communication of the ACM March v.40 no.3 Applying collaborative filtering to Usenet News
  10. Proceedings of the Seventeenth Annual International ACM-SIGIR Conference on Research and Development in information Retrieval Information filtering based on user behavior analysis and best match text retrieval Morita, M.;Shinoda,Y.
  11. In Proceedings of the 5th DELOS Workshop on Filtering and Collaborative Filtering no.10-12 Implicit ratings and filtering Nichols,D.M.
  12. User Modeling and User-Adapted Interaction v.7 no.3 The state of the art in text filtering Oard. D. W.
  13. In AAAI Workshop on Recommender Systems Implicit Feedback for Recommender System Oard. D. W.;Kim, J.
  14. A learning approach to personalized information filtering Sheth, B. D.
  15. Knowledge-based assistance for accessing large poorly structured information spaces Stevens, C.
  16. In Proceedings of the 1995 USENIX Technical Conference SIFT-A too for wide-area information dissemination Yan, T. W.;Garcia-Molina, H.