Neural Net Agent for Distributed Information Retrieval

분산 정보 검색을 위한 신경망 에이전트

  • Published : 2001.10.01


Since documents on the Web are naturally partitioned into may document database, the efficient information retrieval process requires identifying the document database that are most likely to provide relevant documents to the query and then querying the identified document database. We propose a neural net agent approach to such an efficient information retrieval. First, we present a neural net agent that learns about underlying document database using the relevance feedbacks obtained from many retrieval experiences. For a given query, the neural net agent, which is sufficiently trained on the basis of the BPN learning mechanism, discovers the document database associated with the relevant documents and retrieves those documents effectively. In the experiment, we introduce a neural net agent based information retrieval system and evaluate its performance by comparing experimental results to those of the conventional well-known approaches.



  1. D. Clifford Neuman, 'The Prospero File System: A global file system based on the Virtual System model,' Computer Systems, 5(4), 1992. [1]
  2. Michael F. Schwarz, Alan Emtage, Brewster Kahle, and B. Clifford Neuman, 'A Comparison of INTERNET resource discovery approaches,' Computer Systems, 5(4), 1992
  3. B. Kahle and A. Medlar, 'An information system for corporate users: Wide Area Information Servers,' Technical Report TMC199, Thinking Machines Corporation, 1991
  4. G. Salton, The SMART Retrieval System-Experiments in Automatic Document Processing, Prentice-Hall, Inc., Englewood Cliffs NJ, 1971
  5. G. Salton and M. McGill, Introduction to Modem Information Retrieval, MacGraw-Hill, New York NY, 1983
  6. A. Howe and D. Dreilinger, 'Savvy Search: A Meta-Search Engine that Learns Which Search Engines to Query,' AI Magazine, 18(2), 1997
  7. L. Gravano, H. Garcia-Molina, and A. Tomasic, 'The Effectiveness of GlOSS for the Text-Database Discovery Problem,' in Proceedings of ACM SIGMOD, 1994
  8. L. Gravano and H. Garcia-Molina, 'Generalizing GlOSS to Vector-Space Databases and Broker Hierarchies,' in Proceedings of VLDB, 1995
  9. Yong S. Choi and Suk I. Yoo, 'Neural Network Based Web Information Agent,' in Proceedings of ACM CIKM'98 Workshop on Web Information and Data Management, November 1998
  10. Yong S. Choi and Suk I. Yoo, 'Neural Net Agent for Discovering Text Databases on the Web,' in Proceedings of International Conference on Advances in Databases and Information Systems, September 1999
  11. Ian H. Witten, Alistair Moffat, and Timothy C. Bell, Managing Gigabytes: Compressing and Indexing Documents and Images, Von Nostrand Reinhold, New York, 1994
  12. I. Biederman, On the Semantics of a Glance at a Scene, Perceptual Organization, Hillsdale, New-Jersey, Lawrence Erlbaum, 1981
  13. J. A. Freeman and D. M. Skapura, Neural Networks Algorithms, Applications, and programming Techniques, Addison-Wesley, MA, 1992
  14. B.A. LaMacchia, Internet Fish, PhD thesis, MIT, MA, 1996
  15. G. Tesauro and H. Janssens, 'Scaling relationships in back-propagation learning,' Complex Systems, Vol. 6, 1988
  16. M. Minsky and S. Papert, Perceptrons, MlT Press, Cambridge, MA, 1969
  17. Yong S. Choi and Suk I. Yoo, 'Multi-agent Learning Approach to WWW Information Retrieval using Neural Network,' in Proceedings of ACM International Conference on Intelligent User Interfaces, January 1999
  18. Yong S. Choi, Suk I. Yoo, and Jaeho Lee, 'Hierarchically Organized Neural Net. Agents for Distributed Web Information Retrieval,' in Proceedings of 23rd International IEEE Computer Software and Applications Conference, October 1999