Investigating Factors Affecting Automated Question Triage for Social Reference: A Study of Adopting Decision Factors from Digital Reference

  • Park, Jong Do (Department of Library and Information Science at Chung Ang University)
  • Received : 2015.01.26
  • Accepted : 2015.02.17
  • Published : 2015.02.28


The efficiency and quality of the social reference sites are being challenged because a large quantity of the questions have not been answered or satisfied for quite a long time. Main goal of this study is to investigate important factors that affect the performance of question triage to relevant answerers in the context of social reference. To achieve the goal, expert finding techniques were used to construct an automated question triage approach to resolve this problem. Furthermore, important factors affecting triage decisions in digital reference were first examined, and extended them to the social reference setting by investigating important factors affecting the performance of automated question triage in the social reference setting. The study was conducted using question-answer pairs collected from Ask Metafilter. For the evaluation, logistic regression analyses were conducted to examine which factors would significantly affect the performance of predicting relevant answerers to questions. The results of the current study have important implications for research and practice in automated question triage for social reference. Furthermore, the results will offer insights into designing user-participatory digital reference systems.


Question Triage;Question Routing;Social Reference;Digital Reference


  1. Agichtein, E. et al. 2008. "Finding High-Quality Content in Social Media." Proceedings of the 2008 International Conference on Web Search and Data Mining.
  2. Balog, K., Azzopardi, L. and De Rijke, M. 2006. "Formal models for expert finding in enterprise corpora." Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval.
  3. Bian, J. et al. 2008. "Finding the Right Facts in the Crowd: Factoid Question Answering over Social Media." Proceedings of the 17th international conference on World Wide Web.
  4. Blei, D. M., Ng, A. Y. and Jordan, M. I. 2003. "Latent dirichlet allocation." The Journal of Machine Learning Research, 3: 993-1022.
  5. Bouguessa, M., Dumoulin, B. and Wang, S. 2008. "Identifying authoritative actors in question-answering forums: the case of Yahoo! answers." Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining.
  6. Gazan, R. 2007. "Seekers, sloths and social reference: Homework questions submitted to a question-answering community." New Review of Hypermedia and Multimedia, 13(2): 239-248.
  7. Goldman, A. I. 1999. Knowledge in a social world. USA: Oxford University Press.
  8. Harper, F. M., Moy, D. and Konstan, J. A. 2009. "Facts or friends?: distinguishing informational and conversational questions in social Q&A sites." Proceedings of the 27th international conference on Human factors in computing systems.
  9. Jeon, J., Croft, W. B. and Lee, J. H. 2005. "Finding similar questions in large question and answer archives." Proceedings of the 14th ACM international conference on Information and knowledge management.
  10. Jurczyk, P. and Agichtein, E. 2007. "Discovering authorities in question answer communities by using link analysis." Proceedings of the sixteenth ACM conference on Conference on information and knowledge management. Lisbon, Portugal: ACM.
  11. Kim, S., Oh, J. S. and Oh, S. 2007. "Best-answer selection criteria in a social Q&A site from the user-oriented relevance perspective." Proceedings of the American Society for Information Science and Technology, 44(1): 1-15.
  12. Lee, C. T. et al. 2009. "Model for voter scoring and best answer selection in community Q&A services." Proceedings of the Web Intelligence and Intelligent Agent Technologies, 2009. WI-IAT '09. IEEE/WIC/ACM International Joint Conferences on.
  13. Li, B. and King, I. 2010. "Routing questions to appropriate answerers in community question answering services." Proceedings of the 19th ACM international conference on Information and knowledge management.
  14. Liu, M., Liu, Y. and Yang, Q. 2010. "Predicting best answerers for new questions in community question answering." Web-Age Information Management, 127-138.
  15. Nam, K. K., Ackerman, M. S. and Adamic, L. A. 2009. "Questions in, knowledge in?: a study of naver's question answering community." Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.
  16. Park, J. D. 2013. Automated Question Triage for Social Reference: A Study on Adopting Decision Factors from Digital Reference. PhD dissertation, University of Pittsburgh.
  17. Pomerantz, J. 2004. "Factors Influencing Digital Reference Triage: A Think-Aloud Study." Library Quarterly, 74(3): 235-264.
  18. Pomerantz, J., Nicholson, S. and Lankes, R. D. 2003. "Digital Reference Triage: Factors Influencing Question Routing and Assignment." Library Quarterly, 73(2): 103.
  19. Qu, M. et al. 2009. "Probabilistic question recommendation for question answering communities." Proceedings of the 18th international conference on World wide web.
  20. Shachaf, P. 2010. "Social reference: Toward a unifying theory." Library & Information Science Research, 32(1): 66-76.
  21. Shah, C., Oh, J. S. and Oh, S. 2008. "Exploring characteristics and effects of user participation in online social Q&A sites." First Monday, 13(9).
  22. Shah, C. and Pomerantz, J. 2010. "Evaluating and predicting answer quality in community QA." Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval.
  23. Steyvers, M. et al. 2004. "Probabilistic author-topic models for information discovery." Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining.
  24. Zhang, J., Tang, J. and Li, J. 2010. "Expert finding in a social network." Advances in Databases: Concepts, Systems and Applications, 1066-1069.