Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Spatiotemporal Grounding for a Language Based Cognitive System

언이기반의 인지시스템을 위한 시공간적 기초화

  • 안현식 (동명대학교 로봇시스템공학부)
  • Published : 2009.01.01

Abstract

For daily life interaction with human, robots need the capability of encoding and storing cognitive information and retrieving it contextually. In this paper, spatiotemporal grounding of cognitive information for a language based cognitive system is presented. The cognitive information of the event occurred at a robot is described with a sentence, stored in a memory, and retrieved contextually. Each sentence is parsed, discriminated with the functional type of it, and analyzed with argument structure for connecting to cognitive information. With the proposed grounding, the cognitive information is encoded to sentence form and stored in sentence memory with object descriptor. Sentences are retrieved for answering questions of human by searching temporal information from the sentence memory and doing spatial reasoning in schematic imagery. An experiment shows the feasibility and efficiency of the spatiotemporal grounding for advanced service robot.

Keywords

File

Download PDF

References

  1. D. Roy, "Semiotic Schernas: A Framework for GrOlmding Language in Action and Perception," Artificial Intelligence, vol. 167, pp. 170-205, 2005
  2. S. Coradeschi and A. Saffiotti, "An Introduction to the Anchoring Problem," Robotics and Autonomous System,vol. 43, pp. 85-96, 2003
  3. D. Roy, K.-Y. Hsiao, and N. Mavridis, "Mental Imagery for a Conversational Robot," IEEE SMC Part B, vol. 34,no. 3, pp. 1374-1383, June 2004
  4. M. Levit and D. Roy, "Interpretation of Spatial Language in a Map Navigation Task," IEEE Transactions on Systems. Man. and Cybernetics, Part B, vol. 37, no. 3, pp. 667-679, 2007
  5. P. Gorniak and D. Roy, "Grounded Semantic Composition for Visual Scenes," Journal of Artificial Intelligence Research, vol. 21, pp. 429-470, 2004
  6. J. M. Siskind, "Grounding the Lexical Semantics of Verbs in Visual Perception Using Force Dynamics and Event Logic," Journal of ArtificialIntelligence Research, no. 15, pp. 31-90, 2001
  7. R J. Mooney, "Learning to Connect Language and Perception," Proceedings of the 23th AAI Conference on Artificial Intelligence, Chicago, pp. 1598-1601, July 2008
  8. F. Huang, J. Yang, and A. Waibel, "Dialogue Management for Multimodal User Registration," ICSLP-2000,vol. 3, pp. 37-40, 2000
  9. A. Nuxoll and J. Laird, "Extending Cognitive Architecture with Episodic Memory," Proceedings of the 22ndNational Conference on Artificial Intelligence, 2007
  10. J. R Anderson, D. Bothell, M. D. Byrne, S. Douglass,C. Lebiere, and Y. Qin, "An integrated theory of the mind," Psychological Review, vol. Ill, no. 4, pp .1036-1060, 2004
  11. D. E. Kieras, S. D. Wood, and D. E. Meyer,"Predictive Engineering Models Based on the EPIC Architecture for a Multimodal Highperformance Human -computerInteraction Task," ACM Transactions on Computer-Human Interaction, vol. 4, pp. 230-275, 1997
  12. S. D. Lathrop and J. E. Laird, "Towards Incorporating Visual Imagery into a Cognitive Architecture," Proceedings of the Eighth International Conference on Cognitive Modeling. Ann Arbor, 2007
  13. P. Ratanaswasd, W. Dodd, K. Kawamura, and D. Noelle,"Modular Behavior Control for a Cognitive Robot," 12th International Coriference on Advanced Robotics(lCAR 2005), pp. 18-20, Seattle, July 2005
  14. M. P. Marcus, B. Santorini, and M. A. Marcinkiewicz,"Building a Large Annotated Corpus of English: the Penn Treebank," Computational Linguistics, vol. 19,1993
  15. S. M. Garnsey, N. J. Pearimuttter, E. Myers, and M. A.Lotocky, "The Contributions of Verb Bias and Plausibility to the Comprehension of Temporarily AmbiguousSentences," Journal of Memory and Language, vol. 37,pp. 58-93, 1997
  16. 정태구，논항구조와 영어 통사론，한국문화사 2002
  17. P. N. Johnson-Laird, Mental Models, Cambridge, MITPress, 1983
  18. E. Tulving, "Precis of Elements of Episodic Memory,"The Behavioral and Brain Sciences, vol. 7, pp. 223-268,1984
  19. W. G. Kennedy and J. G. Trafton, "Long-term Learning in Soar and ACT-R," Proceedings of the Seventh International Conference on Cognitive Modeling, pp. 166-171, Italy, 2006
  20. http://www.abisource.comlprojectsllink-grammar/
  21. R. C. Gonzalez and R. E. Woods, Digital Image Processing, Prentice Hall, 2008