Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

POMDP-based Human-Robot Interaction Behavior Model

POMDP 기반 사용자-로봇 인터랙션 행동 모델

  • Received : 2014.02.15
  • Accepted : 2014.03.30
  • Published : 2014.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents the interactive behavior modeling method based on POMDP (Partially Observable Markov Decision Process) for HRI (Human-Robot Interaction). HRI seems similar to conversational interaction in point of interaction between human and a robot. The POMDP has been popularly used in conversational interaction system. The POMDP can efficiently handle uncertainty of observable variables in conversational interaction system. In this paper, the input variables of the proposed conversational HRI system in POMDP are the input information of sensors and the log of used service. The output variables of system are the name of robot behaviors. The robot behavior presents the motion occurred from LED, LCD, Motor, sound. The suggested conversational POMDP-based HRI system was applied to an emotional robot KIBOT. In the result of human-KIBOT interaction, this system shows the flexible robot behavior in real world.

Keywords

References

  1. C. Boutilier and D. Poole, "Computering optimal policies for partially observable decision processes using compact representations," Proc. AAAI, pp. 1168-1175, 1996.
  2. A. Green and K. Eklundh, "Designing for learnability in humanrobot communication," IEEE Tr ans. Electron., vol. 50, no. 4, pp. 644-650, 2003.
  3. C. Breazeal, "Social Interaction in HRI: The robot view," IEEE Trans. on Systems, Man, and Cyber.-Part C:, vol. 34, no. 2, pp. 181-185, 2004. https://doi.org/10.1109/TSMCC.2004.826268
  4. R. C. Arkim, M. Fujita, T. Takagi, and R. Hasegawa, "An ethological and emotional basis for human-robot interaction," Robotics and Autonomous Systems, vol. 42, pp. 191-201, 2003. https://doi.org/10.1016/S0921-8890(02)00375-5
  5. K. Wada, T. Shibata, T. Saito, and K. Tanie, "Robot assisted activity at a health service facility for the aged for ten weeks: an interim report of a long-term experiment," Proc. of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, vol. 220, no. 8, pp. 709-715, 2006.
  6. http://www.nec.co.jp/products/robot/
  7. H. R. Kim, Y. M. Kim, J. C. Park, J. S. Park, T. W. Kang, and D. S. Kwon, "Design of reactive emotion process for the service robot," Journal of Korea Society, vol. 2, no. 2, 2007.
  8. Y.-C. Kim, H.-T. Kwon, W.-C. Yoon, and J.-C. Kim, "Designing emotional and interactive behaviors for an entertainment robot," Proc. of Int'l Conf. on Human Computer Interaction, LNCS 5611, pp. 321-330, Jul. 2009.
  9. J. C. Kim and G. H. Park, "Sound-based emotion estimation and growing HRI system for an edutainment robot," Journal of Korea Society, vol. 5, no. 1, pp. 7-13, 2010.
  10. G. H. Park, J. C. Kim, and H. J. Ann, "Development of videophone-based application services for KT Mon-e (KT Edutainment Robot for Young Children)," Journal of Korea Society, vol. 5, no. 2, pp. 93-101, 2010.
  11. J. C. Kim and H. H. Kim, "An edutainment Mon-E robot for young children," Journal of Korea Society, vol. 6, no. 2, pp. 147- 155, 2011. https://doi.org/10.7746/jkros.2011.6.2.147
  12. http://pomdp.org/
  13. H. Sim, K. E. Kim, J. H. Kim, D. S. Chang, and M. W. Koo, "Symbolic heuristic search value iteration for factored POMDPs," Proc. AAAI, pp. 1008-1093, 2008.
  14. J. W. Sung, J. H. Eun, H. J. Kim, and D. S. Jang, "Statistical dialog management policy using POMDP POMDPs for multi multi-goal domains," The Proc of Korea Computer Conference, vol. 36, no. 1(B), pp. 126-131, 2009.
  15. C. Boutiler and D. Poole, "Computing optimal plokcies for partially observable decision processes using compact representations," Proc. of AAAI, 1996.