Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

Interactive Motion Retargeting for Humanoid in Constrained Environment

제한된 환경 속에서 휴머노이드를 위한 인터랙티브 모션 리타겟팅

  • Nam, Ha Jong (Dept. of Media Technology and Media Contents, The Catholic University of Korea) ;
  • Lee, Ji Hye (Dept. of Media Technology and Media Contents, The Catholic University of Korea) ;
  • Choi, Myung Geol (Dept. of Media Technology and Media Contents, The Catholic University of Korea)
  • 남하종 (가톨릭대학교 미디어기술콘텐츠학과) ;
  • 이지혜 (가톨릭대학교 미디어기술콘텐츠학과) ;
  • 최명걸 (가톨릭대학교 미디어기술콘텐츠학과)
  • Received : 2017.06.04
  • Accepted : 2017.07.06
  • Published : 2017.07.14
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we introduce a technique to retarget human motion data to the humanoid body in a constrained environment. We assume that the given motion data includes detailed interactions such as holding the object by hand or avoiding obstacles. In addition, we assume that the humanoid joint structure is different from the human joint structure, and the shape of the surrounding environment is different from that at the time of the original motion. Under such a condition, it is also difficult to preserve the context of the interaction shown in the original motion data, if the retargeting technique that considers only the change of the body shape. Our approach is to separate the problem into two smaller problems and solve them independently. One is to retarget motion data to a new skeleton, and the other is to preserve the context of interactions. We first retarget the given human motion data to the target humanoid body ignoring the interaction with the environment. Then, we precisely deform the shape of the environmental model to match with the humanoid motion so that the original interaction is reproduced. Finally, we set spatial constraints between the humanoid body and the environmental model, and restore the environmental model to the original shape. To demonstrate the usefulness of our method, we conducted an experiment by using the Boston Dynamic's Atlas robot. We expected that out method can help the humanoid motion tracking problem in the future.

본 논문에서는 인체 모션 데이터를 공간적 제약이 많은 환경 속에 있는 휴머노이드의 몸체에 맞추어 리타겟팅하는 기술을 소개한다. 주어진 모션 데이터는 물체를 손으로 잡거나 장애물 사이를 피해 다니는 등의 세밀한 인터랙션을 포함하고 있다고 가정한다. 또한 휴머노이드의 관절 구조는 인체 관절 구조와 다르며 주변 환경의 모양도 원본 모션이 촬영 될 당시와 서로 다르다고 가정한다. 이러한 조건 하에서 단순히 몸체의 변화만 고려한 리타겟팅 기법을 적용한다면 원본 모션 데이터에서 나타난 인터랙션의 내용을 그대로 보존하기 어렵다. 본 논문에서는 모션 데이터를 휴머노이드 몸체에 맞게 리타겟팅하는 문제와 인터랙션의 내용을 보존하는 문제를 나누어서 독립적으로 해결하는 방법을 제안한다. 먼저 환경 모델과의 인터랙션은 무시하고 모션 데이터를 휴머노이드 몸체에 맞게 리타겟팅 한다. 다음, 환경 모델의 모양을 휴머노이드 모션에 부합하도록 변형하여 원본 데이터에서 나타난 인터랙션이 재현되도록 한다. 마지막으로 휴머노이드 몸체와 환경 모델 사이의 공간적 상관 관계에 대한 제약 조건을 설정하고 환경 모델은 다시 원래 모양으로 되돌린다. 보스턴 다이나믹 사의 아틀라스 로봇 모델을 사용한 실험을 통해 제시된 방법의 유용성을 검증하였다. 향후 모션 데이터 트레킹을 통한 휴머노이드 동작 제어 문제에 사용될 수 있을 것으로 기대된다.

Keywords

References

  1. Matsui, Daisuke and Minato, Takashi and MacDorman, Karl F and Ishiguro, Hiroshi, "Generating natural motion in an android by mapping human motion", Intelligent Robots and Systems, 2005. (IROS 2005). 2005 IEEE/RSJ International Conference on, pp. 3301-3308, 2005.
  2. Riley, Marcia and Ude, Ales and Wade, Keegan and Atkeson, Christopher G, "Enabling real-time full-body imitation: a natural way of transferring human movement to humanoids", Robotics and Automation, 2003. Proceedings. ICRA'03. IEEE International Conference on, Vol. 2, pp. 2368-2374, 2003.
  3. Terlemez, Ö mer and Ulbrich, Stefan and Mandery, Christian and Do, Martin and Vahrenkamp, Nikolaus and Asfour, Tamim "Master Motor Map (MMM) - Framwork and Toolkit for Capturing, Representing, and Reproducing Human Motion on Humanoid Robots," Humanoid Robots (Humanoids), 2014 14th IEEE-RAS International Conference on, pp.894-901, 2014.
  4. Ramos, Oscar E and Mansard, Nicolas and Stasse, Olivier and Benazeth, Christophe and Hak, Sovannara and Saab, Layale, "Dancing Humanoid Robots: Systematic Use of OSID to Compute Dynamically Consistent Movements Following a Motion Capture Pattern," IEEE Robotics \& Automation Magazine, Vol. 22, No. 4, pp. 16-26, 2015. https://doi.org/10.1109/MRA.2015.2415048
  5. Di Fava, Alessandro and Bouyarmane, Karim and Chappellet, Kevin and Ruffaldi, Emanuele and Kheddar, Abderrahmane, "Multi-contact motion retargeting from human to humanoid robot," Humanoid Robots (Humanoids), 2016 IEEE-RAS 16th International Conference on, pp. 1081-1086, 2016
  6. Safonova, Alla and Pollard, Nancy and Hodgins, Jessica K, "Optimizing human motion for the control of a humanoid robot." Proc. Applied Mathematics and Applications of Mathematics, Vol. 78, 2003.
  7. Zheng, Yu and Yamane, Katsu, "Human motion tracking control with strict contact force constraints for floating-base humanoid robots." Humanoid Robots (Humanoids), 2013 13th IEEE-RAS International Conference on. pp. 34-41, 2013.
  8. Kim, Mingon and Kim, Sanghyun and Park, Jaeheung, "Human motion imitation for humanoid by Recurrent Neural Network," Ubiquitous Robots and Ambient Intelligence (URAI), 2016 13th International Conference on, pp. 519-520, 2016
  9. Yin, KangKang and Loken, Kevin and van de Panne, Michiel, "SIMBICON: Simple Biped Locomotion Control," ACM Transactions on Graphics (TOG), Vol. 26, No. 3, pp. 105, 2007 https://doi.org/10.1145/1276377.1276509
  10. Sok, Kwang Won and Kim, Manmyung and Lee, Jehee, "Simulating, Biped Behaviors from, Human Motion Data," ACM Transactions on Graphics (TOG), Vol. 26, No. 3, pp. 107, 2007. https://doi.org/10.1145/1276377.1276511
  11. Jain, Sumit and Liu, C Karen, "Controlling physics-based characters using soft contacts." ACM Transactions on Graphics (TOG), Vol. 30, No. 6, pp. 163, 2011
  12. Lee, Yoonsang and Lee, Kyungho and Kwon, Soon-Sun and Jeong, Jiwon and O'Sullivan, Carol and Park, Moon Seok and Lee, Jehee, "Push-Recovery Stability of Biped Locomotion," ACM Transactions on Graphics (TOG), Vol. 34, No. 6, pp. 180, 2015 https://doi.org/10.1145/2816795.2818124
  13. Choi, Myung Geol and Kim, Manmyung and Hyun, Kyung Lyul and Lee, Jehee, "Deformable Motion: Squeezing into Cluttered Environments" Computer Graphics Forum, Vol. 30, No. 2, pp. 445-453, 2011 https://doi.org/10.1111/j.1467-8659.2011.01889.x
  14. Al-Asqhar, Rami Ali and Komura, Taku and Choi, Myung Geol, "Relationship descriptors for interactive motion adaptation," Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 45-53, 2013
  15. Lee, Jehee and Shin, Sung Yong, "A Hierarchical Approach to Interactive Motion Editing for Human-like Characters," Proceedings of the 26th annual conference on Computer graphics and interactive techniques, pp. 39-48, 1999.
  16. Tonneau, Steve and Al-Ashqar, Rami Ali and Pettr{\'e}, Julien and Komura, Taku and Mansard, Nicolas, "Character contact re-positioning under large environment deformation" Computer Graphics Forum, Vol. 35, No. 2, pp. 127-138, 2016 https://doi.org/10.1111/cgf.12817