• Title/Summary/Keyword: Robot Learning

Search Result 855, Processing Time 0.023 seconds

Development of Humanoid Robot HUMIC and Reinforcement Learning-based Robot Behavior Intelligence using Gazebo Simulator (휴머노이드 로봇 HUMIC 개발 및 Gazebo 시뮬레이터를 이용한 강화학습 기반 로봇 행동 지능 연구)

  • Kim, Young-Gi;Han, Ji-Hyeong
    • The Journal of Korea Robotics Society
    • /
    • v.16 no.3
    • /
    • pp.260-269
    • /
    • 2021
  • To verify performance or conduct experiments using actual robots, a lot of costs are needed such as robot hardware, experimental space, and time. Therefore, a simulation environment is an essential tool in robotics research. In this paper, we develop the HUMIC simulator using ROS and Gazebo. HUMIC is a humanoid robot, which is developed by HCIR Lab., for human-robot interaction and an upper body of HUMIC is similar to humans with a head, body, waist, arms, and hands. The Gazebo is an open-source three-dimensional robot simulator that provides the ability to simulate robots accurately and efficiently along with simulated indoor and outdoor environments. We develop a GUI for users to easily simulate and manipulate the HUMIC simulator. Moreover, we open the developed HUMIC simulator and GUI for other robotics researchers to use. We test the developed HUMIC simulator for object detection and reinforcement learning-based navigation tasks successfully. As a further study, we plan to develop robot behavior intelligence based on reinforcement learning algorithms using the developed simulator, and then apply it to the real robot.

Analysis on Psychological and Educational Effects in Children and Home Robot Interaction (아동과 홈 로봇의 심리적.교육적 상호작용 분석)

  • Kim, Byung-Jun;Han, Jeong-Hye
    • Journal of The Korean Association of Information Education
    • /
    • v.9 no.3
    • /
    • pp.501-510
    • /
    • 2005
  • To facilitate interaction between home robot and humans, it's urgently needed to make in-depth research in Human-Robot Interaction(HRI). The purpose of this study was to examine how children interacted with a newly developed home robot named 'iRobi' in a bid to identify how the home robot affected their psychology and the effectiveness of learning through the home robot. Concerning the psychological effects of the home robot, the children became familiar with the robot, and found it possible to interact with it, and their initial anxiety was removed. As to its learning effect, the group that studied by using the home robot outperformed the others utilizing the other types of learning media (books, WBI)in attention, learning interest and academic achievement. Accordingly, home robot could serve as one of successful vehicles to expedite the psychological and educational interaction of children.

  • PDF

Intelligent Control of Robot Manipulators by Learning (학습을 이용한 로봇 머니퓰레이터용 지능제어)

  • Lee DongHun;Kuc TaeYong;Chung ChaeWook
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.11 no.4
    • /
    • pp.330-336
    • /
    • 2005
  • An intelligent control method is proposed for control of rigid robot manipulators which achieves exponential tracking of repetitive robot trajectory under uncertain operating conditions such as parameter uncertainty and unknown deterministic disturbance. In the learning controller, exponentially stable learning algorithms are combined with stabilizing computed error feedforward and feedback inputs. It is shown that all the error signals in the learning system are bounded and the repetitive robot motion converges to the desired one exponentially fast with guaranteed convergence rate. An engineering workstation based control system is built to verify the effectiveness of the proposed control scheme.

Robot learning control with fast convergence (빠른 수렴성을 갖는 로보트 학습제어)

  • 양원영;홍호선
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1988.10a
    • /
    • pp.67-71
    • /
    • 1988
  • We present an algorithm that uses trajectory following errors to improve a feedforward command to a robot in the iterative manner. It has been shown that when the manipulator handles an unknown object, the P-type learning algorithm can make the trajectory converge to a desired path and also that the proposed learning control algorithm performs better than the other type learning control algorithm. A numerical simulation of a three degree of freedom manipulator such as PUMA-560 ROBOT has been performed to illustrate the effectiveness of the proposed learning algorithm.

  • PDF

Redesigning of STEAM Learning/Teaching Program for Robot (로봇 STEAM 교수학습 프로그램 제안)

  • Park, HyunJu;Baek, Yoon Su
    • Journal of Engineering Education Research
    • /
    • v.18 no.6
    • /
    • pp.3-10
    • /
    • 2015
  • The purpose of this study was to analyze STEAM learning/teaching program that relates robots and to develop and redesign STEAM teaching/learning program with a robot for elementary and secondary schools. 'Learning with a robot' is considered as one of the best candidates for STEAM education. This article mainly concerns a robot that can be helpful to improve students' interests in learning science and mathematics in schools. As the results of the STEAM learning/teaching program analyzing, the program for elementary schools contained more contents of liberal arts and fine arts, and the program for secondary schools contained more contents of science, technology, and math. In the middle school program, context for learning, class activities of creative design and emotional touch, evaluation, and job and career information were evenly implemented. In the elementary and high school program, there were few information about robotics career. We extracted all robot utilizable subjects and units from school curriculums, and redesigned contents which can be applicable to regular classes for schools. As the result of this study, we conclude that 'learning with a robot' can encourage students' interests in STEM area.

Qualitative Exploration on Children's Interactions in Telepresence Robot Assisted Language Learning (원격로봇 보조 언어교육의 아동 상호작용 질적 탐색)

  • Shin, Kyoung Wan Cathy;Han, Jeong-Hye
    • Journal of the Korea Convergence Society
    • /
    • v.8 no.3
    • /
    • pp.177-184
    • /
    • 2017
  • The purpose of this study was to explore children and robot interaction in distant language learning environments using three different video-conferencing technologies-two traditional screen-based videoconference technologies and a telepresence robot. One American and six Korean elementary school students participated in our case study. We relied on narratives of one-on-one interviews and observation of nonverbal cues in robot assisted language learning. Our findings suggest that participants responded more positively to interactions via a telepresence robot than to two screen-based video-conferencings, with many citing a stronger sense of immediacy during robot-mediated communications.

Obstacle Avoidance of Mobile Robot Using Reinforcement Learning in Virtual Environment (가상 환경에서의 강화학습을 활용한 모바일 로봇의 장애물 회피)

  • Lee, Jong-lark
    • Journal of Internet of Things and Convergence
    • /
    • v.7 no.4
    • /
    • pp.29-34
    • /
    • 2021
  • In order to apply reinforcement learning to a robot in a real environment, it is necessary to use simulation in a virtual environment because numerous iterative learning is required. In addition, it is difficult to apply a learning algorithm that requires a lot of computation for a robot with low-spec. hardware. In this study, ML-Agent, a reinforcement learning frame provided by Unity, was used as a virtual simulation environment to apply reinforcement learning to the obstacle collision avoidance problem of mobile robots with low-spec hardware. A DQN supported by ML-Agent is adopted as a reinforcement learning algorithm and the results for a real robot show that the number of collisions occurred less then 2 times per minute.

Comparative Analysis of Machine Learning Algorithms for Healthy Management of Collaborative Robots (협동로봇의 건전성 관리를 위한 머신러닝 알고리즘의 비교 분석)

  • Kim, Jae-Eun;Jang, Gil-Sang;Lim, KuK-Hwa
    • Journal of the Korea Safety Management & Science
    • /
    • v.23 no.4
    • /
    • pp.93-104
    • /
    • 2021
  • In this paper, we propose a method for diagnosing overload and working load of collaborative robots through performance analysis of machine learning algorithms. To this end, an experiment was conducted to perform pick & place operation while changing the payload weight of a cooperative robot with a payload capacity of 10 kg. In this experiment, motor torque, position, and speed data generated from the robot controller were collected, and as a result of t-test and f-test, different characteristics were found for each weight based on a payload of 10 kg. In addition, to predict overload and working load from the collected data, machine learning algorithms such as Neural Network, Decision Tree, Random Forest, and Gradient Boosting models were used for experiments. As a result of the experiment, the neural network with more than 99.6% of explanatory power showed the best performance in prediction and classification. The practical contribution of the proposed study is that it suggests a method to collect data required for analysis from the robot without attaching additional sensors to the collaborative robot and the usefulness of a machine learning algorithm for diagnosing robot overload and working load.

Force tracking impedance control of robot by learning of robot-environment dynamics (로봇-작업환경 동역학의 학습에 의한 로봇의 힘 추종 임피이던스 제어)

  • 신상운;최규종;김영원;안두성
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.548-551
    • /
    • 1997
  • Performance of force tracking impedance control of robot manipulators is degraded by the uncertainties in the robot and environment dynamic model. The purpose of this paper is to improve the controller robustness by applying neural network. Neural networks are designed to learn the uncertainties in robot and environment model for compensating the uncertainties. The proposed scheme is verified through the simulation of 20DOF robot manipulator.

  • PDF

Design and Development of Robot Command Card for Coding Learning

  • Han, Sun-Gwan
    • Journal of the Korea Society of Computer and Information
    • /
    • v.23 no.1
    • /
    • pp.49-55
    • /
    • 2018
  • In this paper, we propose a design and development of instructional cards to understand the grammar of coding, solving the problems and extending the computational thinking in the robot-driven environment. First, we designed the input/output module of the robot to process the coding grammar through the function analysis of the robot. And we designed the module of command card to learn coding grammar using color sensors. We have proven the validity of the designed instruction card by examining the experts to see if it is suitable for coding grammar learning. Designed robot and command card were developed with 28 cards and sensor robot. After applying the developed robot and command card to the elementary school students, the questionnaire showed that students grow the understanding and confidence of coding. In addition, students showed an increased need for programming learning.