• Journal of Institute of Control, Robotics and Systems
• /
• v.8 no.7
• /
• pp.607-612
• /
• 2002

An automatic design method of behaviors in behavior-based robotics is proposed. With this method, a robot can design its behaviors by itself without aids of human designer. Automating design procedure of behaviors can make the human designer free from somewhat tedious endeavor that requires to predict all possible situations in which the robot will work and to design a suitable behavior for each situation. A simple reinforcement learning strategy is the main frame of this method and the key parameter of the learning process is significant change of reward value. A successful application to mobile robot navigation is reported too.

• The Journal of Korea Robotics Society
• /
• v.18 no.4
• /
• pp.463-471
• /
• 2023

This paper proposes a method to estimate the level of interest shown by visitors towards a specific target, a guide robot, in spaces where a large number of visitors, such as exhibition halls and museums, can show interest in a specific subject. To accomplish this, we apply deep learning-based behavior recognition and object tracking techniques for multiple visitors, and based on this, we derive the behavior analysis and interest level of visitors. To implement this research, a personalized dataset tailored to the characteristics of exhibition hall and museum environments was created, and a deep learning model was constructed based on this. Four scenarios that visitors can exhibit were classified, and through this, prediction and experimental values were obtained, thus completing the validation for the interest estimation method proposed in this paper.

• Journal of Institute of Control, Robotics and Systems
• /
• v.20 no.6
• /
• pp.599-605
• /
• 2014

This paper presents the interactive behavior modeling method based on POMDP (Partially Observable Markov Decision Process) for HRI (Human-Robot Interaction). HRI seems similar to conversational interaction in point of interaction between human and a robot. The POMDP has been popularly used in conversational interaction system. The POMDP can efficiently handle uncertainty of observable variables in conversational interaction system. In this paper, the input variables of the proposed conversational HRI system in POMDP are the input information of sensors and the log of used service. The output variables of system are the name of robot behaviors. The robot behavior presents the motion occurred from LED, LCD, Motor, sound. The suggested conversational POMDP-based HRI system was applied to an emotional robot KIBOT. In the result of human-KIBOT interaction, this system shows the flexible robot behavior in real world.

• Journal of Institute of Control, Robotics and Systems
• /
• v.13 no.8
• /
• pp.760-768
• /
• 2007

This paper introduces an emotional behavior decision model based on linear system for intelligent service robots. An emotional model should make different behavior decisions according to the purpose of the robots. We propose an emotional behavior decision model which can change the character of intelligent service robots and make different behavior decisions although the situation and environment remain the same. We defined each emotional element such as reactive dynamics, internal dynamics, emotional dynamics, and behavior dynamics by state dynamic equations. The proposed system model is a linear dynamic system. If you want to add one external stimulus or behavior, you need to add just one dimensional vector to the matrix of external stimulus or behavior dynamics. The case of removing is same. The change of reactive dynamics, internal dynamics, emotional dynamics, and behavior dynamics also follows the same procedure. We implemented a cyber robot and an emotional head robot using 3D character for verifying the performance of the proposed emotional behavior decision model.

• Journal of Institute of Control, Robotics and Systems
• /
• v.6 no.12
• /
• pp.1079-1085
• /
• 2000

In this paper, we propose a method of cooperative control (T-cell modeling) and selection of group behavior strategy (B-cell modeling) based on immune system in distributed autonomous robotic system (DARS). An immune system is the living bodys self-protection and self-maintenance system. these features can be applied to decision making of the optimal swarm behavior in a dynamically changing environment. For applying immune system to DARS, a robot is regarded as a B-cell, each environmental condition as an antigen, a behavior strategy as an antibody, and control parameter as a T-cell, respectively. When the environmental condition (antigen) changes, a robot selects an appropriate behavior strategy (antibody). And its behavior strategy is stimulated and suppressed by other robots using communication (immune network). Finally, much stimulated strategy is adopted as a swarm behavior strategy. This control scheme is based on clonal selection and immune network hypothesis, and it is used for decision making of the optimal swarm strategy. Adaptation ability of the robot is enhanced by adding T-cell model as a control parameter in dynamic environments.

• Journal of Institute of Control, Robotics and Systems
• /
• v.9 no.7
• /
• pp.527-535
• /
• 2003

A behavior-based control and learning architecture is proposed, where reinforcement learning is applied to learn proper associations between stimulus and response by using two types of memory called as short Term Memory and Long Term Memory. In particular, to solve delayed-reward problem, a knowledge-propagation (KP) method is proposed, where well-designed or well-trained S-R(stimulus-response) associations for low-level sensors are utilized to learn new S-R associations for high-level sensors, in case that those S-R associations require the same objective such as obstacle avoidance. To show the validity of our proposed KP method, comparative experiments are performed for the cases that (ⅰ) only a delayed reward is used, (ⅱ) some of S-R pairs are preprogrammed, (ⅲ) immediate reward is possible, and (ⅳ) the proposed KP method is applied.

• The Journal of Korea Robotics Society
• /
• v.16 no.3
• /
• pp.260-269
• /
• 2021

To verify performance or conduct experiments using actual robots, a lot of costs are needed such as robot hardware, experimental space, and time. Therefore, a simulation environment is an essential tool in robotics research. In this paper, we develop the HUMIC simulator using ROS and Gazebo. HUMIC is a humanoid robot, which is developed by HCIR Lab., for human-robot interaction and an upper body of HUMIC is similar to humans with a head, body, waist, arms, and hands. The Gazebo is an open-source three-dimensional robot simulator that provides the ability to simulate robots accurately and efficiently along with simulated indoor and outdoor environments. We develop a GUI for users to easily simulate and manipulate the HUMIC simulator. Moreover, we open the developed HUMIC simulator and GUI for other robotics researchers to use. We test the developed HUMIC simulator for object detection and reinforcement learning-based navigation tasks successfully. As a further study, we plan to develop robot behavior intelligence based on reinforcement learning algorithms using the developed simulator, and then apply it to the real robot.

• 제어로봇시스템학회:학술대회논문집
• /
• 2004.08a
• /
• pp.1776-1780
• /
• 2004

In this paper, we propose the new emotion model and the robot behavior decision model based on proposed emotion model. As like in human, emotions are hierarchicalized in four levels (momentary emotions, mood, attitude, and personality) and are determined from the robot behavior and human responses. They are combined with motivation (which is determined from the external stimuli) to determine the robot behavior.

• Journal of Institute of Control, Robotics and Systems
• /
• v.11 no.12
• /
• pp.984-990
• /
• 2005

The aim of this paper is to investigate a control framework for mobile robots, operating in shared environment with humans. The Intelligent Space (iSpace) can sense the whole space and evaluate the situations in the space by distributing sensors. The mobile agents serve the inhabitants in the space utilizes the evaluated information by iSpace. The iSpace evaluates the situations in the space and learns the walking behavior of the inhabitants. The human intelligence manifests in the space as a behavior, as a response to the situation in the space. The iSpace learns the behavior and applies to mobile agent motion planning and control. This paper introduces the application of fuzzy-neural network to describe the obstacle avoidance behavior teamed from humans. Simulation results are introduced to demonstrate the efficiency of this method.

• Journal of Institute of Control, Robotics and Systems
• /
• v.9 no.10
• /
• pp.789-797
• /
• 2003

An implementation scheme and some improvements are proposed to adopt public-licensed operating system, Linux and de-facto world-wide network standard, TCP/IP into the field of behavior-based autonomous mobile robots. To demonstrate the needs of scheme and the improvement, an analysis is performed on a server/client communication problem with real time Linux previously proposed, and another analysis is also performed on interactions among TCP/IP communications and the performance of Linux system using them. Implementation of behavior-based control architecture on real time Linux is proposed firstly. Revised task-scheduling schemes are proposed that can enhance the performance of server/client communication among local tasks on a Linux platform. A new method of TCP/IP packet flow handling is proposed that prioritizes TCP/IP software interrupts with aperiodic server mechanism as well. To evaluate the implementation scheme and the proposed improvements, performance enhancements are shown through some simulations.