• Journal of the Korea Society of Computer and Information
• /
• v.29 no.1
• /
• pp.11-19
• /
• 2024

Multi-agent systems can be utilized in various real-world cooperative environments such as battlefield engagements and unmanned transport vehicles. In the context of battlefield engagements, where dense reward design faces challenges due to limited domain knowledge, it is crucial to consider situations that are learned through explicit sparse rewards. This paper explores the collaborative potential among allied agents in a battlefield scenario. Utilizing the Multi-Robot Warehouse Environment(RWARE) as a sparse reward environment, we define analogous problems and establish evaluation criteria. Constructing a learning environment with the QMIX algorithm from the reinforcement learning library Ray RLlib, we enhance the Agent Network of QMIX and integrate Random Network Distillation(RND). This enables the extraction of patterns and temporal features from partial observations of agents, confirming the potential for improving the acquisition of sparse reward experiences through intrinsic rewards.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.19 no.6
• /
• pp.47-55
• /
• 2019

The robot is the creation of new markets and various cooperation according to the manufacturing paradigm shift. Cooperative management easy for existing industrial robots, robots work on productivity, manpower to replace the robot in every industry cooperation for the purpose of and demand increases.to exist But the industrial robot at the scene of the cooperation working due to accidents are frequent, threatening the safety of the operator. Of industrial site is configured with a robot in an environment ensuring the safety of the operator to and confidence to communicate that can do the possibility of action.Robot guard system of the need for development cooperation. The robot's cooperation through the sensors and computer vision task within a radius of the double to prevent accidents and accidents should reduce the risk. International protocol for a variety of industrial production equipment and communications opc ua system based on ultrasonic sensors and cnn to (Convolution Neural Network) for video analytics. We suggest the cooperation with the robot guard system. Robots in a proposed system is unsafe situation of workers evaluating the possibility of control.

• Journal of Electrical Engineering and Technology
• /
• v.6 no.6
• /
• pp.806-816
• /
• 2011

Interest about social security has recently increased in favor of safety for infrastructure. In addition, advances in computer vision and pattern recognition research are leading to video-based surveillance systems with improved scene analysis capabilities. However, such video surveillance systems, which are controlled by human operators, cannot actively cope with dynamic and anomalous events, such as having an invader in the corporate, commercial, or public sectors. For this reason, intelligent surveillance systems are increasingly needed to provide active social security services. In this study, we propose a core technique for intelligent surveillance system that is based on swarm robot technology. We present techniques for invader enclosing using swarm robots based on multiple distributed object environment. The proposed methods are composed of three main stages: location estimation of the object, specified object tracking, and decision of the cooperative behavior of the swarm robots. By using particle filter, object tracking and location estimation procedures are performed and a specified enclosing point for the swarm robots is located on the interactive positions in their coordinate system. Furthermore, the cooperative behaviors of the swarm robots are determined via the result of path navigation based on the combination of potential field and wall-following methods. The results of each stage are combined into the swarm robot-based invader-enclosing technique on multiple distributed object environments. Finally, several simulation results are provided to further discuss and verify the accuracy and effectiveness of the proposed techniques.

• Journal of the Korea Society of Computer and Information
• /
• v.16 no.8
• /
• pp.67-76
• /
• 2011

This study is to analyze the effects on using robots in elementary regular classes. The robots and PC-linked applications were developed considering the school subjects' academic goals and the learners' responses were carefully examined while applying the robots in the class. The image profile after the robot application shows positive feedbacks in most of the contents and some significant differences were found in contents such as 'theoretical-practical', 'uncooperative-cooperative'(p<.05). Moreover, the analysis on the learners' image drawings shows that more robot images are formed related to the concrete learning environment. The learners have answered in an interview to evaluate their understanding of Robot based instruction that both direct and indirect robot experience induce positive participations and provide authentic learning experience. During the robot based instruction, the learners cooperate with their group members and recognize the cooperation as a positive activity. It proves that the robot based instruction can lead to a possibility of new education paradigm.

• The Journal of Korea Robotics Society
• /
• v.2 no.4
• /
• pp.317-326
• /
• 2007

Recently, robotic automation in clinical laboratory becomes of keen interest as a fusion of bio and robotic technology. In this paper, we present a new robotic platform for clinical tests suitable for small or medium sized laboratories using mobile robots. The mobile robot called Mobile Agent is designed as transfer system of blood samples, reagents, microplates, and any instruments. Also, the developed mobile agent can perform diverse tests simultaneously based on its cooperative and distributed ability. The driving circuits for the mobile agent are embedded in the robot, and each mobile agent communicates with other agents by using Bluetooth communication. The RFID system is used to recognize patient information. Also, the magnetic hall sensor is embedded to remove and compensate the cumulated error of locomotion at the bottom of mobile agent. The proposed mobile agent can be easily used for various applications because it is designed to be compatible with general software development tools. The Mobile agents are manufactured, and feasibility of the robot and localization of the agents using magnetic hall sensor are validated by preliminary experiments.

• Journal of Institute of Control, Robotics and Systems
• /
• v.18 no.12
• /
• pp.1122-1131
• /
• 2012

This paper presents obstacle avoidance method for scout robot or industrial robot in unknown environment by using IR sensor and vision system. In the proposed method, robots share the information where the obstacles are located in real-time, thus the robots can choose the best path for obstacle avoidance. Using IR sensor and vision system, multiple robots efficiently evade the obstacles by the proposed cooperation method. No landmark is used at wall or floor in experiment environment. The obstacles don't have specific color or shape. To get the information of the obstacle, vision system extracts the obstacle coordinate by using an image labeling method. The information obtained by IR sensor is about the obstacle range and the locomotion direction to decide the optimal path for avoiding obstacle. The experiment was conducted in $7m{\times}7m$ indoor environment with two-wheeled mobile robots. It is shown that multiple robots efficiently move along the optimal path in cooperation with each other in the space where obstacles are located.

• Proceedings of the Korean Society for Agricultural Machinery Conference
• /
• 2000.11b
• /
• pp.307-312
• /
• 2000

This study was carried out to develop an automatic grafting system suitable for fruit-vegetable seedlings. The study consisted of two research sections: 1) development of a medium-sized, low-cost automatic grafting system for cooperative farms and commercial seedlings production company, and 2) commercializing research for prototype development based on the above concepts. The grafting robot developed in this research can be described as follows, a. Developed grafting robot can cover the whole operations for grafting scion and rootstock, only if operator provides scion and rootstock tray. b. Five seedlings can be grafted at one time, and about 1,200 seedlings can be grafted in one hour. c. The success ratio of mechanical grafting scion and rootstock with ceramic pin bonding provided by the holder is more than 95% when the conditions of seedlings are satisfied. d. The grafting efficiency has improved over 10 times compared with manual work, and the grafting cost generated 44% savings.

• ETRI Journal
• /
• v.37 no.5
• /
• pp.1032-1043
• /
• 2015

ETRI's Co-Pilot project is aimed at the development of an automated vehicle that cooperates with a driver and interacts with other vehicles on the road while obeying traffic rules without collisions. This paper presents a core block within the Co-Pilot system; the block is named "Co-Pilot agent" and consists of several main modules, such as road map generation, decision-making, and trajectory generation. The road map generation builds road map data to provide enhanced and detailed map data. The decision-making, designed to serve situation assessment and behavior planning, evaluates a collision risk of traffic situations and determines maneuvers to follow a global path as well as to avoid collisions. The trajectory generation generates a trajectory to achieve the given maneuver by the decision-making module. The system is implemented in an open-source robot operating system to provide a reusable, hardware-independent software platform; it is then tested on a closed road with other vehicles in several scenarios similar to real road environments to verify that it works properly for cooperative driving with a driver and automated driving.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.22 no.6
• /
• pp.687-693
• /
• 2012

In this paper, we propose a optimal deployment method for cooperative exploration of swarm robots. The proposed method consists of two parts such as optimal deployment and path planning. The optimal area deployment is proposed by the K-mean Algorithm and Voronoi tessellation. The path planning is proposed by the potential field method and A* Algorithm. Finally, the numerical experiments demonstrate the effectiveness and feasibility of the proposed method.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.5 no.2
• /
• pp.151-156
• /
• 2005

This paper proposes a Distributed Autonomous Robotic System(DARS) based on an Artificial Immune System(AIS) and a Classifier System(CS). The behaviors of robots in the system are divided into global behaviors and local behaviors. The global behaviors are actions to search tasks in given environment. These actions are composed of two types: aggregation and dispersion. AIS decides one among these two actions, which robot should select and act on in the global. The local behaviors are actions to execute searched tasks. The robots learn the cooperative actions in these behaviors by the CS in the local one. The proposed system will be more adaptive than the existing system at the viewpoint that the robots learn and adapt the changing of tasks.