• Title/Summary/Keyword: multi-agent control

Search Result 195, Processing Time 0.036 seconds

Cooperative Multi-Agent Reinforcement Learning-Based Behavior Control of Grid Sortation Systems in Smart Factory (스마트 팩토리에서 그리드 분류 시스템의 협력적 다중 에이전트 강화 학습 기반 행동 제어)

  • Choi, HoBin;Kim, JuBong;Hwang, GyuYoung;Kim, KwiHoon;Hong, YongGeun;Han, YounHee
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.9 no.8
    • /
    • pp.171-180
    • /
    • 2020
  • Smart Factory consists of digital automation solutions throughout the production process, including design, development, manufacturing and distribution, and it is an intelligent factory that installs IoT in its internal facilities and machines to collect process data in real time and analyze them so that it can control itself. The smart factory's equipment works in a physical combination of numerous hardware, rather than a virtual character being driven by a single object, such as a game. In other words, for a specific common goal, multiple devices must perform individual actions simultaneously. By taking advantage of the smart factory, which can collect process data in real time, if reinforcement learning is used instead of general machine learning, behavior control can be performed without the required training data. However, in the real world, it is impossible to learn more than tens of millions of iterations due to physical wear and time. Thus, this paper uses simulators to develop grid sortation systems focusing on transport facilities, one of the complex environments in smart factory field, and design cooperative multi-agent-based reinforcement learning to demonstrate efficient behavior control.

Design of RCGA-based PID controller for two-input two-output system

  • Lee, Yun-Hyung;Kwon, Seok-Kyung;So, Myung-Ok
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.39 no.10
    • /
    • pp.1031-1036
    • /
    • 2015
  • Proportional-integral-derivative (PID) controllers are widely used in industrial sites. Most tuning methods for PID controllers use an empirical and experimental approach; thus, the experience and intuition of a designer greatly affect the tuning of the controller. The representative methods include the closed-loop tuning method of Ziegler-Nichols (Z-N), the C-C tuning method, and the Internal Model Control tuning method. There has been considerable research on the tuning of PID controllers for single-input single-output systems but very little for multi-input multi-output systems. It is more difficult to design PID controllers for multi-input multi-output systems than for single-input single-output systems because there are interactive control loops that affect each other. This paper presents a tuning method for the PID controller for a two-input two-output system. The proposed method uses a real-coded genetic algorithm (RCGA) as an optimization tool, which optimizes the PID controller parameters for minimizing the given objective function. Three types of objective functions are selected for the RCGA, and each PID controller parameter is determined accordingly. The performance of the proposed method is compared with that of the Z-N method, and the validity of the proposed method is examined.

A preliminary evaluation on mixed probiotics as an antimicrobial spraying agent in growing pig barn

  • Shanmugam, Sureshkumar;Jae Hong, Park;In Ho, Kim
    • Journal of Animal Science and Technology
    • /
    • v.64 no.6
    • /
    • pp.1035-1045
    • /
    • 2022
  • The purpose of this study is to examine whether spraying an anti-microbial agent into the slurry pit will reduce the noxious odor substances from piggery barns. For this, a total of 200 crossbred ([Landrace × Yorkshire] × Duroc) growing pigs with an initial average body weight (BW) of 23.58 ± 1.47 kg were selected and housed in two different rooms, i.e. control (CON) and treatment (TRT). Each room has 100 pigs (60 gilts and 40 borrows). For a period of 42 days, all pigs were fed with corn-soybean meal-based basal diet. Later the noxious odor substances were measured by the following methods. First, fecal samples were randomly collected and stored in sealed and unsealed containers, and sprayed with the non-anti-microbial agent (NAMA) (saline water) and multi-bacterial spraying (MBS) agent (200 :1, mixing ratio-fecal sample : probiotic), Second, the slurry pit of CON and TRT rooms were directly sprayed with NAMA and MBS, respectively. The fecal sample that was stored in sealed and un-sealed containers and sprayed with MBS significantly reduced NH3 and CO2 concentration at the end of day 7. However, at the end of day 42, the fecal sample showed a lower H2S, methyl mercaptans, acetic acid, and CO2 concentration compared to the unsealed container. Moreover, at the end of days 7, 14, 21, 28, 35, and 42 compared to the CON room and TRT room slurry pit emits lower concentrations of NH3, acetic acid, H2S, and methyl mercaptans, and CO2 into the atmosphere. Based on the current findings, we infer that spraying anti-microbial agents on pig dung would be one of the better approaches to suppress the odor emission from the barn in the future.

A Multiagent System for Workflow-Based Bioinformatics Tool Integration

  • Sohn, Bong-Ki;Lee, Keon-Myung;Kim, Hak-Joon
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.3 no.2
    • /
    • pp.133-137
    • /
    • 2003
  • Various bioinformatics tools for biological data processing have been developed and most of them are available in public. Most bioinformatics works are carried out by a composite application of those tools. Several integration approaches have been proposed for easy use of the tools. This paper proposes a new multi agent system to integrate bioinformatics tools in the perspective of workflow since the composite applications of tools can be regarded as workflows. For the easy integration, the proposed system employs wrapper agents for existing tools, uses XML-based messages in the inter-agent communication, and agents are supposed to extract necessary information from the received messages. This allows new tools to be easily added on the integration framework. The proposed method allows various control structures in workflow definition and provides the progress monitoring capability of the on-going workflows. In particular, agents in this system have the rule-based architecture which allows the defined rule set to be a special role agent. This feature provides fast and flexible agent development to aid in managing the complexity of bioinformatics application. This system has been partially implemented and has been proven to be a viable implementation for workflow-based bioinformatics tool integration.

Development of Pilot Plant for Distributed Intelligent Management System of Microgrids (멀티에이전트 시스템을 이용한 마이크로그리드 분산 지능형 관리시스템 파일럿 플랜트 개발)

  • Oh, Sang-Jin;Yoo, Cheol-Hee;Chung, Il-Yop;Lim, Jae-Bong
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.62 no.3
    • /
    • pp.322-331
    • /
    • 2013
  • This paper describes the development of the pilot plant of distributed intelligent management system for a microgrid. For optimal control and management of microgrids, intelligent agents area applied to the microgrid management system. Each agent includes intelligent algorithms to make decisions on behalf of the corresponding microgrid entity such as distributed generators, local loads, and so on. To this end, each agent has its own resources to evaluate the system conditions by collecting local information and also communicating with other agents. This paper presents key features of the data communication and management of the developed pilot plant such as the construction of mesh network using local wireless communication techniques, the autonomous agent coordination schemes using plug-and-play functions of agents and contract net protocol (CNP) for decision-making. The performance of the pilot plant and developed algorithms are verified via real-time microgrid test bench based on hardware-in-the-loop simulation systems.

Adaptive Sliding-Mode Formation Control and Collision Avoidance for Multi-agent Nonholonomic Mobile Robots with Model Uncertainty and Disturbance (모델 불확실성 및 외란을 갖는 이동 로봇들을 위한 적응 슬라이딩 모드 군집 제어 및 충돌 회피 기법)

  • Park, Bong-Seok;Park, Jin-Bae
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.16 no.11
    • /
    • pp.1038-1043
    • /
    • 2010
  • In this paper, an adaptive sliding-mode formation control and collision avoidance are proposed for electrically driven nonholonomic mobile robots with model uncertainties and external disturbances. A sliding surface based on the leader-follower approach is developed to achieve the desired formation in the presence of model uncertainties and disturbances. Moreover, by using the collision avoidance function, the mobile robots can avoid the obstacles successfully. Finally, simulations illustrate the effectiveness of the proposed control system.

Implementation of MAPF-based Fleet Management System (다중에이전트 경로탐색(MAPF) 기반의 실내배송로봇 군집제어 구현)

  • Shin, Dongcheol;Moon, Hyeongil;Kang, Sungkyu;Lee, Seungwon;Yang, Hyunseok;Park, Chanwook;Nam, Moonsik;Jung, Kilsu;Kim, Youngjae
    • The Journal of Korea Robotics Society
    • /
    • v.17 no.4
    • /
    • pp.407-416
    • /
    • 2022
  • Multiple AMRs have been proved to be effective in improving warehouse productivity by eliminating workers' wasteful walking time. Although Multi-agent Path Finding (MAPF)-based solution is an optimal approach for this task, its deployment in practice is challenging mainly due to its imperfect plan-execution capabilities and insufficient computing resources for high-density environments. In this paper, we present a MAPF-based fleet management system architecture that robustly manages multiple robots by re-computing their paths whenever it is necessary. To achieve this, we defined four events that trigger our MAPF solver framework to generate new paths. These paths are then delivered to each AMR through ROS2 message topic. We also optimized a graph structure that effectively captures spatial information of the warehouse. By using this graph structure we can reduce computational burden while keeping its rescheduling functionality. With proposed MAPF-based fleet management system, we can control AMRs without collision or deadlock. We applied our fleet management system to the real logistics warehouse with 10 AMRs and observed that it works without a problem. We also present the usage statistic of adopting AMRs with proposed fleet management system to the warehouse. We show that it is useful over 25% of daily working time.

A Swarm System Design Based on Coupled Nonlinear Oscillators for Cooperative Behavior

  • Kim, Dong-Hun
    • International Journal of Control, Automation, and Systems
    • /
    • v.1 no.3
    • /
    • pp.301-307
    • /
    • 2003
  • A control system design based on coupled nonlinear oscillators (CNOs) for a self- organized swarm system is presented. In this scheme, agents self-organize to flock and arrange group formations through attractive and repulsive forces among themselves using CNOs. Virtual agents are also used to create richer group formation patterns. The objective of the swarm control in this paper is to follow a moving target with a final group formation in the shortest possible time despite some obstacles. The simulation results have shown that the proposed scheme can effectively construct a self-organized multi-agent swarm system capable of group formation and group immigration despite the emergence of obstacles.

A Study on Processor Monitoring for Integration Test of Flight Control Computer equipped with A Modern Processor (최신 프로세서 탑재 비행제어 컴퓨터의 통합시험을 위한 프로세서 모니터링 연구)

  • Lee, Cheol;Kim, Jae-Cheol;Cho, In-Jae
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.14 no.10
    • /
    • pp.1081-1087
    • /
    • 2008
  • This paper describes limitations and solutions of the existing processor-monitoring concept for a military supersonics aircraft Flight Control Computer (FLCC) equipped with modern architecture processor to perform the system integration test. Safecritical FLCC integration test, which requires automatic test for thousands of test cases and real-time input/output test condition generation, depends on the processor-monitoring device called Processor Interface (PI). The PI, which relies upon on the FLCC processor's external address and data-bus data, has some limitations due to multi-fetching capability of the modern sophisticated military processors, like C6000's VLIW (Very-Long Instruction Word) architecture and PowerPC's Superscalar architecture. Several techniques for limitations were developed and proper monitoring approach was presented for modem processor-adopted FLCC system integration test.

The design of controllers for soccer robots (축구 로봇을 위한 제어기 설계)

  • 김광춘;김동한;김종환
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.612-616
    • /
    • 1997
  • In this paper, two kinds of controller are proposed for a soccer robot system.. One for Supervisor and defense mode, and the other for attack mode. Robot soccer game has very dynamic characteristics. Furthermore, there exist competitions between agents. The soccer-playing robot should take an appropriate action according to its surroundings. Initially, an attack mode controller using a vector field concept is designed, then a supervisor and a defense mode controller are designed with a Petri-net. The efficiency and applicability of the proposed controllers are demonstrated through a real robot soccer game(MiroSot 97).

  • PDF