• 제어로봇시스템학회:학술대회논문집
• /
• 2001.10a
• /
• pp.164.1-164
• /
• 2001

Q-learning is a recent reinforcement learning algorithm that does not need a modeling of environment and it is a suitable approach to learn behaviors for autonomous agents. But when it is applied to multi-agent learning with many I/O states, it is usually too complex and slow. To overcome this problem in the multi-agent learning system, we propose the successive Q-learning algorithm. Successive Q-learning algorithm divides state-action pairs, which agents can have, into several Q-functions, so it can reduce complexity and calculation amounts. This algorithm is suitable for multi-agent learning in a dynamically changing environment. The proposed successive Q-learning algorithm is applied to the prey-predator problem with the one-prey and two-predators, and its effectiveness is verified from the efficient avoidance ability of the prey agent.

• Journal of Korea Multimedia Society
• /
• v.6 no.5
• /
• pp.937-944
• /
• 2003

The most important problems in the multi-agent system are to accomplish a gnat through the efficient coordination of several agents and to prevent collision with other agents. In this paper, we propose a new control strategy for succeeding the goal of a prey pursuit problem efficiently Our control method uses reinforcement learning to control the multi-agent system and consider the distance as well as the space relationship among the agents in the state space of the prey pursuit problem.

• Journal of Internet Computing and Services
• /
• v.9 no.1
• /
• pp.137-143
• /
• 2008

In ubiquitous environment the multi-agent system is effective for providing intelligent services. In this paper we introduce a new scheduling service model for improving the communication performance in the multi-agent system. It is achieved by assigning a priority to the message according to the weight of formalized ACL message and the number of messages exchanged between the agents. An experiment reveals that the proposed approach allows smaller processing time per message and turnaround time than the scheduling with the existing JADE platform. Moreover, the proposed scheme allows a scalable messaging system.

• Journal of Institute of Control, Robotics and Systems
• /
• v.16 no.3
• /
• pp.222-226
• /
• 2010

In this paper we study the consensus problem of SISO (Single-Input Single-Output) linear multi-agent systems under a fixed weighted undirected network communication. The dynamics of each agent can be of any order, while it is constrained to be neutrally stable. Based on a simple root locus argument, we show that the problem at hand is always solvable if the gain and zeros of the dynamic compensator, of which dimension is the same as the number of plant poles on the imaginary axis, are chosen suitably, finally the result is successfully verified by an example.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.60 no.3
• /
• pp.625-631
• /
• 2011

This paper presents a discrete-time output feedback consensus algorithm for Multi-Agent Systems (MAS). Under the assumption that an agent is aware of the relative state information about its neighbors, a state feedback consensus algorithm is designed based on Linear Matrix Inequality (LMI) method. In general, however, it is possible to obtain its relative output information rather than the relative state information. To reconcile this problem, an Unknown Input Observer (UIO) is employed in this paper. To this end, first it is shown that the relative state information can be estimated using the UIO and the measured relative output information. Then a certainty-equivalence type output feedback consensus algorithm is proposed by combining the LMI-based state feedback consensus algorithm with the UIO. Finally, simulation results are given to illustrate that the proposed method successfully achieves the state consensus.

• Journal of information and communication convergence engineering
• /
• v.17 no.3
• /
• pp.167-173
• /
• 2019

This study investigates the problem of leader-following consensus for multi-agent systems with output saturations. This study assumes that the agents are described as a neutrally stable system, and the leader agent generates the bounded trajectory within the saturation level. Then, the objective of the leader-following consensus is to track the trajectory of the leader by exchanging information with neighbors. To solve this problem, we propose an observer-based distributed consensus algorithm. Then, we provide a consensus analysis by applying the Lyapunov stability theorem and LaSalle's invariance principle. The result shows that the agents achieve the leader-following consensus in a global sense. Moreover, we can achieve the consensus by choosing any positive control gain. Finally, we perform a numerical simulation to demonstrate the validity of the proposed algorithm.

• International conference on construction engineering and project management
• /
• 2009.05a
• /
• pp.1359-1363
• /
• 2009

The object of this research is to develop a simulation system for earthmoving operations in consideration of the impact of congestion in-between equipment and existing traffic flow around the site. The congestion in-between equipment and traffic flow affect work productivity. The conventional discrete event simulation, however, has limitations in simulating the flow of construction equipment. To consider the impact of congestion in-between equipment and existing traffic flow, in this paper, a multi-agent based simulation model that can realize characteristics of truck behavior more accurately to consider the impact of congestion was proposed. In this simulation model, multiple agents can identify environmental changes and adapt themselves to the new environment. This modeling approach is a better choice for this problem since it describes behavioral characteristics of each agent by sensing changes in dynamic surroundings. This study suggests a detailed system design of the multi-agent based simulation system.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.12 no.2
• /
• pp.109-114
• /
• 2002

E-commerce customers can reduce purchasing cost by the help of comparison shopping agents that collect price information of products in the shopping malls. However, user expects a software agent that can recommend product information satisfying various purchase conditions besides price. In this paper, we present a MAS (multi-agent system) which retrieves and recommends book information suitable for various user needs to realize an agent-based E-Commerce. We implemented and tested our MAS to help on-line bookstore customers. From the results, we could provide E-commerce customers various book purchase conditions for several online bookstores in real-time.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.10 no.3
• /
• pp.11-28
• /
• 2000

In these days it is rapidly increasing that multi-user, multi-layered commercial software developments for companies or public institutions. Security services are necessary for most of systems and the access control service is the essential of security services. Current access control methods that are used as access control policies are classified as Discretionary Access Control Mandatory Access Control and Role Based Access Control. However there are some inefficiencies when those methods are applied to current multi-user, multi-layered systems. Therefore it is required that a new access control method that takes complex system resources into account from the side of policy. In this paper extending previous Role Based of 'Behavior' and a basic model of the method. And we simply implement the method on the mobile agent based workflow management system that is a representative example of multi-user. multi-layered softwares and shows implementation results to tap possibilities of real-world application.

• 제어로봇시스템학회:학술대회논문집
• /
• 2005.06a
• /
• pp.1938-1943
• /
• 2005

Network human-robot interface is an important research topic. In home application, users access the robotic system directly via voice, gestures or through the network. Users explore a system by using the services provided by this system and to some extend users are enable to participate in a service as partners. A service may be provided by a robot, a group of robots or robots and other network connected systems (distributed sensors, information systems, etc). All these services are done in the network environment, where uncertainty such as the unstable network connection, the availability of the partners in a service, exists. Moreover, these services are controlled by several users, accessing at different time by different methods. Our research aimed at solving this problem to provide a high available level, flexible coordination system. In this paper, a multi-agent framework is proposed. This framework is validated by using our new concept of slave agents, a responsive multi-agent environment, a virtual directory facilitator (VDF), and a task allocation system using contract net protocol. Our system uses a mixed model between distributed and centralized model. It uses a centralized agent management system (AMS) to control the overall system. However, the partners and users may be distributed agents connected to the center through agent communication or centralized at the AMS container using the slave agents to represent the physical agents. The system is able to determine the task allocation for a group of robot working as a team to provide a service. A number of experiments have been conducted successfully in our lab environment using Issac robot, a PDA for user agent and a wireless network system, operated under our multi agent framework control. The experiments show that this framework works well and provides some advantages to existing systems.