• Proceedings of the Korea Society for Simulation Conference
• /
• 2001.10a
• /
• pp.321-324
• /
• 2001

The robot soccer simulation game is a dynamic multi-agent environment. In this paper we suggest a new reinforcement learning approach to each agent's dynamic positioning in such dynamic environment. Reinforcement Beaming is the machine learning in which an agent learns from indirect, delayed reward an optimal policy to choose sequences of actions that produce the greatest cumulative reward. Therefore the reinforcement loaming is different from supervised teaming in the sense that there is no presentation of input-output pairs as training examples. Furthermore, model-free reinforcement loaming algorithms like Q-learning do not require defining or loaming any models of the surrounding environment. Nevertheless it can learn the optimal policy if the agent can visit every state-action pair infinitely. However, the biggest problem of monolithic reinforcement learning is that its straightforward applications do not successfully scale up to more complex environments due to the intractable large space of states. In order to address this problem, we suggest Adaptive Mediation-based Modular Q-Learning(AMMQL) as an improvement of the existing Modular Q-Learning(MQL). While simple modular Q-learning combines the results from each learning module in a fixed way, AMMQL combines them in a more flexible way by assigning different weight to each module according to its contribution to rewards. Therefore in addition to resolving the problem of large state space effectively, AMMQL can show higher adaptability to environmental changes than pure MQL. This paper introduces the concept of AMMQL and presents details of its application into dynamic positioning of robot soccer agents.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.7 no.10
• /
• pp.2376-2394
• /
• 2013

In order to ensure both of the whole system capacity and users QoS requirements in heterogeneous wireless networks, admission control mechanism should be well designed. In this paper, Multi-agent Q-learning based Admission Control Mechanism (MQACM) is proposed to handle new and handoff call access problems appropriately. MQACM obtains the optimal decision policy by using an improved form of single-agent Q-learning method, Multi-agent Q-learning (MQ) method. MQ method is creatively introduced to solve the admission control problem in heterogeneous wireless networks in this paper. In addition, different priorities are allocated to multiple services aiming to make MQACM perform even well in congested network scenarios. It can be observed from both analysis and simulation results that our proposed method not only outperforms existing schemes with enhanced call blocking probability and handoff dropping probability performance, but also has better network universality and stability than other schemes.

• Journal of Internet Computing and Services
• /
• v.5 no.5
• /
• pp.69-77
• /
• 2004

As the internet is widely distributed. the intelligent search agent is commonly used to meet the needs of user. But these Intelligent multi-agents are so independent each other that they can not give reliability of information and also have difficulty in coping with the dynamic distributed environments due to the short of cooperation abilities among multiagent. To resolve these problems. this paper proposes the mechanism for efficient cooperation and information processing by creating agency within broker agent and clustering multi agent's agency using neural network. For reliability of information. we also propose the multiagent management mechanism that can improve the information update problems which are in existing search systems and evaluate the performance of this research through simulation.

• Journal of the Korean Society for Aeronautical & Space Sciences
• /
• v.48 no.8
• /
• pp.573-580
• /
• 2020

One of challengeable problems of multi-agent systems is a positioning control. Augmented Cucker-Smale model is using for controlling position and velocity of the multi-agent system. The original model applies same coefficients to all agents in same group, so that does not consider characteristic of each agent. To enhance performance of the original model, this paper transforms original coefficients to Mahalanobis distance coefficients that reflects an initial distribution of multi-agent systems and applies statistical degrees of freedom. This paper not only confirms tendency of enhanced performance of the suggested model by using monte-carlo simulation, but also additionally compares trajectory of the original model with the suggested model to confirm coefficients of Mahalanobis distance performing correctly.

• Journal of Institute of Control, Robotics and Systems
• /
• v.20 no.5
• /
• pp.526-532
• /
• 2014

In this paper, we present and analyze a LQ (Linear Quadratic) inverse optimal state-consensus protocol for continuous-time multi-agent systems with undirected graph topology. By Lyapunov analysis of the state-consensus error dynamics, we show the sufficient conditions on the algebraic connectivity of the graph to guarantee LQ inverse optimality and closed-loop stability. A more relaxed stability condition is also provided in terms of the algebraic connectivity. Finally, a formation control protocol for multiple mobile robots is proposed based on the target LQ inverse optimal consensus protocol, and the simulation results are provided to verify the performance of the proposed LQ inverse formation control method.

• Journal of Institute of Control, Robotics and Systems
• /
• v.20 no.12
• /
• pp.1231-1237
• /
• 2014

This paper proposes a reduced-order disturbance observer based coordinated tracking controller for uncertain heterogeneous multi-agent systems. To this end, first the control problem is converted as a robust control problem. Then, a dynamic coordinated controller is designed based on the recently proposed reduced-order disturbance observer. Simulation results are given to show the effectiveness of the proposed control scheme.

• Transactions on Control, Automation and Systems Engineering
• /
• v.1 no.2
• /
• pp.147-152
• /
• 1999

It is an interesting area in the field of artifical intelligence to find an analytic model of cooperative structure for multiagent system accomplishing a given task. Usually it is difficult to design controllers for multi-agent systems without a comprehensive knowledge about the system. One of the way to overcome this limitation is to implement an evolutionary approach to design the controllers. This paper introduces the use of a genetic algorithm to discover a fuzzy logic controller with rules that govern emergent agents solving a pursuit problem in a continuous world. Simulation results indicate that, given the complexity of the problem, an evolutionary approach to find the fuzzy logic controller seems to be promising.

• Journal of Institute of Control, Robotics and Systems
• /
• v.18 no.5
• /
• pp.439-444
• /
• 2012

In this study, we address the formation control problem of coupled unicycle-type mobile robots, each of which can interact with its neighboring robots by communicating their position outputs. Each communication link between two mobile robots is assumed to be established according to the given time-varying interconnection topology that switches within a finite set of connected fixed undirected networks and has a non-vanishing dwell time. Under this setup, we propose a distributed formation control algorithm by using the dynamics extension and feedback linearization methods, and by employing a consensus algorithm for linear multi-agent systems which provides arbitrary fast convergence rate to the agreement of the multi-agent system. Finally, the proposed result is demonstrated through a computer simulation.

• Journal of Institute of Control, Robotics and Systems
• /
• v.20 no.12
• /
• pp.1225-1230
• /
• 2014

This paper investigates the group average-consensus and group formation-consensus problems for first-order multi-agent systems. The control protocol for group consensus is designed by considering the positive adjacency elements. Since each intra-group Laplacian matrix cannot be satisfied with the in-degree balance because of the positive adjacency elements between groups, we decompose the Laplacian matrix into an intra-group Laplacian matrix and an inter-group Laplacian matrix. Moreover, average matrices are used in the control protocol to analyze the stability of multi-agent systems with a fixed and undirected communication topology. Using the graph theory and the Lyapunov functional, stability analysis is performed for group average-consensus and group formation-consensus, respectively. Finally, some simulation results are presented to validate the effectiveness of the proposed control protocol for group consensus.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.15 no.12
• /
• pp.7451-7458
• /
• 2014

In this paper, the system modeling and multi-agent control algorithm in isolated wind hybrid power systems are proposed. The multi-agent control is a new type of the hybrid control method that is made up of wind turbine, diesel generator, battery, and dumpload. Fourteen different modes of operations of the wind hybrid power system are performed by wind speed changes and the SOC of battery. Simulation results show that the efficient operations under various wind variations in isolated wind hybrid power systems can be obtained using proposed algorithms.