• Title/Summary/Keyword: Multi-Agent Technology

Search Result 244, Processing Time 0.026 seconds

Explicit Dynamic Coordination Reinforcement Learning Based on Utility

  • Si, Huaiwei;Tan, Guozhen;Yuan, Yifu;peng, Yanfei;Li, Jianping
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.16 no.3
    • /
    • pp.792-812
    • /
    • 2022
  • Multi-agent systems often need to achieve the goal of learning more effectively for a task through coordination. Although the introduction of deep learning has addressed the state space problems, multi-agent learning remains infeasible because of the joint action spaces. Large-scale joint action spaces can be sparse according to implicit or explicit coordination structure, which can ensure reasonable coordination action through the coordination structure. In general, the multi-agent system is dynamic, which makes the relations among agents and the coordination structure are dynamic. Therefore, the explicit coordination structure can better represent the coordinative relationship among agents and achieve better coordination between agents. Inspired by the maximization of social group utility, we dynamically construct a factor graph as an explicit coordination structure to express the coordinative relationship according to the utility among agents and estimate the joint action values based on the local utility transfer among factor graphs. We present the application of such techniques in the scenario of multiple intelligent vehicle systems, where state space and action space are a problem and have too many interactions among agents. The results on the multiple intelligent vehicle systems demonstrate the efficiency and effectiveness of our proposed methods.

A study on Service Restoration Systems for Power Distribution Networks by Applying Multi-Agent System (멀티에이전트 시스템을 이용한 배전계통 사고복구시스템에 관한 연구)

  • Jung K.H.;Choi M.S.;Lee S.J.
    • Proceedings of the KIEE Conference
    • /
    • summer
    • /
    • pp.403-405
    • /
    • 2004
  • A service restoration is one of the most important missions in distribution system operation. This paper proposes a multi-agent system approach to distribution system restoration. Every relay is developed as an agent by adding its own intelligent, self-tuning and communication ability. Relay agent calculates and corrects its restoration index by itself through communication with neighboring agents and its own intelligence. The proposed algorithm is applied to a simple network to show how to calculate restoration index. Keywords Multi-Agent System, Service Restoration, Distribution Networks

  • PDF

Multi-agent Q-learning based Admission Control Mechanism in Heterogeneous Wireless Networks for Multiple Services

  • Chen, Jiamei;Xu, Yubin;Ma, Lin;Wang, Yao
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.7 no.10
    • /
    • pp.2376-2394
    • /
    • 2013
  • In order to ensure both of the whole system capacity and users QoS requirements in heterogeneous wireless networks, admission control mechanism should be well designed. In this paper, Multi-agent Q-learning based Admission Control Mechanism (MQACM) is proposed to handle new and handoff call access problems appropriately. MQACM obtains the optimal decision policy by using an improved form of single-agent Q-learning method, Multi-agent Q-learning (MQ) method. MQ method is creatively introduced to solve the admission control problem in heterogeneous wireless networks in this paper. In addition, different priorities are allocated to multiple services aiming to make MQACM perform even well in congested network scenarios. It can be observed from both analysis and simulation results that our proposed method not only outperforms existing schemes with enhanced call blocking probability and handoff dropping probability performance, but also has better network universality and stability than other schemes.

Development of a Synthetic Multi-Agent System;The KMITL Cadence 2003 Robotic Soccer Simulation Team, Intelligent and AI Based Control

  • Chitipalungsri, Thunyawat;Jirawatsiwaporn, Chawit;Tangchupong, Thanapon;Kittitornkun, Surin
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2004.08a
    • /
    • pp.879-884
    • /
    • 2004
  • This paper describes the development of a synthetic multi-agent called KMITL Cadence 2003. KMITL Cadence 2003 is a robotic soccer simulation team consisting of eleven autonomous software agents. Each agent operates in a physical soccer simulation model called Robocup Soccer Server which provides fully distributed and real-time multi-agent system environment. All teammates have to cooperate to achieve the common goal of winning the game. The simulation models many aspects of the football field such as noise in ball movements, noisy sensors, unreliable communication channel between teammates and actuators, limited physical abilities and restricted communication. This paper addresses the algorithm to develop the soccer agents to perform basic actions which are scoring, passing ball and blocking the opponents effectively. The result of this development is satisfactory because the successful scoring attempts is increased from 11.1% to 33.3%, successful passing ball attempts is increased from 22.08% to 63.64%, and also, successful intercepting attempts is increased from 88% to 97.73%.

  • PDF

Use of Software Agent Technology in Management Information System: A Literature Review and Classification

  • Hamirahanim Abdul Rahman;Jinsoo Park;Jihae Suh
    • Asia pacific journal of information systems
    • /
    • v.29 no.1
    • /
    • pp.65-82
    • /
    • 2019
  • Technological innovations over the years have accentuated the workings in corporate- connected organizations and different application platforms. Hence, a unified management information system (MIS) that can utilize the Web and propel programming developments is required. Software agents, the latest developments in computer software technology, can be utilized to rapidly and effortlessly build integrated information systems. Consequently, 59 research papers on the use of software agents in MIS were identified from top 40 MIS journals published between 2007 and 2017. Then, we reviewed and classified all the research papers according to two categories: application fields and application categories. The application fields consisted of eight sub-groups: manufacturing, telecommunication systems, traffic and transportation management, information filtering and gathering, electronic commerce, business process management, entertainment, and medical care; whereas the application categories consisted of three sub-groups: multi-agent systems, personal assistants, and multi-agent simulation. The research papers were further divided into journal and year of publication, and journal and application field. The objective of our research was to understand the trend of the use software agent technology in MIS by examining the published research paper beside to add knowledge and content to the information system academic discipline.

Multi-Agent System having Adaptive Over Current Protection Function for Power Distribution Systems (멀티 에이전트 시스템 (Multi-Agent System)을 이용한 배전계통의 적응 과전류보호)

  • Chang, Choong-Koo;Lee, Seung-Jae;Lim, Dong-Jin
    • The Transactions of the Korean Institute of Electrical Engineers A
    • /
    • v.50 no.8
    • /
    • pp.365-372
    • /
    • 2001
  • This paper presents a new protection concept to achieve the adaptive optimal function by introducing the multi-agent system technology. Making each relay an agent which consists of relay agent module and coordinator module, each agent works autonomously to improve protection capability by cooperating with other agents. It is applied to the overcurrent protection system of the industrial power system in order to show the feasibility of the proposed methodology.

  • PDF

A Multi-Agent Approach to Context-Aware Optimization for Personalized Mobile Web Service (상황인지 기반 최적화가 가능한 개인화된 모바일 웹서비스 구축을 위한 다중에이전트 접근법에 관한 연구)

  • Kwon Oh-byung;Lee Ju-chul
    • Korean Management Science Review
    • /
    • v.21 no.3
    • /
    • pp.23-38
    • /
    • 2004
  • Recently the usage of mobile devices which enable the accessibility to Internet has been dramatically increased. Most of the mobile services, however, so far tend to be simple such as infotainment service. In order to fully taking advantage of wireless network and corresponding technology, personalized web service based on user's context could be needed. Meanwhile, optimization techniques have been vitally incorporated for optimizing the development and administration of electronic commerce. However, applying context-aware optimization mechanism to personalized mobile services is still very few. Hence, the purpose of this paper is to propose a methodology to incorporate optimization techniques into personalization services. Multi agent-based web service approach is considered to realize the methodology. To show the feasibility of the methodology proposed in this paper, a prototype system, CAMA-myOPt(Context-Aware Multi-Agent system for my Optimization), was implemented and adopted in mobile comparative shopping.

A Multi-agent Architecture for Coordination of Supply Chains with Local Information Sharing (지역적 정보 공유를 활용하는 멀티 에이전트 시스템 기반의 공급사슬 관리 아키텍쳐)

  • Ahn, Hyung-Jun;Park, Sung-Joo
    • Asia pacific journal of information systems
    • /
    • v.14 no.4
    • /
    • pp.49-70
    • /
    • 2004
  • Multi-agent technology is being regarded as one of the promising technologies for today's supply chain management because of its desirable features such as autonomy, intelligence, and collaboration. This paper suggests a multi-agent system architecture with which companies can improve the efficiency of their supply chains by collaborative operation. Reflecting the practical difficulties of collaboration in complex supply chains, the architecture allows agent systems to share information with only neighboring companies for the coordinated operation. The suggested architecture is elaborated with a collaboration model based on Petri-net, conversation models for communication, and internal behavior models of each agent. A simulation experiment was performed for the evaluation of the suggested architecture. The result implies that when the estimation of market demand is higher than a certain level, the suggested architecture can be beneficial.

Studying Retailer Strategies through an Integrated E-Business Model: a Multi-Agent Approach

  • Xie Ming;Chen Jian
    • Management Science and Financial Engineering
    • /
    • v.11 no.3
    • /
    • pp.1-17
    • /
    • 2005
  • Agent technology has been widely applied in today's electronic business, such as mobile agents, multi-agent information systems, etc. In particular, multi-agent systems have been applied as powerful simulation tools to study complex business networks composed of various self-interested trading firms and/or human beings. In this paper, we build an integrated model that consists of a multi-agent B2C market model and a B2B trade network model, and incorporate more reality than much of prior work. Then with this model, we carry out experimental studies on two different strategies that are common in electronic business - 'loyal' strategy (retailers try to build stable cooperation with suppiers to ensure material supply) and 'cost-saving' strategy (retailers try to reduce cost by choosing suppliers with lower wholesale price).

A Design of Multi-Agent Framework to Develop Negotiation Systems

  • Park, Hyung-Rim;Kim, Hyun-Soo;Hong, Soon-Goo;Park, Young-Jae;Park, Yong-Sung;Kang, Moo-Hong
    • Journal of Intelligence and Information Systems
    • /
    • v.9 no.2
    • /
    • pp.155-169
    • /
    • 2003
  • A multi-agent technology has emerged as new paradigms that can flexibly and promptly cope with various environmental changes and complex problems. Accordingly, many studies have been carried out to establish multi-agent systems in an effort to solve dynamic problems in many fields. However, most previous research on the multi-agent frameworks aimed at, on the behalf of a user, exchanging and sharing information among agents, reusing agents, and suggesting job cooperation in order to integrate and assimilate heterogeneous agents. That is, their frameworks mainly focused on the basic functions of general multi-agents. Therefore, they are not suitable to the development of the proper system for a specific field such as a negotiation. The goal of this research is to design a multi-agent framework for the negotiation system that supports the evaluation of the negotiation messages, management of the negotiation messages, and message exchanges among the negotiation agents.

  • PDF