• Proceedings of the IEEK Conference
• /
• 2009.05a
• /
• pp.91-93
• /
• 2009

In this paper, we present the Q-learning method for adaptive traffic signal control on the basis of In this paper, we present the Q-learning method for adaptive traffic signal control on the basis of multi-agent technology. The structure is composed of sixphase agents and one intersection agent. Wireless communication network provides the possibility of the cooperation of agents. As one kind of reinforcement learning, Q-learning is adopted as the algorithm of the control mechanism, which can acquire optical control strategies from delayed reward; furthermore, we adopt dynamic learning method instead of static method, which is more practical. Simulation result indicates that it is more effective than traditional signal system.

• Proceedings of the IEEK Conference
• /
• 2009.05a
• /
• pp.118-120
• /
• 2009

In this paper, we present the Q-learning method for adaptive traffic signal control on the basis of multi-agent technology. The structure is composed of sixphase agents and one intersection agent. Wireless communication network provides the possibility of the cooperation of agents. As one kind of reinforcement learning, Q-learning is adopted as the algorithm of the control mechanism, which can acquire optical control strategies from delayed reward; furthermore, we adopt dynamic learning method instead of static method, which is more practical. Simulation result indicates that it is more effective than traditional signal system.

• Transactions of the Korean Society of Automotive Engineers
• /
• v.14 no.5
• /
• pp.84-92
• /
• 2006

Freeway Corridors consist of urban freeways and parallel arterials that drivers can use alternatively. Ramp metering in freeways and signal control in arterials are contemporary traffic control methods that have been developed and applied in order to improve traffic conditions of freeway corridors. However, most of the existing studies have focused on either optimal ramp metering in freeways, or progression signal strategies between arterial intersections. There have been no traffic control systems in Korea that integrates the freeway ramp metering and arterial signal control. The effective control strategies for freeway operations may cause negative effects on arterial traffic. On the other hand, traffic congestion and bottleneck phenomenon of arterials due to the increasing peak-hour travel demand and ineffective signal operation may generate an accessibility problem to freeway ramps. Thus, the main function of the freeway which is the through-traffic process has not been successful. The purpose of this study is to develop an integrated control model that connects freeway ramp metering systems and signal control systems in arterial intersections. And Optimization of integrated control model which consists of ramp metering and signal control is another purpose. Optimization results are verified by comparison with the results from MATDYMO.

• International Journal of Aeronautical and Space Sciences
• /
• v.18 no.3
• /
• pp.522-534
• /
• 2017

According to the characteristics of salvo attack for the multiple flight vehicles (MFV), the design of cooperative guidance law can be converted into the consensus problem of multi-vehicle system through the concept of multi-agent cooperative control. The flight vehicles can be divided into leader and followers depending on different functions, and the flight conditions of leader are independent of the ones of followers. The consensus problem of leader-follower multi-vehicle system is researched by graph theory, and the consensus protocol is also presented. Meanwhile, the finite time guidance law is designed for the flight vehicles via the finite time control method, and the system stability is also analyzed. Whereby, the guidance law can guarantee the line of sight (LOS) angular rates converge to zero in finite time, and hence the cooperative attack of the MFV can be realized. The effectiveness of the designed cooperative guidance method is validated through the simulation with a stationary target and a moving target, respectively.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.7
• /
• pp.3566-3582
• /
• 2019

In intelligent warehouse picking system, the allocation of tasks has an important influence on the efficiency of the whole system because of the large number of robots and orders. The paper proposes a method to solve the task allocation problem that multi-robot task allocation problem is transformed into transportation problem to find a collision-free task allocation scheme and then improve the capability of task processing. The task time window and the power consumption of multi-robot (driving distance) are regarded as the utility function and the maximized utility function is the objective function. Then an integer programming formulation is constructed considering the number of task assignment on an agent according to their battery consumption restriction. The problem of task allocation is solved by table working method. Finally, simulation modeling of the methods based on table working method is carried out. Results show that the method has good performance and can improve the efficiency of the task execution.

• Proceedings of the KIEE Conference
• /
• 2007.07a
• /
• pp.127-129
• /
• 2007

Since the competitive market environment was introduced into the electric power industry, the structure of the industry has been changing from vertically integrated system to functionally unbundled and decentralized system composed of multiple (decision-making) market participants. So the market participants such as Gencos or LSE (load serving entity) need to forecast the market clearing price and thus build their offer or bidding strategies. Not just these market players but also a market operator is required to perform market analysis and ensure simulation capability to manage and monitor the competitive electricity market. For fulfilling the demand for market simulation, many global venders like GE, Henwood, Drayton Analytics, CRA, etc. have developed and provided electricity market simulators. Most of these simulators are based on the optimization formulation which has been used mainly for the least cost resource planning in the centralized power system planning and operation. From this standpoint, it seems somehow inevitable to face many challenges on modeling competitive market based on the method of traditional market simulators. In this paper, we propose a kind of new method, which is MAS based market simulation. The agent based model has already been introduced in EMCAS, one of commercial market simulators, but there may be various ways of modeling agent. This paper, in particular, seeks to introduce an model for MAS based market simulator.

• Journal of the Korea Society for Simulation
• /
• v.27 no.1
• /
• pp.1-13
• /
• 2018

Earthwork planning is one of the critical issues in a construction process management. For the construction process management, there are some different approaches such as optimizing construction with either mathematical methodologies or heuristics with simulations. This paper propose a simulated earthwork scenario and an optimal path for the simulation using a reinforcement learning. For reinforcement learning, we use two different Markov decision process, or MDP, formulations with interacting excavator agent and truck agent, sequenced learning, and independent learning. The simulation result shows that two different formulations can reach the optimal planning for a simulated earthwork scenario. This planning could be a basis for an automatic construction management.

• Journal of Korea Game Society
• /
• v.11 no.1
• /
• pp.111-120
• /
• 2011

It is important to realistically simulate group behaviors of the multi-agents in virtual worlds. While most researchers have focused on their group behaviors in an open space, this paper studies their group behaviors by using steering force in an enclosed space. Agents have a common target and should move towards it in an enclosed space while avoiding collision with other agents. Under those environments, three possible models of agents are proposed and the six steering forces needed in each model are also proposed. In order to show the correctness of the proposed models, they were simulated. Our simulation results showed that the proposed models only using steering forces operate well in the enclosed space although it requires a different period of time for each agent to arrive at its target depending on the walls and doors.

• Journal of Intelligence and Information Systems
• /
• v.7 no.1
• /
• pp.1-15
• /
• 2001

Recently, Internet based Electronic Commerce is recognized as one of the alternatives for strengthening sales power of small and medium companies. However, small and medium manufacturers can't adjust properly to the new environment because they are in short of money, personnel, and technology. To cope with this problem, this paper deals with the development of virtual manufacturing agent to support sales agent. The sales activity of most of parts manufacturing companies is based on orders of buyers. The process of promotion, receipt and selection of orders of the parts manufacturing is closely coupled with the load status of the production lines. On deciding whether to accept an order or not, as well as negotiating with buyers, sales person needs information such as load and schedule of production lines, manufacturability of the order. Therefore, the functions of virtual manufacturing agents manufacturability analysis, process planning, and scheduling are key features in developing an agent of sales activity for the parts manufacturing business. While most of research on virtual manufacturing system so far is focused on the simulation of each product, this paper deals with the development of agent assisting internet-based product sales by supporting production information promptly. The pilot system of virtual manufacturing agent is implemented using KQML-based agent template and Java-based expert system shell for a small molding company.

• 제어로봇시스템학회:학술대회논문집
• /
• 2001.10a
• /
• pp.44.1-44
• /
• 2001

This paper discusses the interacting mobile robots for tele-operation system using the world wide web. In multi-agent and web-based teleoperation environment the problem of communication delay must be solved for the efficient and robust control of the system. The standard graphic user interface(GUI)is implemented using Java Programing language. The web browser is used to integrate the virtual environment and the standard GUI(Java applet) in a single user interface. Users can access a dedicated WWWserver and download the user interface. Reinforcement learning is applied to indirect control in order to autonomously operate without the need of human intervention. Java application has been developed to communicate and control multi robots using WWW. The effectiveness of our multi robots system is verified by simulation and experiments ...