• Title/Summary/Keyword: Agent-Based Simulation

Search Result 361, Processing Time 0.029 seconds

Simulation of MultiAgent-based Emergency Medical System Using ARENA (ARENA를 이용한 멀티 에이전트 기반 응급 의료 시스템 시뮬레이션)

  • Noh, Seon-Taek;Yi, Keun-Sang;Choi, Young-Keun
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2007.10b
    • /
    • pp.408-413
    • /
    • 2007
  • 최근 인구와 기계문명의 발달로 예전에 비해 좀더 복잡한 응급 사고가 발생하고 있다. 현재 응급 구조 시스템은 타인에 의한 신고나 정적인 웹페이지로 수집된 정보를 통해 당시 상황에 맞춰 응급 체계를 수립하고 있다. 이는 비전문 의료인인 구급대원의 현장 판단과 의료기관으로의 부적절한 판단으로 인해 응급 환자의 적절한 치료의 가능성을 낮추는 요인이 될 수 있다. 따라서 선행연구로써 기존의 응급 의료 시스템에 멀티 에이전트 개념을 도입하여 멀티 에이전트 기반의 응급 의료 시스템(MAEMS)을 모델링하였다. 멀티 에이전트 시스템은 독립적인 성격과 자율적인 성격으로 않은 부분에 응용되어 설계되고 있다. 특히 에이전트의 독립적인 성격은 이질적인 환경에서 동일한 목적의 행위를 수행할 수 있으며, 동적으로 많은 변화가 있는 상황에서 자율적으로 판단하여 행동할 수 있다. 본 논문에서는 MAEMS에 구성되어 있는 각 에이전트를 구현하며, ARENA를 통해 시뮬레이션함으로써 실제 통계자료와 비교하여 멀티 에이전트를 도입한 응급 의료 시스템의 효율성에 대해 연구한다.

  • PDF

Exploring reward efficacy in traffic management using deep reinforcement learning in intelligent transportation system

  • Paul, Ananya;Mitra, Sulata
    • ETRI Journal
    • /
    • v.44 no.2
    • /
    • pp.194-207
    • /
    • 2022
  • In the last decade, substantial progress has been achieved in intelligent traffic control technologies to overcome consistent difficulties of traffic congestion and its adverse effect on smart cities. Edge computing is one such advanced progress facilitating real-time data transmission among vehicles and roadside units to mitigate congestion. An edge computing-based deep reinforcement learning system is demonstrated in this study that appropriately designs a multiobjective reward function for optimizing different objectives. The system seeks to overcome the challenge of evaluating actions with a simple numerical reward. The selection of reward functions has a significant impact on agents' ability to acquire the ideal behavior for managing multiple traffic signals in a large-scale road network. To ascertain effective reward functions, the agent is trained withusing the proximal policy optimization method in several deep neural network models, including the state-of-the-art transformer network. The system is verified using both hypothetical scenarios and real-world traffic maps. The comprehensive simulation outcomes demonstrate the potency of the suggested reward functions.

Development of Integrated Development Framework for Context-Awareness Simulation based on Multi-Agent System (멀티 에이전트 기반의 상황 인지 시뮬레이션을 위한 통합 개발 프레임워크의 개발)

  • Kim, Tae-Hyung;Choi, Jin-Woo;Woo, Chong-Woo
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2010.11a
    • /
    • pp.538-541
    • /
    • 2010
  • 상황인지 시뮬레이션이란 상황자료의 수집, 추론 및 결론 도출의 과정을 실제 환경이 아닌 가상의 시뮬레이션 환경 안에서 실험해 볼 수 있는 것을 말하며, 상황인지 기술과 DEVS(Discrete Event System Specification), 페트리-넷(Petri-Net)등의 기반 기술이 사용된다. 본 논문에서는 사용자들이 보다 편리하게 상황인지 시스템을 구축하고 실제보다 적은 시간으로 구축된 시스템을 실험할 수 있는 시뮬레이션 환경을 제공할 수 있는 통합 개발 프레임워크를 개발하고자 한다. 시뮬레이션 통합 개발 프레임워크 특징으로는, 첫째 상황인지를 위한 추론 기능을 가지는 에이전트와 시뮬레이션 기능들을 플러그인 및 라이브러리로 제공할 수 있고, 둘째, 통합환경 안에서 제공되는 도구들을 사용하여 사용자들이 보다 편리하게 개발 및 실험을 할 수 있다는 장점이 있다. 따라서 본 논문에서는 상황 아키텍처를 위한 모델 표현 계층, 멀티 에이전트 시스템을 위한 연산 계층, 환경과의 상호작용을 위한 인터랙션 계층, 그리고 시뮬레이션 계층인 4-계층구조의 통합개발환경을 연구하였다.

Neuro-Fuzzy Controller Based on Reinforcement Learning (강화 학습에 기반한 뉴로-퍼지 제어기)

  • 박영철;심귀보
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.10 no.5
    • /
    • pp.395-400
    • /
    • 2000
  • In this paper, we propose a new neuro-fuzzy controller based on reinforcement learning. The proposed system is composed of neuro-fuzzy controller which decides the behaviors of an agent, and dynamic recurrent neural networks(DRNNs) which criticise the result of the behaviors. Neuro-fuzzy controller is learned by reinforcement learning. Also, DRNNs are evolved by genetic algorithms and make internal reinforcement signal based on external reinforcement signal from environments and internal states. This output(internal reinforcement signal) is used as a teaching signal of neuro-fuzzy controller and keeps the controller on learning. The proposed system will be applied to controller optimization and adaptation with unknown environment. In order to verifY the effectiveness of the proposed system, it is applied to collision avoidance of an autonomous mobile robot on computer simulation.

  • PDF

Performance Analysis of Error Recovery System on Distributed Multimedia Environment (분산 멀티미디어 환경에서 실행되는 오류 복구 시스템의 성능 분석)

  • Ko Eung-Nam
    • Journal of Digital Contents Society
    • /
    • v.6 no.1
    • /
    • pp.85-88
    • /
    • 2005
  • The requirement of distributed multimedia applications is the need for sophisticated QoS(quality of service) management. In terms of distributed multimedia systems, the most important catagories for quality of service are a timeless, volume, and reliability. In this paper, we discuss a method for increasing reliability through fault tolerance. We describe the desist and implementation of the ERA running on distributed multimedia environment ERA is a system is able to recover automatically a software error based on distributed multimedia. This paper explains a performance analysis of an error recovery system running on distributed multimedia environment using the rule-based DEVS modeling and simulation techniques. In DEVS, a system has a time base, inputs, states, outputs, and functions.

  • PDF

A Ring-based Multicast Routing Architecture for Mobile Ad Hoc Networks (모바일 애드혹 네트워크를 위한 링 기반 멀티캐스트 라우팅 구조)

  • Heo Joon;Hong Choong Seon;Yang Yubai
    • The KIPS Transactions:PartC
    • /
    • v.11C no.7 s.96
    • /
    • pp.895-904
    • /
    • 2004
  • Due to the frequent and unpredictable topology changes, multicast still remains as challenge and no one-size-fits-all protocol could serve all kinds of needs in mobile ad hoc network. In this paper, we propose a novel scheme of Hierarchical Eulerian Ring Oriented Multicast Architecture (HEROMA) over mobile ad hoc network. It has features that concentrate on efficiency and robustness simultaneously. It is also an application-driven proposal for hazard detection. Architectures including Eulerian ring, hierarchy and multicast agent are investigated in detail Simulation results different level of improvements on control traffic, end-to-end delay and packet delivery ratio by comparing with tree-based and mesh-based multicast protocols.

The Design of Operation and Control Solution with Intelligent Inference Capability for IED based Digital Switchgear Panel (IED를 기반으로 하는 디지털 수배전반의 지적추론기반 운전제어 솔루션 설계)

  • Ko, Yun-Seok
    • The Transactions of the Korean Institute of Electrical Engineers A
    • /
    • v.55 no.9
    • /
    • pp.351-358
    • /
    • 2006
  • In this paper, DSPOCS(Digital Switchgear-Panel Operation and Control Solution) is designed, which is the intelligent inference based operation and control solution to obtain the safety and reliability of electric power supply in substation based on IED. DSPOCS is designed as a scheduled monitoring and control task and a real-time alarm inference task, and is interlinked with BRES(Bus Reconfiguration Expert System) in the required case. The intelligent alarm inference task consists of the alarm knowledge generation part and the real-time pattern matching part. The alarm knowledge generation part generates automatically alarm knowledge from DB saves it in alarm knowledge base. On the other hand, the pattern matching part inferences the real-time event by comparing the real-time event information furnished from IEDs of substation with the patterns of the saved alarm knowledge base.; Especially, alarm knowledge base includes the knowledge patterns related with fault alarm, the overload alarm and the diagnosis alarm. In order to design the database independently in substation structure, busbar is represented as a connectivity node which makes the more generalized graph theory possible. Finally, DSPOCS is implemented in MS Visual $C^{++}$, MFC, the effectiveness and accuracy of the design is verified by simulation study to the typical distribution substation.

Development of human-in-the-loop experiment system to extract evacuation behavioral features: A case of evacuees in nuclear emergencies

  • Younghee Park;Soohyung Park;Jeongsik Kim;Byoung-jik Kim;Namhun Kim
    • Nuclear Engineering and Technology
    • /
    • v.55 no.6
    • /
    • pp.2246-2255
    • /
    • 2023
  • Evacuation time estimation (ETE) is crucial for the effective implementation of resident protection measures as well as planning, owing to its applicability to nuclear emergencies. However, as confirmed in the Fukushima case, the ETE performed by nuclear operators does not reflect behavioral features, exposing thus, gaps that are likely to appear in real-world situations. Existing research methods including surveys and interviews have limitations in extracting highly feasible behavioral features. To overcome these limitations, we propose a VR-based immersive experiment system. The VR system realistically simulates nuclear emergencies by structuring existing disasters and human decision processes in response to the disasters. Evacuation behavioral features were quantitatively extracted through the proposed experiment system, and this system was systematically verified by statistical analysis and a comparative study of experimental results based on previous research. In addition, as part of future work, an application method that can simulate multi-level evacuation dynamics was proposed. The proposed experiment system is significant in presenting an innovative methodology for quantitatively extracting human behavioral features that have not been comprehensively studied in evacuation. It is expected that more realistic evacuation behavioral features can be collected through additional experiments and studies of various evacuation factors in the future.

The Development of Theoretical Model for Relaxation Mechanism of Sup erparamagnetic Nano Particles (초상자성 나노 입자의 자기이완 특성에 관한 이론적 연구)

  • 장용민;황문정
    • Investigative Magnetic Resonance Imaging
    • /
    • v.7 no.1
    • /
    • pp.39-46
    • /
    • 2003
  • Purpose : To develop a theoretical model for magnetic relaxation behavior of the superparamagnetic nano-particle agent, which demonstrates multi-functionality such as liver- and lymp node-specificity. Based on the developed model, the computer simulation was performed to clarify the relationship between relaxation time and the applied magnetic field strength. Materials and Methods : The ultrasmall superparamagnetic iron oxide (USPIO) was encapsulated with biocompatiable polymer, to develop a relaxation model based on outsphere mechanism, which was resulting from diffusion and/or electron spin fluctuation. In addition, Brillouin function was introduced to describe the full magnetization by considering the fact that the low-field approximation, which was adapted in paramagnetic case, is no longer valid. The developed model describes therefore the T1 and T2 relaxation behavior of superparamagnetic iron oxide both in low-field and in high-field. Based on our model, the computer simulation was performed to test the relaxation behavior of superparamagnetic contrast agent over various magnetic fields using MathCad (MathCad, U.S.A.), a symbolic computation software. Results : For T1 and T2 magnetic relaxation characteristics of ultrasmall superparamagnetic iron oxide, the theoretical model showed that at low field (<1.0 Mhz), $\tau_{S1}(\tau_{S2}$, in case of T2), which is a correlation time in spectral density function, plays a major role. This suggests that realignment of nano-magnetic particles is most important at low magnetic field. On the other hand, at high field, $\tau$, which is another correlation time in spectral density function, plays a major role. Since $\tau$ is closely related to particle size, this suggests that the difference in R1 and R2 over particle sizes, at high field, is resulting not from the realignment of particles but from the particle size itself. Within normal body temperature region, the temperature dependence of T1 and T2 relaxation time showed that there is no change in T1 and T2 relaxation times at high field. Especially, T1 showed less temperature dependence compared to T2. Conclusion : We developed a theoretical model of r magnetic relaxation behavior of ultrasmall superparamagnetic iron oxide (USPIO), which was reported to show clinical multi-functionality by utilizing physical properties of nano-magnetic particle. In addition, based on the developed model, the computer simulation was performed to investigate the relationship between relaxation time of USPIO and the applied magnetic field strength.

  • PDF

NetLogo Extension Module for the Active Participatory Simulations with GoGo Board (고고보드를 이용한 능동적 참여 모의실험을 위한 NetLogo 확장 모듈)

  • Xiong, Hong-Yu;So, Won-Ho
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.36 no.11B
    • /
    • pp.1363-1372
    • /
    • 2011
  • Flooding based routing protocols are usually used to disseminate information in wireless sensor networks. Those approaches, however, require message retransmissions to all nodes and induce huge collision rate and high energy consumption. In this paper, HoGoP (Hop based Gossiping Protocol) in which all nodes consider the number of hops from sink node to them, and decide own gossiping probabilities, is introduced. A node can decide its gossiping probability according to the required average reception percentage and the number of parent nodes which is counted with the difference between its hop and neighbors' ones. Therefore the decision of gossiping probability for network topology is adaptive and this approach achieves higher message reception percentage with low message retransmission than the flooding scheme. Through simulation, we compare the proposed protocol with some previous ones and evaluate its performance in terms of average reception percentage, average forwarding percentage, and forwarding efficiency. In addition, average reception percentage is analyzed according to the application requirement.