• 제목/요약/키워드: Agent-Based Simulation

검색결과 364건 처리시간 0.02초

Modified Deep Reinforcement Learning Agent for Dynamic Resource Placement in IoT Network Slicing

  • 로스세이하;담프로힘;김석훈
    • 인터넷정보학회논문지
    • /
    • 제23권5호
    • /
    • pp.17-23
    • /
    • 2022
  • Network slicing is a promising paradigm and significant evolution for adjusting the heterogeneous services based on different requirements by placing dynamic virtual network functions (VNF) forwarding graph (VNFFG) and orchestrating service function chaining (SFC) based on criticalities of Quality of Service (QoS) classes. In system architecture, software-defined networks (SDN), network functions virtualization (NFV), and edge computing are used to provide resourceful data view, configurable virtual resources, and control interfaces for developing the modified deep reinforcement learning agent (MDRL-A). In this paper, task requests, tolerable delays, and required resources are differentiated for input state observations to identify the non-critical/critical classes, since each user equipment can execute different QoS application services. We design intelligent slicing for handing the cross-domain resource with MDRL-A in solving network problems and eliminating resource usage. The agent interacts with controllers and orchestrators to manage the flow rule installation and physical resource allocation in NFV infrastructure (NFVI) with the proposed formulation of completion time and criticality criteria. Simulation is conducted in SDN/NFV environment and capturing the QoS performances between conventional and MDRL-A approaches.

유고상황 시 MatSIM을 활용한 도시부 도로네트워크 운영 분석 (Application of Multi-Agent Transport Simulation for Urban Road Network Operation in Incident Case)

  • 김주영;유연승;이승재;허혜정;성정곤
    • 한국도로학회논문집
    • /
    • 제14권4호
    • /
    • pp.163-173
    • /
    • 2012
  • PURPOSES : The purpose of this study is to check the possibilities of traffic pattern analysis using MatSIM for urban road network operation in incident case. METHODS : One of the stochastic dynamic models is MatSIM. MatSIM is a transportation simulation tool based on stochastic dynamic model and activity based model. It is an open source software developed by IVT, ETH zurich, Switzerland. In MatSIM, various scenario comparison analyses are possible and analyses results are expressed using the visualizer which shows individual vehicle movements and traffic patterns. In this study, trip distribution in 24-hour, traffic volume, and travel speed using MatSIM are similar to those of measured values. Therefore, results of MatSIM are reasonable comparing with measured values. Traffic patterns are changed according to incident from change of individual behavior. RESULTS : The simulation results and the actual measured values are similar. The simulation results show reasonable ranges which can be used for traffic pattern analysis. CONCLUSIONS : The change of traffic pattern including trip distribution, traffic volumes and speeds according to various incident scenarios can be used for traffic control policy decision to provide effective operation of urban road network.

불확실성을 포함한 다 개체 시스템의 상태 일치를 위한 이산 시간 출력 궤환 협조 제어 알고리즘 (Discrete-Time State Feedback Algorithm for State Consensus of Uncertain Homogeneous Multi-Agent Systems)

  • 윤문채;김정수;백주훈
    • 제어로봇시스템학회논문지
    • /
    • 제19권5호
    • /
    • pp.390-397
    • /
    • 2013
  • This paper presents a consensus algorithm for uMAS (uncertain Multi-Agent Systems). Unlike previous results in which only nominal models for agents are considered, it is assumed that the uncertain agent model belongs to a known polytope set. In the middle of deriving the proposed algorithm, a convex set is found which includes all uncertainties in the problem using convexity of the polytope set. This set plays an important role in designing the consensus algorithm for uMAS. Based on the set, a consensus condition for uMAS is proposed and the corresponding consensus design problem is solved using LMI (Linear Matrix Inequality). Simulation result shows that the proposed consensus algorithm successfully leads to consensus of the state of uMAS.

멀티에이전트 시스템을 이용한 마이크로그리드 분산 지능형 관리시스템 파일럿 플랜트 개발 (Development of Pilot Plant for Distributed Intelligent Management System of Microgrids)

  • 오상진;유철희;정일엽;임재봉
    • 전기학회논문지
    • /
    • 제62권3호
    • /
    • pp.322-331
    • /
    • 2013
  • This paper describes the development of the pilot plant of distributed intelligent management system for a microgrid. For optimal control and management of microgrids, intelligent agents area applied to the microgrid management system. Each agent includes intelligent algorithms to make decisions on behalf of the corresponding microgrid entity such as distributed generators, local loads, and so on. To this end, each agent has its own resources to evaluate the system conditions by collecting local information and also communicating with other agents. This paper presents key features of the data communication and management of the developed pilot plant such as the construction of mesh network using local wireless communication techniques, the autonomous agent coordination schemes using plug-and-play functions of agents and contract net protocol (CNP) for decision-making. The performance of the pilot plant and developed algorithms are verified via real-time microgrid test bench based on hardware-in-the-loop simulation systems.

Rescorla-Wagner 모형을 활용한 다중 에이전트 웹서비스 기반 욕구인지 상기 서비스 구축 및 성능분석 (Applying Rescorla-Wagner Model to Multi-Agent Web Service and Performance Evaluation for Need Awaring Reminder Service)

  • 권오병;최근호;최성철
    • 지능정보연구
    • /
    • 제11권3호
    • /
    • pp.1-23
    • /
    • 2005
  • 개인화된 상기 시스템은 사용자의 현재 상황 정보를 토대로 현재 욕구를 동적이며 선응적으로 파악하여야 한다. 하지만 기존의 욕구 인식 방법론 및 상기시스템 아키텍처들은 이러한 요구 사항을 잘 반영하지 못해왔다. 따라서 본 논문은 에이전트, 시맨틱 웹, 그리고 RFID기반의 상황인지를 활용한 선응적인 욕구 인지 메커니즘을 유력한 유비쿼터스 서비스 지원환경의 하나인 개인화된 상기 시스템에 적용하는 것을 목적으로 한다. 이를 위하여 주된 욕구 인지 이론으로 Rescorla-Wagner 모형을 채택하였다. 또한 본 논문에서 제안하는 방법론의 실현 가능성을 보이기 위해 NAMA (Need Aware Multi-Agent)-RFID라고 하는 프로토타입 시스템을 개발하였다. NAMA는 사용자의 욕구를 인지하기 위해 상황 정보 및 사용자 프로파일과 선호도, 가용 서비스 관련 정보 등을 고려할 수 있으며, 웹 서비스의 형태로 구현된 서비스 집합들을 사용자에게 연결시켜준다. 더욱이 범위성 측면에서의 시스템 성능을 보이기 위해 시뮬레이션을 수행하였으며, 그 결과를 보였다.

  • PDF

An Alternative Evaluation of the Item-based Collaborative Filtering Using Simulated Online Shopping

  • Ahn, Hyung-Jun
    • Journal of Information Technology Applications and Management
    • /
    • 제16권3호
    • /
    • pp.17-28
    • /
    • 2009
  • This paper presents a novel method for evaluating the usefulness of online product recommendation. Previous studies on evaluating recommendation systems have mostly relied on two methods : testing the accuracy of estimating user preferences by recommendation systems, or empirically testing the effectiveness with lab experiments involving human participants. The former does not measure the usefulness directly and hence can be misleading; the latter is expensive in that it requires a working online store System and test participants. In order to address the problems, the proposed approach uses simulation to imitate customer behavior and evaluate the usefulness of recommendation. Models for user behavior and an abstract Internet store are developed for simulation. Actual simulation experiments are performed to illustrate the use of the approach.

  • PDF

보안 모델의 연동을 위한 블랙보드구조의 적용 (An Application of Blackboard Architecture for the Coordination among the Security Systems)

  • 서희석;조대호
    • 한국시뮬레이션학회논문지
    • /
    • 제11권4호
    • /
    • pp.91-105
    • /
    • 2002
  • The attackers on Internet-connected systems we are seeing today are more serious and technically complex than those in the past. So it is beyond the scope of amy one system to deal with the intrusions. That the multiple IDSes (Intrusion Detection System) coordinate by sharing attacker's information for the effective detection of the intrusion is the effective method for improving the intrusion detection performance. The system which uses BBA (BlackBoard Architecture) for the information sharing can be easily expanded by adding new agents and increasing the number of BB (BlackBoard) levels. Moreover the subdivided levels of blackboard enhance the sensitivity of the intrusion detection. For the simulation, security models are constructed based on the DEVS (Discrete EVent system Specification) formalism. The intrusion detection agent uses the ES (Expert System). The intrusion detection system detects the intrusions using the blackboard and the firewall responses these detection information.

  • PDF

Fk means를 이용한 동적객체그룹관리기반 지능형 멀티 에이전트 분산플랫폼 (Intelligent Multi-Agent Distributed Platform based on Dynamic Object Group Management using Fk-means)

  • 이재완;나혜영;마테오 로미오
    • 인터넷정보학회논문지
    • /
    • 제10권1호
    • /
    • pp.101-110
    • /
    • 2009
  • 효율적인 자원공유 및 동적인 시스템구성을 위한 지능형 분산 접근방식에서 주로 멀티에이전트 시스템을 사용한다. 또한 객체중복은 고장허용시스템을 구축하여 시스템에 예기치 않은 결함의 문제를 해결하기 위해 흔히 사용된다. 본 논문은 동적인 객체그룹관리에 기반한 지능형 멀티에이전트 분산플랫폼을 제시하고, 제안한 filtered k-means (Fk-means)를 기반으로 하여 객체검색기법을 제시한다. 객체 결함의 경우에, 대체 객체를 검색하여 클라이언트에게 적절한 객체를 투명하게 재 연결 시켜주기 위해 Fk-means를 사용한다. 검색방법을 효율적으로 수행하고, 그룹 내의 적절한 객체를 포함시키기 위해 Fk-means의 여과 범위를 설정한다. 시뮬레이션 결과 제안한 기법이 분산객체그룹에 대해 빠르고 정확한 검색을 나타내었다.

  • PDF

Implementation of an Agent-centric Planning of Complex Events as Objects of Pedagogical Experiences in Virtual World

  • Park, Jong Hee
    • International Journal of Contents
    • /
    • 제12권1호
    • /
    • pp.25-43
    • /
    • 2016
  • An agent-centric event planning method is proposed for providing pedagogical experiences in an immersed environment. Two-level planning is required at in a macro-level (i.e., inter-event level) and an intra-event level to provide realistic experiences with the objective of learning declarative knowledge. The inter-event (horizontal) planning is based on search, while intra-event (vertical) planning is based on hierarchical decomposition. The horizontal search is dictated by several realistic types of association between events besides the conventional causality. The resulting schematic plan is further augmented by conditions associated with those agents cast into the roles of the events identified in the plan. Rather than following a main story plot, all the events potentially relevant to accomplishing an initial goal are derived in the final result of our planning. These derived events may progress concurrently or digress toward a new main goal replacing the current goal or event, and the plan could be merged or fragmented according to their respective lead agents' intentions and other conditions. The macro-level coherence across interconnected events is established via their common background world existing a priori. As the pivotal source of event concurrency and intricacy, agents are modeled to not only be autonomous but also independent, i.e., entities with their own beliefs and goals (and subsequent plans) in their respective parts of the world. Additional problems our method addresses for augmenting pedagogical experiences include casting of agents into roles based on their availability, subcontracting of subsidiary events, and failure of multi-agent event entailing fragmentation of a plan. The described planning method was demonstrated by monitoring implementation.

센서 네트워크에서 헬스케어 이동성 에이전트 모듈 설계 (Design Healthcare Mobility Agent Module in Sensor Network)

  • 남진우;정영지
    • 한국멀티미디어학회논문지
    • /
    • 제11권4호
    • /
    • pp.544-553
    • /
    • 2008
  • 통상적인 센서 네트워크는 센서노드로부터 고정된 정보를 수집하는 일괄적인 방식을 사용한다. 하지만 이러한 방식은 헬스케어 환경에서 주요 센싱대상인 사람의 상태와 위치변화, 주변 환경의 변화에 능동적으로 대처하기 어렵다. 헬스케어 환경을 지원하기 위해서는 사람의 상태와 주변상황의 변화에 따른 특정정보를 제공해주어야 한다. 또한 사람의 이동에 따른 네트워크 타입의 변화에 대처하여야 한다. 본 논문에서는 대표적인 다중 에이전트 미들웨어인 Agilla 모델과 주변노드간의 클러스터를 구성함으로써 네트워크의 효율성을 보장하는 LEACH 프로토콜에 대해 분석한다. 이 분석 결과를 기반으로 기존 LEACH 프로토콜의 취약점인 노드 이동성을 보장하는 LEACH_Mobile 프로토콜을 제안한다. 또한 노드의 동적 기능변경을 지원하는 Mobility Agent Middleware와 LEACH_Mobile 라우팅 모듈을 구성요소로 이동노드의 동적 기능변경을 지원하는 Mobility Agent 모듈을 설계한다. 그리고 LEACH_Mobile 프로토콜의 시뮬레이션 결과를 통해 네트워크의 데이터 전송 성공률에 대한 성능 향상을 보여준다.

  • PDF