• Journal of Korea Multimedia Society
• /
• v.23 no.7
• /
• pp.830-839
• /
• 2020

As a popular mathematical framework for modeling decision making, Markov decision process (MDP) has been widely used to solve problem in many engineering fields. MDP consists of a set of discrete states, a finite set of actions, and rewards received after reaching a new state by taking action from the previous state. The objective of MDP is to find an optimal policy, that is, to find the best action to be taken in each state to maximize the expected discounted reward of policy (EDR). In practice, MDP is typically unknown, so simulation-based policy improvement (SBPI), which improves a given base policy sequentially by selecting the best action in each state depending on rewards observed via simulation, can be a practical way to find the optimal policy. However, the efficiency of SBPI is still a concern since many simulation samples are required to precisely estimate EDR for each action in each state. In this paper, we propose a method to select the best action accurately in each state using a small number of simulation samples, thereby improving the efficiency of SBPI. The proposed method accumulates the simulation samples observed in the previous states, so it is possible to precisely estimate EDR even with a small number of samples in the current state. The results of comparative experiments on the existing method demonstrate that the proposed method can improve the efficiency of SBPI.

• Journal of the Korean Society for Aeronautical & Space Sciences
• /
• v.36 no.11
• /
• pp.1112-1120
• /
• 2008

The real-time distributed simulation at the present age concentrates on the construction of a system development environment in order to accomplish a synthetic battlefield environment connected with Live-Virtual-Constructive simulation and to realize the Simulation Based Acquisition which supports the life cycle of weapon system. Accordingly this paper describes the development environment of the UML modeling and simulation which integrates the system analysis and design methods performed during the conceptual design phase of the reconnaissance UAV system development. An integrated framework linked with the UML simulation and X-plane visualization is suggested to efficiently perform the system analysis and design, and finally the implementation contents, the analysis of experiment results and concluding remarks are described.

• Journal of the Korea Society for Simulation
• /
• v.15 no.1
• /
• pp.87-95
• /
• 2006

We need to check into when a security system is newly developed, we against cyber attack which is expected in real network. However it is impossible to check it under the environment of a large-scale distributive network. So it is need to simulate it under the virtual network environment. SSFNet is a event-driven simulator which can be represent a large-scale network. Unfortunately, it doesn't have the module to simulate security functions. In this paper, we added the IDS module to SSFNet. We implement the IDS module by modeling a key functions of Snort. In addition, we developed some useful functions using Java language which can manipulate easily a packet for network simulation. Finally, we performed the simulation to verify the function if our developed IDS and Packets Manipulation. The simulation shows that our expanded SSFNet can be used to further large-scale security system simulator.

• Journal of the Korea Society for Simulation
• /
• v.25 no.4
• /
• pp.43-52
• /
• 2016

Wireless sensor network (WSN) technology has been implemented using commercial off-the-shelf microcontrollers (MCUs), In this paper, we propose a simulation environment to realize the physical evaluation of FPGA-based node by considering vertically cross-layered WSN in terms of physical node device and network interconnection perspective. The proposed simulation framework emulates the physical FPGA-based sensor nodes to interoperate with the NS3 through the runtime infrastructure (RTI). For the emulation and interoperation of FPGA-based nodes, we extend a vendor-providing FPGA design tool from the host computer and a script to execute the interoperation procedures. The standalone NS-3 is also revised to perform interoperation through the RTI. To resolve the different time-advance mechanisms between the FPGA emulation and event-driven NS3 simulation, the pre-simulation technique is applied to the proposed environment. The proposed environment is applied to IEEE 802.15.4-based low-rate, wireless personal area network communication.

• Journal of the Korean Institute of Telematics and Electronics A
• /
• v.31A no.3
• /
• pp.77-86
• /
• 1994

A New environment SENSATION for circuit optimization and statistical analysis has been developed. It provides real time simulation and includes automatic algorithms to assist for reaching optimal solution. Furthermore, statistical analysis environment is presented which aids in Monte Carlo analysis. worst case corner analysis, and sensitivity analysis. These capabilities faciliate the characterization of the effects of several operating conditions and manufacture process paramenters on the design performances. We verify that the proposed methods can obtain the optimal solution of the objective function through several experimental results.

• Proceedings of the KSRS Conference
• /
• 2003.11a
• /
• pp.414-416
• /
• 2003

Pedestrian assemblage is now a normal phenomenon in modern cities. To maintain an unblocked traffic situation, protect the pedestrians' safety and make preparedness for any emergencies is an important task for police department. Modeling pedestrian dynamics and simulating evacuation process can provide useful information for make accurate decisions. In this paper, by virtue of geographic information technologies, the authors proposed a conceptual framework to simulate pedestrian dynamics and evacuation in an open urban environment.

• Korean Management Science Review
• /
• v.17 no.1
• /
• pp.17-30
• /
• 2000

This paper addresses the effect of protective capacity on the lead time and throughput of a re-entrant line where statistical fluctuations exist in the form of variation in processing times and machine breakdowns. The specific framework employed in the paper is a five station re-entrant line structured as a closed network mode. This paper argues that protective capacity can be used in conjunction with WIP inventory in order to reduce the lead time and to increase the increase the throughput of a line. Simulation analyses are included to give insight into the effectiveness of protective capacity.

• Management Science and Financial Engineering
• /
• v.2 no.1
• /
• pp.19-51
• /
• 1996

We suggest a distributed framework for task assignment in the computer-controlled shop floor where each of the resource agents and part agents acts like an independent profit maker. The job allocation problem is formulated as a linear programming problem. The LP formulation is analyzed to provide a rationale for the distributed task assignment procedure. We suggest an auction based negotiation procedure including a price-based bid construction and a price revising mechanism. The performance of the suggested procedure is compared with those of an LP formulation and conventional dispatching procedures by simulation experiments.

• ETRI Journal
• /
• v.34 no.1
• /
• pp.130-133
• /
• 2012

Recently, several noise-robust adaptive multichannel LMS algorithms have been proposed based on the spectral flatness of the estimated channel coefficients in the presence of additive noise. In this work, we propose a general form for the algorithms that integrates the existing algorithms into a common framework. Computer simulation results are presented and demonstrate that a new proposed algorithm gives better performance compared to existing algorithms in noisy environments.

• 제어로봇시스템학회:학술대회논문집
• /
• 1993.10a
• /
• pp.895-901
• /
• 1993

This paper present controller designs based on the configuration control framework for a redundant manipulator to accomplish the basic task of desired, end-effector motion, while utilizing the redundancy to achieve the additional tasks such as joint motion control, obstacle avoidance, singularity avoidance. etc. A task based decentralized adaptive scheme is then applied for the configuration variables to track some reference trajectories as close as possible. Simulation results for a direct-drive three-link arm in the vertical plane demonstrate its capabilities for performing various useful tasks.