• Title/Summary/Keyword: 확률제어

Search Result 621, Processing Time 0.03 seconds

Priority-Based Random Access control for M2M Service in 3GPP LTE-A System (3GPP LTE-A 시스템에서 M2M 서비스를 위한 우선순위 기반 임의접속제어)

  • Kim, Nam-Sun
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.12 no.4
    • /
    • pp.406-412
    • /
    • 2019
  • In this paper, we propose two algorithms for classifying services with similar delay characteristics into three classes and allocating radio resources according to priority in LTE-A system where H2H and M2M services coexist. The first is to allocate resources from the higher priority class to the lower priority class, and each class gives priority to H2H over M2M, and the other is to give priority to H2H regardless of delay characteristics except for the class with the highest priority. The RA success probability was analyzed according to the access rate(${\alpha}$) of M2M devices in each class. In comparison with the conventional systems, it was improved from 0.5 to 0.52 for ${\alpha}_{2M}=0.05$ in two classes. In the three classes, the success probability was slightly increased from 0.5 to 0.57 for ${\alpha}_{2M}={\alpha}_{3M}=1$ and from 0.5 to 0.58 for ${\alpha}_{2M}=0.5$ and ${\alpha}_{3M}=0.1$. Although 6 services are considered in the proposed scheme, the RA success probability is almost similar to the previous scheme because the average arrival rate of H2H of each class is set to the same.

Evaluating SR-Based Reinforcement Learning Algorithm Under the Highly Uncertain Decision Task (불확실성이 높은 의사결정 환경에서 SR 기반 강화학습 알고리즘의 성능 분석)

  • Kim, So Hyeon;Lee, Jee Hang
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.11 no.8
    • /
    • pp.331-338
    • /
    • 2022
  • Successor representation (SR) is a model of human reinforcement learning (RL) mimicking the underlying mechanism of hippocampal cells constructing cognitive maps. SR utilizes these learned features to adaptively respond to the frequent reward changes. In this paper, we evaluated the performance of SR under the context where changes in latent variables of environments trigger the reward structure changes. For a benchmark test, we adopted SR-Dyna, an integration of SR into goal-driven Dyna RL algorithm in the 2-stage Markov Decision Task (MDT) in which we can intentionally manipulate the latent variables - state transition uncertainty and goal-condition. To precisely investigate the characteristics of SR, we conducted the experiments while controlling each latent variable that affects the changes in reward structure. Evaluation results showed that SR-Dyna could learn to respond to the reward changes in relation to the changes in latent variables, but could not learn rapidly in that situation. This brings about the necessity to build more robust RL models that can rapidly learn to respond to the frequent changes in the environment in which latent variables and reward structure change at the same time.

Development of Mass Proliferation Control Algorithm of Phytoplankton Using Artificial Neural Network (인공신경망을 이용한 식물플랑크톤의 대량 증식 제어 알고리즘 개발)

  • Seonghwa Park;Jonggu Kim;Minsun Kwon
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.29 no.5
    • /
    • pp.435-444
    • /
    • 2023
  • Suitable environmental conditions in Saemangeum frequently favor phytoplankton growth. There have been occurrences of sudden phytoplankton blooms, surpassing the algae management standards. A model was designed to prevent such blooms using scientific predictive techniques to forecast and regulate the possibility of phytoplankton blooms. We propose effective and efficient algae control measures concerning every phytoplankton species optimized through the policy control of nutrients (DIN, PO4-P) from rivers and controlling lake salinity using gate operations. The probability of phytoplankton blooms was initially forecast using an artificial neural network algorithm based on observations. The model's Kappa number fluctuated from 0.7889 to 1.0000, indicating good to excellent predictive power. The Garson algorithm was then utilized to assess the significance of explanatory variables for every species. Meanwhile, the probability of phytoplankton blooms was anticipated depending on the DIN and salinity value changes. Therefore, the model predicted the precise DIN and salinity concentrations to inhibit phytoplankton blooms for each species. Hence, the green algae model can create effective proactive measures to avoid future phytoplankton blooms in enormous artificial lakes.

Electrical characteristics for Multi-Nanocomposites throuh Surface Control of Epoxy/Nano_Micro $SiO_2$ Particles (Epoxy/Nano_Micro $SiO_2$입자 표면제어를 통한 멀티-나노콤포지트 전기적 특성연구)

  • Park, Young-Byum;Park, Hyun-Su;O, Chung-Yon;Kim, Hak-Jae;Park, Ki-Ryung;Lee, Dae-Kyoung;Park, Jae-Jun
    • Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
    • /
    • 2009.11a
    • /
    • pp.154-154
    • /
    • 2009
  • 본 연구는 고전압 전력기기인 몰드형변압기와 계기용 변성기인 CT, PT 절연특성에 유용한 Epoxy/Nano-Micro Mixture Composites(이하,ENMMC)를 개발하기위해 무엇보다 중요한 것은 Nano입자인 $SiO_2$_10nm입자의 표면을 제어하여 즉, 표면의 소수성을 크게 하여 나노입자의 균질한 분산을 얻은것이 무엇보다 중요하다. 개발된 Epoxy/$SiO_2$_10nm Nanocomposites와 Microcomposites을 기계적 전단응력을 이용하여 균질 혼합을 실시하였다. 이런 조건을 이용한 전기적특성을 측정하기위해 구대구 전극이 완전함침된 평등전계하에서 절연파괴전압을 측정하기 시편을 제조하였다. 마이크로입자의 충진함량을 일정하게 유지하여 나노입자 충진함량비율을 4가지로 변화시켜 절연파괴특성을 연구하였다. 충진함량이 나노입자의 경우 1wt%이하의 값이 상대적으로 우수한 절연파괴특성으로 와이블 플롯을 통하여 알수있었다. 상대적으로 멀티나노콤포지트의 형상파라미터가 큰 결과값을 얻을수 있었다. 그리고 스케일파리미터는 누적확률 밀도함수로서 63.2%에서 대단히 큰 초절연성의 절연소재를 개발할수 있었다.

  • PDF

A Research for the Realness of Game Risks based on ANT (ANT를 통한 게임 위험의 실재성에 대한 연구)

  • Lee, Jangwon;Yoon, Joonsung
    • Journal of Korea Game Society
    • /
    • v.16 no.5
    • /
    • pp.7-22
    • /
    • 2016
  • The risk is subjectively perceived by the subject to judge. In the case of the game, game organizations and watchdog groups also recognized differently occurrence probability and intensity of risk to form a physical relationships of the game with each. Thus, we look only at the risk of their own subjective opinion, the fundamental solution is not possible. In this paper, we conducted a study on the form, occurrence point, and generating processes of risk by analyzing the physical components that make up the network of the game based on ATN in order to confirm definitely the substance and the presence of the game risk. In view of ANT, the game and humans constitute a network through their ability to act as each actor. If the gamer does not clearly recognize the nature of the ability to act of the game, the reverse control and the excess flow occur through remediation properties of the game. Therefore, it requires a more in-depth study in the future with respect to complex structure and relationships of the game-gamer network.

Development of Han River Multi-Reservoir Operation Rules by Linear Tracking (선형추적에 의한 한강수계 복합 저수지 계통의 이수 조작기준 작성)

  • Yu, Ju-Hwan
    • Journal of Korea Water Resources Association
    • /
    • v.33 no.6
    • /
    • pp.733-744
    • /
    • 2000
  • Due to the randomness of reservoir inflow and supply demand it is not easy to establish an optimal reservoir operation rule. However, the operation rule can be derived by the implicit stochastic optimization approach using synthetic inflow data with some demand satisfied. In this study the optimal reservoir operation which was reasonably formulated as Linear Tracking model for maximizing the hydro-energy of seven reservoirs system in the Han river was performed by use of the optimal control theory. Here the operation model made to satisfy the 2001st year demand in the capital area inputted the synthetic inflow data generated by multi-site Markov model. Based on the regressions and statistic analyses of the optimal operation results, monthly reservoir operation rules were developed with the seasonal probabilities of the reservoir stages. The comparatively larger dams which would have more controllability such as Hwacheon, Soyanggang, and Chungju had better regressions between the storages and outflows. The effectiveness of the rules was verified by the simulation during actually operating period.period.

  • PDF

Color Landmark Based Self-Localization for Indoor Mobile Robots (이동 로봇을 위한 컬러 표식 기반 자기 위치 추정 기법)

  • Yoon, Kuk-Jin;Jang, Gi-Jeong;Kim, Sung-Ho;Kweon, In-So
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.7 no.9
    • /
    • pp.749-757
    • /
    • 2001
  • We present a simple artificial landmark model and robust landmark tracking algorithm for mobile robot localization. The landmark model, consisting of symmetric and repetitive color patches, produces color histograms that are invariant under the geometric and photometric distortions. A stochastic approach based on the CONDENSATION tracks the landmark model robustly even under the varying illumination conditions. After the landmark detection, relative position of the mobile robot to the landmark is calculated. Experimental results show that the proposed landmark model is effective and can be detected and tracked in a clustered scene robustly. With the tracked single landmark, we extract geometrical information than achieve accurate localization.

  • PDF

Routing Protocol Based on Zone Master for Hybrid Wireless Networks (하이브리드 무선 네트워크를 위한 존 마스터 기반의 라우팅 프로토콜)

  • Lim, Se-Young;Kim, Hun;Yoo, Myung-Sik
    • Journal of KIISE:Information Networking
    • /
    • v.34 no.4
    • /
    • pp.269-275
    • /
    • 2007
  • Since being constructed without any infrastructure-based network, ad hoc network has been received much attention as a key technology for ubiquitous networks. Due to high bit error rate and dynamically changing network topology in ad hoc network, the routing protocol that provides stable multi-hop communication path is the one of the key issues to address. The previously proposed ad hoc routing protocols have their limitations on network overhead, stability, and scalability. In this paper, we consider hybrid wireless network, which can overcome shortcomings of ad hoc network, and propose a novel routing protocol called zone master-based routing protocol. We verify with computer simulations that the proposed routing protocol outperforms other existing routing protocols in the various wireless environments.

Performance Analysis of Navigation System for Guidance and Control of High Speed Underwater Vehicle System (고속 수중운동체 정밀 유도제어를 위한 항법성능 분석)

  • Hong, Sung-Pyo;Han, Yong-Su
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.17 no.9
    • /
    • pp.2227-2232
    • /
    • 2013
  • To obtain the system requirement specification in the beginning of the precision guidance system development, the effectiveness and reliability analysis for the system are necessary. The main purpose of this research is to obtain the system requirement specification for the high speed unmanned underwater vehicles by carrying out the effectiveness analysis using the modeling and simulation scheme. The effectiveness is position error for target position. Reaching accuracy is expected to be affected by the navigation sensor parameter. Assume that the navigation sensors that is consist of inertial navigation system(INS) and doppler velocity log(DVL) is the parameter. To analyze the effectiveness of each parameter, Monte-Carlo numerical simulation is performed in this research. The effectiveness analysis is carried out using circular error probability(CEP) and variance analyze scheme. Considering the cost function, the specification of the navigation sensor is provided. The cost function is consist of the INS and DVL specification and the price of those sensors.

A Study on the Energy Efficient MAC Layer ARQ Protocol for Wireless Ubiquitous Networks (무선 유비쿼터스 네트워크를 위한 에너지 효율적인 MAC Layer ARQ 프로토콜에 대한 연구)

  • Roh, Jae-Sung;Kim, Wan-Tae
    • Journal of Advanced Navigation Technology
    • /
    • v.15 no.1
    • /
    • pp.54-60
    • /
    • 2011
  • The development of wireless sensor networks (WSN) can be motivated by several types of applications. However, these applications demand an energy-efficient WSN that can prolong the network lifetime and can provide high throughput, low latency and delay. Designing wireless sensor networks with the capability of prolonging network lifetime catch the attention of many researchers in wireless system and network field. Contrasts with Mobile Ad Hoc Network system, Wireless Sensor Networks designs focused more on survivability of each node in the network instead of maximizing data throughput or minimizing end-to-end delay. In this paper, we will study part of data link layer in Open Systems Interconnection (OSI) model, called medium access control (MAC) layer. Since the MAC development of energy aware MAC Protocol for wireless sensor layer controls the physical radio part, it has a large impact on the overall energy consumption and the lifetime of a node. This paper proposes a analytical approach that tries to reduce idle energy consumption, and shows the increasement of network end-to-end arrival rate due to efficiency in energy consumption from time slot management.