• 제목/요약/키워드: Learning Automata

검색결과 24건 처리시간 0.036초

회귀 신경망과 유한 상태 자동기계 동정화 (A Class of Recurrent Neural Networks for the Identification of Finite State Automata)

  • 원성환;송익호;민황기;안태훈
    • 한국정보전자통신기술학회논문지
    • /
    • 제5권1호
    • /
    • pp.33-44
    • /
    • 2012
  • 이 논문에서는 얼개가 새로운 회귀 신경망을 제안하고, 그 신경망이 어떤 이산 시간 동적 시스템도 동정화 할 수 있음을 보인다. 또한, 제안한 신경망을 써서 유한 상태 자동기계를 부호화, 동정화, 그리고 추출하는 데에 적용하여 그 성능을 살펴본다. 제안한 신경망에 고친 비용함수를 쓰고 혼합 그리디 모의 담금질 방법으로 학습시키면 유한 상태 자동기계를 동정화하는 성능이 일반적으로 다른 기법보다 더 낫다는 것을 모의실험으로 보인다.

Dynamic Adjustment Strategy of n-Epidemic Routing Protocol for Opportunistic Networks: A Learning Automata Approach

  • Zhang, Feng;Wang, Xiaoming;Zhang, Lichen;Li, Peng;Wang, Liang;Yu, Wangyang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제11권4호
    • /
    • pp.2020-2037
    • /
    • 2017
  • In order to improve the energy efficiency of n-Epidemic routing protocol in opportunistic networks, in which a stable end-to-end forwarding path usually does not exist, a novel adjustment strategy for parameter n is proposed using learning atuomata principle. First, nodes dynamically update the average energy level of current environment while moving around. Second, nodes with lower energy level relative to their neighbors take larger n avoiding energy consumption during message replications and vice versa. Third, nodes will only replicate messages to their neighbors when the number of neighbors reaches or exceeds the threshold n. Thus the number of message transmissions is reduced and energy is conserved accordingly. The simulation results show that, n-Epidemic routing protocol with the proposed adjustment method can efficiently reduce and balance energy consumption. Furthermore, the key metric of delivery ratio is improved compared with the original n-Epidemic routing protocol. Obviously the proposed scheme prolongs the network life time because of the equilibrium of energy consumption among nodes.

Learning Automata Based Multipath Multicasting in Cognitive Radio Networks

  • Ali, Asad;Qadir, Junaid;Baig, Adeel
    • Journal of Communications and Networks
    • /
    • 제17권4호
    • /
    • pp.406-418
    • /
    • 2015
  • Cognitive radio networks (CRNs) have emerged as a promising solution to the problem of spectrum under utilization and artificial radio spectrum scarcity. The paradigm of dynamic spectrum access allows a secondary network comprising of secondary users (SUs) to coexist with a primary network comprising of licensed primary users (PUs) subject to the condition that SUs do not cause any interference to the primary network. Since it is necessary for SUs to avoid any interference to the primary network, PU activity precludes attempts of SUs to access the licensed spectrum and forces frequent channel switching for SUs. This dynamic nature of CRNs, coupled with the possibility that an SU may not share a common channel with all its neighbors, makes the task of multicast routing especially challenging. In this work, we have proposed a novel multipath on-demand multicast routing protocol for CRNs. The approach of multipath routing, although commonly used in unicast routing, has not been explored for multicasting earlier. Motivated by the fact that CRNs have highly dynamic conditions, whose parameters are often unknown, the multicast routing problem is modeled in the reinforcement learning based framework of learning automata. Simulation results demonstrate that the approach of multipath multicasting is feasible, with our proposed protocol showing a superior performance to a baseline state-of-the-art CRN multicasting protocol.

Modeling and Stimulating Node Cooperation in Wireless Ad Hoc Networks

  • Arghavani, Abbas;Arghavani, Mahdi;Sargazi, Abolfazl;Ahmadi, Mahmood
    • ETRI Journal
    • /
    • 제37권1호
    • /
    • pp.77-87
    • /
    • 2015
  • In wireless networks, cooperation is necessary for many protocols, such as routing, clock synchronization, and security. It is known that cooperator nodes suffer greatly from problems such as increasing energy consumption. Therefore, rational nodes have no incentive to cooperatively forward traffic for others. A rational node is different from a malicious node. It is a node that makes the best decision in each state (cooperate or non-cooperate). In this paper, game theory is used to analyze the cooperation between nodes. An evolutionary game has been investigated using two nodes, and their strategies have been compared to find the best one. Subsequently, two approaches, one based on a genetic algorithm (GA) and the other on learning automata (LA), are presented to incite nodes for cooperating in a noisy environment. As you will see later, the GA strategy is able to disable the effect of noise by using a big enough chromosome; however, it cannot persuade nodes to cooperate in a noisefree environment. Unlike the GA strategy, the LA strategy shows good results in a noise-free environment because it has good agreement in cooperation-based strategies in both types of environment (noise-free and noisy).

분산 시스템에서 동적 파일 이전과 수학적 모델 (Dynamic File Migration And Mathematical model in Distributed Computer Systems)

  • 문원식
    • 디지털산업정보학회논문지
    • /
    • 제10권3호
    • /
    • pp.35-40
    • /
    • 2014
  • Many researches have been conducted to achieve improvement in distributed system that connects multiple computer systems via communication lines. Among others, the load balancing and file migration are considered to have significant impact on the performance of distributed system. The dynamic file migration algorithm common in distributed processing system involved complex calculations of decision function necessary for file migration and required migration of control messages for the performance of decision function. However, the performance of this decision function puts significant computational strain on computer. As one single network is shared by all computers, more computers connected to network means migration of more control messages from file migration, causing the network to trigger bottleneck in distributed processing system. Therefore, it has become imperative to carry out the research that aims to reduce the number of control messages that will be migrated. In this study, the learning automata was used for file migration which would requires only the file reference-related information to determine whether file migration has been made or determine the time and site of file migration, depending on the file conditions, thus reflecting the status of current system well and eliminating the message transfer and additional calculation overhead for file migration. Moreover, mathematical model for file migration was described in order to verify the proposed model. The results from mathematical model and simulation model suggest that the proposed model is well-suited to the distributed system.

컴퓨터 통합 샌산을 위한 통신망의 성능관리 (Performance management of communication networks for computer integrated manufacturing Part ll: Decision making)

  • Lee, Suk
    • 한국정밀공학회지
    • /
    • 제11권4호
    • /
    • pp.138-147
    • /
    • 1994
  • Performance management of computer networks is intended to improve a given network performance in order for more efficient information exchange between subsystems of an integrated large-scale system. Improtance of performance management is growing as many function of the large- scale system depend on the quality of communication services provided by the network. The role of performance management is to manipulate the adjustable protocol parameters on line so that the network can adapt itself to a dynamic environment. This can be divided into two subtasks : performance evaluation to find how changes in protocol parameters affect the network performance and decision making to detemine the magnitude and direction of parameter adjustment. This paper is the second part of the two papers focusing on conceptual design, development, and evaluation of performance management for token bus networks. This paper specifically deals with the task of decision making which utilizes the principles of stochastic optimization and learning automata. The developed algorithm can adjuxt four timer settings of a token bus protocol based on the result of performance evaluation. The overall performance management has been evaluated for its efficacy on a network testbed.

  • PDF

A Transformation-Based Learning Method on Generating Korean Standard Pronunciation

  • Kim, Dong-Sung;Roh, Chang-Hwa
    • 한국언어정보학회:학술대회논문집
    • /
    • 한국언어정보학회 2007년도 정기학술대회
    • /
    • pp.241-248
    • /
    • 2007
  • In this paper, we propose a Transformation-Based Learning (TBL) method on generating the Korean standard pronunciation. Previous studies on the phonological processing have been focused on the phonological rule applications and the finite state automata (Johnson 1984; Kaplan and Kay 1994; Koskenniemi 1983; Bird 1995). In case of Korean computational phonology, some former researches have approached the phonological rule based pronunciation generation system (Lee et al. 2005; Lee 1998). This study suggests a corpus-based and data-oriented rule learning method on generating Korean standard pronunciation. In order to substituting rule-based generation with corpus-based one, an aligned corpus between an input and its pronunciation counterpart has been devised. We conducted an experiment on generating the standard pronunciation with the TBL algorithm, based on this aligned corpus.

  • PDF

창의적 피지컬 컴퓨팅 기반 사회정서학습 프로그램 개발 (Development of Social and Emotional Learning Program using Creative Physical Computing)

  • 이준표;김성애
    • 한국컴퓨터정보학회:학술대회논문집
    • /
    • 한국컴퓨터정보학회 2019년도 제59차 동계학술대회논문집 27권1호
    • /
    • pp.205-206
    • /
    • 2019
  • 본 논문에서는 오토마타를 활용한 창의 융합 교육으로 학생들에게 기술과 공학 그리고 예술의 융합적 상상력을 불어넣을 수 있는 교육과정을 제안하고 이를 통해 인지능력과 감정조절, 그리고 공감 능력을 향상시키는 것을 가능하게 하는 사회정서학습인 SEL(Social and Emotional Learning)을 수행할 수 있도록 한다. 제안하는 프로그램을 통해 학생들의 감성을 자극하고 새로운 생각을 유도함으로써 올바른 인성을 가질 수 있도록 한다.

  • PDF

오토마타 학습을 위한 놀이중심의 학습 프로그램 설계 (A design of a Learning Program based on the Playing Activity for an Automata Learning)

  • 김수이;성영훈;구정모;한병래;이재인
    • 한국정보교육학회:학술대회논문집
    • /
    • 한국정보교육학회 2009년도 하계학술대회
    • /
    • pp.67-72
    • /
    • 2009
  • 현재 초등학교의 정보통신기술교육 내용은 실생활에서 컴퓨터를 도구로 활용한 교과 학습이 대부분이다. 그러나 컴퓨터의 기초개념과 원리를 이해시킬 수 있는 학습과정이 부족하여 컴퓨터교과목에 대한 학업성취도와 지적 능력 신장에 한계점을 가지고 있다. 따라서 본 연구는 오토마타를 이용한 놀이중심의 학습 프로그램을 개발 적용하여 컴퓨터의 기초원리 학습시 학습자의 학업 성취도를 향상 시킬 수 있는 프로그램을 설계하였다.

  • PDF

Stochastic MAC-layer Interference Model for Opportunistic Spectrum Access: A Weighted Graphical Game Approach

  • Zhao, Qian;Shen, Liang;Ding, Cheng
    • Journal of Communications and Networks
    • /
    • 제18권3호
    • /
    • pp.411-419
    • /
    • 2016
  • This article investigates the problem of distributed channel selection in opportunistic spectrum access networks from a perspective of interference minimization. The traditional physical (PHY)-layer interference model is for information theoretic analysis. When practical multiple access mechanisms are considered, the recently developed binary medium access control (MAC)-layer interference model in the previous work is more useful, in which the experienced interference of a user is defined as the number of competing users. However, the binary model is not accurate in mathematics analysis with poor achievable performance. Therefore, we propose a real-valued one called stochastic MAC-layer interference model, where the utility of a player is defined as a function of the aggregate weight of the stochastic interference of competing neighbors. Then, the distributed channel selection problem in the stochastic MAC-layer interference model is formulated as a weighted stochastic MAC-layer interference minimization game and we proved that the game is an exact potential game which exists one pure strategy Nash equilibrium point at least. By using the proposed stochastic learning-automata based uncoupled algorithm with heterogeneous learning parameter (SLA-H), we can achieve suboptimal convergence averagely and this result can be verified in the simulation. Moreover, the simulated results also prove that the proposed stochastic model can achieve higher throughput performance and faster convergence behavior than the binary one.