• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제9권11호
• /
• pp.4291-4310
• /
• 2015

This paper investigates the traffic offloading over unlicensed bands for two-tier multi-mode small cell networks. We formulate this problem as a Stackelberg game and apply a hierarchical learning framework to jointly maximize the utilities of both macro base station (MBS) and small base stations (SBSs). During the learning process, the MBS behaves as a leader and the SBSs are followers. A pricing mechanism is adopt by MBS and the price information is broadcasted to all SBSs by MBS firstly, then each SBS competes with other SBSs and takes its best response strategies to appropriately allocate the traffic load in licensed and unlicensed band in the sequel, taking the traffic flow payment charged by MBS into consideration. Then, we present a hierarchical Q-learning algorithm (HQL) to discover the Stackelberg equilibrium. Additionally, if some extra information can be obtained via feedback, we propose an improved hierarchical Q-learning algorithm (IHQL) to speed up the SBSs' learning process. Last but not the least, the convergence performance of the proposed two algorithms is analyzed. Numerical experiments are presented to validate the proposed schemes and show the effectiveness.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2001년도 ICCAS
• /
• pp.22.2-22
• /
• 2001

Recently, Reinforcement Learning (RL) methods in MDP have been extended and applied to the POMDP problems. Currently, hierarchical RL methods are widely studied. However, they have the drawback that the learning time and memories are exhausted only for keeping the hierarchical structure, though they aren´t necessary. On the other hand, our "Labeling Q-learning (LQ-learning) proposed previously, has no hierarchical structure, but adopts a characteristic internal memory mechanism. Namely, LQ-1earning agent percepts the state by pair of observation and its label, and the agent can distinguish states, which look as same, but obviously different, more exactly. So to speak, at each step t, we define a new type of perception of its environment ～ot = (ot, $\theta$t), where of is conventional observation, and $\theta$t is the label attached to the observation. Then the conventional ...

• ETRI Journal
• /
• 제38권6호
• /
• pp.1229-1239
• /
• 2016

For efficient interaction between humans and robots, robots should be able to understand the meaning and intention of human behaviors as well as recognize them. This paper proposes an interactive human intention reading method in which a robot develops its own knowledge about the human intention for an object. A robot needs to understand different human behavior structures for different objects. To this end, this paper proposes a hierarchical behavior knowledge network that consists of behavior nodes and directional edges between them. In addition, a human intention reading algorithm that incorporates reinforcement learning is proposed to interactively learn the hierarchical behavior knowledge networks based on context information and human feedback through human behaviors. The effectiveness of the proposed method is demonstrated through play-based experiments between a human and a virtual teddy bear robot with two virtual objects. Experiments with multiple participants are also conducted.

• ETRI Journal
• /
• 제45권1호
• /
• pp.93-104
• /
• 2023

Coreference resolution is a task in discourse analysis that links several headwords used in any document object. We suggest pointer networks-based coreference resolution for Korean using multi-task learning (MTL) with an attention mechanism for a hierarchical structure. As Korean is a head-final language, the head can easily be found. Our model learns the distribution by referring to the same entity position and utilizes a pointer network to conduct coreference resolution depending on the input headword. As the input is a document, the input sequence is very long. Thus, the core idea is to learn the word- and sentence-level distributions in parallel with MTL, while using a shared representation to address the long sequence problem. The suggested technique is used to generate word representations for Korean based on contextual information using pre-trained language models for Korean. In the same experimental conditions, our model performed roughly 1.8% better on CoNLL F1 than previous research without hierarchical structure.

• 한국지능시스템학회:학술대회논문집
• /
• 한국퍼지및지능시스템학회 1996년도 추계학술대회 학술발표 논문집
• /
• pp.172-175
• /
• 1996

In the paper is proposed a hierarchical self-learning fuzzy controller for balancing and position control of an circular inverted pendulum system. To stabilize the pendulum at a specified position, the hierarchical fuzzy controller consists of a supervisory controller, a self-learning fuzzy controller, and a forced disturbance generator. Simulation example shows the effectiveness of the proposed method.

• Educational Technology International
• /
• 제22권2호
• /
• pp.255-283
• /
• 2021

In the early 2020, COVID-19 changed the traditional way of teaching and learning. This paper aimed to explore the impact of college students' perception of course quality on their online learning satisfaction. A total of 4,812 valid samples were extracted, and the difference analysis and hierarchical regression analysis were used to make an empirical analysis of college students' online learning satisfaction. The research results were as follows. Firstly, there was no difference in online learning satisfaction among students by gender and grade. Secondly, learning assessment, course materials, course activities and learner interaction, and course production had a significant positive impact on online learning satisfaction. Course overview and course objectives had an insignificant correlation with online learning satisfaction. Thirdly, the total effect of online learning satisfaction was as follows. Course production had the greatest effect, followed by course activities and student-student interactions, followed by course materials. It was the learning evaluation that showed the least effect. This study can provide empirical reference for college teachers on how to continuously improve online teaching and increase students' satisfaction with online learning.

• 대한산업공학회지
• /
• 제27권2호
• /
• pp.214-225
• /
• 2001

This research deals with an off-line learning method targeted for systematically constructing negotiation strategies in automated electronic commerce. Single-issue negotiation is assumed. Variants of competitive learning and hierarchical clustering method are devised and applied to extracting negotiation strategies, given historical negotiation data set and tactics. Our research is motivated by the following fact: evidence from both theoretical analysis and observations of human interaction shows that if decision makers have prior knowledge on the behaviors of opponents from negotiation, the overall payoff would increase. Simulation-based experiments convinced us that the proposed method is more effective than human negotiation in terms of the ratio of negotiation settlement and resulting payoff.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제11권5호
• /
• pp.2539-2554
• /
• 2017

Regression-based image super resolution (SR) methods have shown great advantage in time consumption while maintaining similar or improved quality performance compared to other learning-based methods. In this paper, we propose a novel single image SR method based on hierarchical regression to further improve the quality performance. As an improvement to other regression-based methods, we introduce a hierarchical scheme into the process of learning multiple regressors. First, training samples are grouped into different clusters according to their geometry similarity, which generates the structure layer. Then in each cluster, a compact dictionary can be learned by Sparse Coding (SC) method and the training samples can be further grouped by dictionary atoms to form the detail layer. Last, a series of projection matrixes, which anchored to dictionary atoms, can be learned by linear regression. Experiment results show that hierarchical scheme can lead to regression that is more precise. Our method achieves superior high quality results compared with several state-of-the-art methods.

• International Journal of Contents
• /
• 제13권3호
• /
• pp.25-31
• /
• 2017

With tremendous advancement of information and communication technologies, mobile learning systems have been widely adopted in language learning contexts, and several frameworks have been developed for identifying and categorizing different factors of mobile-assisted language learning (MALL). However, pre-existing frameworks have limitations when evaluating the importance level of criteria. The purpose of this study is to develop a comprehensive hierarchical framework for identifying and categorizing success factors of MALL and prioritizing them according to the importance level. To do that, AHP method is used to quantitatively estimate weight values of MALL criteria. Results reveal that the priority of MALL criteria is ordered as follows: content, system, learner, language learning. Local weights of each criterion are also analyzed; for example, usefulness, accuracy, and authenticity are critical factors for improving MALL contents. Ease of use and mobility of MALL systems are also considered more critical than other systematic factors. In addition, availability of immediate feedback and self-directness has the highest weight values of importance. The findings of the study are discussed regarding hierarchical orders of MALL criteria and conclude that successful MALL implementation may be achieved if related elements are diversely measured and evaluated. Pedagogical implications and suggestions for further research are also presented.

• 디지털콘텐츠학회 논문지
• /
• 제19권2호
• /
• pp.415-423
• /
• 2018

최근, 컴퓨터 분야의 기계 학습(Machine Learning)과 딥러닝(Deep Learning) 등 컴퓨터 관련 학습이 각광을 받고 있다. 이들은 인공 신경망(Artificial Neural Network)을 이용하여 가장 하위 레벨로부터 학습을 시작하여, 최상위 레벨까지 그 결과를 전달하여 최종 결과를 산출하는 방식이다. 하위레벨로부터의 체계적인 학습을 통한 효과적인 성장 및 교육 방안에 대한 연구는 다양한 분야에서 이루어지고 있으나, 체계적인 규칙과 방법에 기반한 모델은 찾아보기가 힘들다. 이에, 본 논문에서는 성장 및 융합 모델인, TNT 모델(Transitive Nested Triangle Model)을 처음으로 제안한다. 제안하는 모델은 기하학적인 형태를 통해 형성된 각 기능들이 유기적 계층 관계를 형성하여, 상위로 성장 및 융합하면서, 그 결과가 반복 사용되는 순환적 재귀 모델이다. 즉, '수평적 형제 병합에 이은 상위로의 융합(Horizontal Sibling Merges and Upward Convergence)'의 분석적 방법이다. 이러한 모델은 공학, 디지털공학, 인문학, 예술학 등에 모두 적용될 수 있는 기본기적 이론으로, 본 연구에서는 제안하는 TNT 모델을 설명하는 것에 그 초점을 둔다.