• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.11
• /
• pp.4291-4310
• /
• 2015

This paper investigates the traffic offloading over unlicensed bands for two-tier multi-mode small cell networks. We formulate this problem as a Stackelberg game and apply a hierarchical learning framework to jointly maximize the utilities of both macro base station (MBS) and small base stations (SBSs). During the learning process, the MBS behaves as a leader and the SBSs are followers. A pricing mechanism is adopt by MBS and the price information is broadcasted to all SBSs by MBS firstly, then each SBS competes with other SBSs and takes its best response strategies to appropriately allocate the traffic load in licensed and unlicensed band in the sequel, taking the traffic flow payment charged by MBS into consideration. Then, we present a hierarchical Q-learning algorithm (HQL) to discover the Stackelberg equilibrium. Additionally, if some extra information can be obtained via feedback, we propose an improved hierarchical Q-learning algorithm (IHQL) to speed up the SBSs' learning process. Last but not the least, the convergence performance of the proposed two algorithms is analyzed. Numerical experiments are presented to validate the proposed schemes and show the effectiveness.

• 제어로봇시스템학회:학술대회논문집
• /
• 2001.10a
• /
• pp.22.2-22
• /
• 2001

Recently, Reinforcement Learning (RL) methods in MDP have been extended and applied to the POMDP problems. Currently, hierarchical RL methods are widely studied. However, they have the drawback that the learning time and memories are exhausted only for keeping the hierarchical structure, though they aren´t necessary. On the other hand, our "Labeling Q-learning (LQ-learning) proposed previously, has no hierarchical structure, but adopts a characteristic internal memory mechanism. Namely, LQ-1earning agent percepts the state by pair of observation and its label, and the agent can distinguish states, which look as same, but obviously different, more exactly. So to speak, at each step t, we define a new type of perception of its environment ～ot = (ot, $\theta$t), where of is conventional observation, and $\theta$t is the label attached to the observation. Then the conventional ...

• ETRI Journal
• /
• v.38 no.6
• /
• pp.1229-1239
• /
• 2016

For efficient interaction between humans and robots, robots should be able to understand the meaning and intention of human behaviors as well as recognize them. This paper proposes an interactive human intention reading method in which a robot develops its own knowledge about the human intention for an object. A robot needs to understand different human behavior structures for different objects. To this end, this paper proposes a hierarchical behavior knowledge network that consists of behavior nodes and directional edges between them. In addition, a human intention reading algorithm that incorporates reinforcement learning is proposed to interactively learn the hierarchical behavior knowledge networks based on context information and human feedback through human behaviors. The effectiveness of the proposed method is demonstrated through play-based experiments between a human and a virtual teddy bear robot with two virtual objects. Experiments with multiple participants are also conducted.

• ETRI Journal
• /
• v.45 no.1
• /
• pp.93-104
• /
• 2023

Coreference resolution is a task in discourse analysis that links several headwords used in any document object. We suggest pointer networks-based coreference resolution for Korean using multi-task learning (MTL) with an attention mechanism for a hierarchical structure. As Korean is a head-final language, the head can easily be found. Our model learns the distribution by referring to the same entity position and utilizes a pointer network to conduct coreference resolution depending on the input headword. As the input is a document, the input sequence is very long. Thus, the core idea is to learn the word- and sentence-level distributions in parallel with MTL, while using a shared representation to address the long sequence problem. The suggested technique is used to generate word representations for Korean based on contextual information using pre-trained language models for Korean. In the same experimental conditions, our model performed roughly 1.8% better on CoNLL F1 than previous research without hierarchical structure.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 1996.10a
• /
• pp.172-175
• /
• 1996

In the paper is proposed a hierarchical self-learning fuzzy controller for balancing and position control of an circular inverted pendulum system. To stabilize the pendulum at a specified position, the hierarchical fuzzy controller consists of a supervisory controller, a self-learning fuzzy controller, and a forced disturbance generator. Simulation example shows the effectiveness of the proposed method.

• Educational Technology International
• /
• v.22 no.2
• /
• pp.255-283
• /
• 2021

In the early 2020, COVID-19 changed the traditional way of teaching and learning. This paper aimed to explore the impact of college students' perception of course quality on their online learning satisfaction. A total of 4,812 valid samples were extracted, and the difference analysis and hierarchical regression analysis were used to make an empirical analysis of college students' online learning satisfaction. The research results were as follows. Firstly, there was no difference in online learning satisfaction among students by gender and grade. Secondly, learning assessment, course materials, course activities and learner interaction, and course production had a significant positive impact on online learning satisfaction. Course overview and course objectives had an insignificant correlation with online learning satisfaction. Thirdly, the total effect of online learning satisfaction was as follows. Course production had the greatest effect, followed by course activities and student-student interactions, followed by course materials. It was the learning evaluation that showed the least effect. This study can provide empirical reference for college teachers on how to continuously improve online teaching and increase students' satisfaction with online learning.

• Journal of Korean Institute of Industrial Engineers
• /
• v.27 no.2
• /
• pp.214-225
• /
• 2001

This research deals with an off-line learning method targeted for systematically constructing negotiation strategies in automated electronic commerce. Single-issue negotiation is assumed. Variants of competitive learning and hierarchical clustering method are devised and applied to extracting negotiation strategies, given historical negotiation data set and tactics. Our research is motivated by the following fact: evidence from both theoretical analysis and observations of human interaction shows that if decision makers have prior knowledge on the behaviors of opponents from negotiation, the overall payoff would increase. Simulation-based experiments convinced us that the proposed method is more effective than human negotiation in terms of the ratio of negotiation settlement and resulting payoff.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.11 no.5
• /
• pp.2539-2554
• /
• 2017

Regression-based image super resolution (SR) methods have shown great advantage in time consumption while maintaining similar or improved quality performance compared to other learning-based methods. In this paper, we propose a novel single image SR method based on hierarchical regression to further improve the quality performance. As an improvement to other regression-based methods, we introduce a hierarchical scheme into the process of learning multiple regressors. First, training samples are grouped into different clusters according to their geometry similarity, which generates the structure layer. Then in each cluster, a compact dictionary can be learned by Sparse Coding (SC) method and the training samples can be further grouped by dictionary atoms to form the detail layer. Last, a series of projection matrixes, which anchored to dictionary atoms, can be learned by linear regression. Experiment results show that hierarchical scheme can lead to regression that is more precise. Our method achieves superior high quality results compared with several state-of-the-art methods.

• International Journal of Contents
• /
• v.13 no.3
• /
• pp.25-31
• /
• 2017

With tremendous advancement of information and communication technologies, mobile learning systems have been widely adopted in language learning contexts, and several frameworks have been developed for identifying and categorizing different factors of mobile-assisted language learning (MALL). However, pre-existing frameworks have limitations when evaluating the importance level of criteria. The purpose of this study is to develop a comprehensive hierarchical framework for identifying and categorizing success factors of MALL and prioritizing them according to the importance level. To do that, AHP method is used to quantitatively estimate weight values of MALL criteria. Results reveal that the priority of MALL criteria is ordered as follows: content, system, learner, language learning. Local weights of each criterion are also analyzed; for example, usefulness, accuracy, and authenticity are critical factors for improving MALL contents. Ease of use and mobility of MALL systems are also considered more critical than other systematic factors. In addition, availability of immediate feedback and self-directness has the highest weight values of importance. The findings of the study are discussed regarding hierarchical orders of MALL criteria and conclude that successful MALL implementation may be achieved if related elements are diversely measured and evaluated. Pedagogical implications and suggestions for further research are also presented.

• Journal of Digital Contents Society
• /
• v.19 no.2
• /
• pp.415-423
• /
• 2018

In recent years, Computer-based learning, such as machine learning and deep learning in the computer field, is attracting attention. They start learning from the lowest level and propagate the result to the highest level to calculate the final result. Research literature has shown that systematic learning and growth can yield good results. However, systematic models based on systematic models are hard to find, compared to various and extensive research attempts. To this end, this paper proposes the first TNT(Transitive Nested Triangle)model, which is a growth and fusion model that can be used in various aspects. This model can be said to be a recursive model in which each function formed through geometric forms an organic hierarchical relationship, and the result is used again as they grow and converge to the top. That is, it is an analytical method called 'Horizontal Sibling Merges and Upward Convergence'. This model is applicable to various aspects. In this study, we focus on explaining the TNT model.