• 제어로봇시스템학회:학술대회논문집
• /
• 2001.10a
• /
• pp.22.2-22
• /
• 2001

Recently, Reinforcement Learning (RL) methods in MDP have been extended and applied to the POMDP problems. Currently, hierarchical RL methods are widely studied. However, they have the drawback that the learning time and memories are exhausted only for keeping the hierarchical structure, though they aren´t necessary. On the other hand, our "Labeling Q-learning (LQ-learning) proposed previously, has no hierarchical structure, but adopts a characteristic internal memory mechanism. Namely, LQ-1earning agent percepts the state by pair of observation and its label, and the agent can distinguish states, which look as same, but obviously different, more exactly. So to speak, at each step t, we define a new type of perception of its environment ～ot = (ot, $\theta$t), where of is conventional observation, and $\theta$t is the label attached to the observation. Then the conventional ...

• Genomics & Informatics
• /
• v.16 no.4
• /
• pp.38.1-38.3
• /
• 2018

Gene-gene interaction (GGI) analysis is known to play an important role in explaining missing heritability. Many previous studies have already proposed software to analyze GGI, but most methods focus on a binary phenotype in a case-control design. In this study, we developed "Hierarchical structural CoMponent analysis of Gene-Gene Interactions" (HisCoM-GGI) software for GGI analysis with a continuous phenotype. The HisCoM-GGI method considers hierarchical structural relationships between genes and single nucleotide polymorphisms (SNPs), enabling both gene-level and SNP-level interaction analysis in a single model. Furthermore, this software accepts various types of genomic data and supports data management and multithreading to improve the efficiency of genome-wide association study data analysis. We expect that HisCoM-GGI software will provide advanced accessibility to researchers in genetic interaction studies and a more effective way to understand biological mechanisms of complex diseases.

• ETRI Journal
• /
• v.39 no.4
• /
• pp.502-513
• /
• 2017

For video understanding, namely analyzing who did what in a video, actions along with objects are primary elements. Most studies on actions have handled recognition problems for a well-trimmed video and focused on enhancing their classification performance. However, action detection, including localization as well as recognition, is required because, in general, actions intersect in time and space. In addition, most studies have not considered extensibility for a newly added action that has been previously trained. Therefore, proposed in this paper is an extensible hierarchical method for detecting generic actions, which combine object movements and spatial relations between two objects, and inherited actions, which are determined by the related objects through an ontology and rule based methodology. The hierarchical design of the method enables it to detect any interactive actions based on the spatial relations between two objects. The method using object information achieves an F-measure of 90.27%. Moreover, this paper describes the extensibility of the method for a new action contained in a video from a video domain that is different from the dataset used.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.17 no.5
• /
• pp.598-603
• /
• 2007

To solve the rule explosion problem in multi-input fuzzy system, a method of converting a given fuzzy system to 2 layered hierarchical fuzzy system has been reported, where at the 1st layer, linearly independent fuzzy rule vectors generated from the given fuzzy system are used and, at the 2nd layer, linear combinations of these independent fuzzy rule vectors are used. In this paper, the steapest descent algorithm is presented to learn the fuzzy rule vectors and related coefficients for the equivalent 2 layered hierarchical structure. By simulation of learning of ball and beam control system, the feasibility of proposed learning scheme is shown.

• Journal of IKEEE
• /
• v.22 no.4
• /
• pp.1147-1151
• /
• 2018

As personal users create and share lots of contents at any time and any places, new networking architecture such as content centric networking (CCN) has emerged. CCN utilizes content name as a packet identifier, not address. However, current CCN has a limitation for content source mobility management. The movement of content sources cause long delivery latency and long service disruption. To solve that, a hierarchical mobility management was was proposed. However, the hierarchical mobility management scheme has still the loss of interest packets and long handoff latency. So, this paper presents the hybrid hierarchical mobility management in mobile CCN environements to reduce both the loss rate of interest packets and the handoff latency. It is shown from the performance evaluations shows that the proposed scheme provides low loss rate of control message.

• Korean Journal of Applied Biomechanics
• /
• v.30 no.2
• /
• pp.131-144
• /
• 2020

Objective: The purpose of this study was to examine the effect of degrees of freedom on the multi-synergies in two hierarchies of human hand system during force production and releasing tasks. Method: In this study, the constrained movements of the aiming and releasing actions using both hands and fingers during archery-like shooting were implemented as experimental tasks. The participants produced a pulling force holding the customized frame (mimicking an archery bow, with a set of force transducers) and kept it consistently for about 5 seconds, and released fingers as quickly as possible in a self-paced manner within the next 5 seconds. An analytical method based on the uncontrolled manifold hypothesis was used to quantify the stability index (synergy index) in two hierarchies including two hands (upper hierarchy) and individual fingers (lower hierarchy). Results: The results confirmed that the positive synergy pattern showed simultaneously at the upper and lower hierarchies, and the kinetic degrees of freedom were associated with the increment of hierarchical synergy indices and the performance indices. Also, the synergy indices of both hierarchies showed significant positive correlations with the performance accuracy during the task. Conclusion: The results of this study suggest that the human control system actively uses extra degrees of freedom to stabilize task performance variables. Further increasing the degree of freedom at one level of hierarchy induces positive interactions across hierarchical control levels, which in turn positively affects the accuracy and precision of task performance.

• 제어로봇시스템학회:학술대회논문집
• /
• 1987.10b
• /
• pp.223-227
• /
• 1987

This paper presents the extended interaction prediction method for large scale discrete-time systems with interconnected state and control. Feedback gain is obtained from decentralized calculation without solving Riccati equation. Hence, Computer storage and calculation time is reduced.

• 제어로봇시스템학회:학술대회논문집
• /
• 1996.10b
• /
• pp.1509-1512
• /
• 1996

This paper presents an intelligent autopilot for STT missiles with multiple controllers. The mixed H$_{2}$/H$_{\infty}$ control technique is applied for each controller and implemented by using the genetic searching algorithm. To facilitate automatic switching of multiple controllers under different operating conditions, an error based switching scheme is also combined with the multiple controllers at the higher level, which constitutes a hierarchical intelligent control system. It is shown via computer simulation that the proposed autopilot outperforms the conventional one..

• Journal of information and communication convergence engineering
• /
• v.8 no.2
• /
• pp.212-218
• /
• 2010

In wireless sensor networks (WSNs), both efficient energy management and Quality of Service (QoS) are important issues for some applications. For creating robust networks, real-time services are usually employed to satisfy the QoS requirements. In this paper, we proposed a hierarchical real-time MAC (medium access control) protocol for (m,k)-firm constraint in wireless sensor networks shortly called HRTS-MAC. The proposed HRTS-MAC protocol is based on a dynamic priority assignment by (m,k)-firm constraint. In a tree structure topology, the scheduling algorithm assigns uniform transmitting opportunities to each node. The paper also provides experimental results and comparison of the proposed protocol with E_DBP scheduling algorithm.

• Proceedings of the KIEE Conference
• /
• 2011.07a
• /
• pp.302-303
• /
• 2011

Smart WAMAC (Wide Area Monitoring And Control) System, which supplements control function with the function of WAMS(Wide Area Monitoring System), is an intelligent system not only monitoring the wide area but controlling the power equipment according to defined procedure. This paper presents WAMAC system architecture for hierarchical Infra and considerations to design and implement.