• Journal of the Korean Institute of Telematics and Electronics C
• /
• v.35C no.11
• /
• pp.76-88
• /
• 1998

While most of the research on reinforcement learning assumed a discrete control space, many of the real world control problems need to have continuous output. This can be achieved by using continuous mapping functions for the value and action functions of the reinforcement learning architecture. Two questions arise here however. One is what sort of function representation to use and the other is how to determine the amount of noise for search in action space. The ubiquitous neural network is used here to learn the value and policy functions. Next, the reinforcement predictor that is intended to predict the next reinforcement is introduced that also determines the amount of noise to add to the controller output. The proposed reinforcement learning architecture is found to have a sound on-line learning control performance especially at high-speed road following of high curvature road. Both computer simulation and actual experiments on a test vehicle have been performed and their efficiency and effectiveness has been verified.

• Transactions on Electrical and Electronic Materials
• /
• v.18 no.5
• /
• pp.287-297
• /
• 2017

Novel power system stabilizers (PSSs) have been proposed to effectively dampen low frequency oscillations (LFOs) in multi-machine power systems and have attracted increasing research interest in recent years. Due to this attention, recently, fractional order controllers (FOCs) have found new applications in power system stability issues. Here, a tilt-integral-derivative power system stabilizer (TID-PSS) is proposed to enhance the dynamic stability of a multi-machine power system by providing additional damping to the LFOs. The TID is an extended version of the classical proportional-integral-derivative (PID) applying fractional calculus. The design of the proposed three-parameter tunable TID-PSS is systematized as a nonlinear time domain optimization problem in which the tunable parameters are adjusted concurrently using a modified group search optimization (MGSO) algorithm. An integral of the time multiplied squared error (ITSE) performance index is considered as the objective function. The proposed stabilizer is simulated in the MATLAB/SIMULINK environment using the FOMCON toolbox and the dynamic performance is evaluated on a 3-machine 6-bus power system. The TID-PSS is compared with both classical PID-PSS (PID-PSS) and conventional PSS (CPSS) using eigenvalue analysis and time domain simulations. Sensitivity analyses are performed to assess the robustness of the proposed controller against large changes in system loading conditions and parameters. The results indicate that the proposed TID-PSS provides the better dynamic performance and robustness compared with the PID-PSS and CPSS.

• International Journal of Aeronautical and Space Sciences
• /
• v.11 no.1
• /
• pp.10-18
• /
• 2010

The purpose of this paper deals with direct multiple-shooting method (DMS) to resolve helicopter maneuver problems of helicopters. The maneuver problem is transformed into nonlinear problems and solved DMS technique. The DMS method is easy in handling constraints and it has large convergence radius compared to other strategies. When parameterized with piecewise constant controls, the problems become most effectively tractable because the search direction is easily estimated by solving the structured Karush-Kuhn-Tucker (KKT) system. However, generally the computation of function, gradients and Hessian matrices has considerably time-consuming for complex system such as helicopter. This study focused on the approximation of the KKT system using the matrix exponential and its integrals. The propose method is validated by solving optimal control problems for the linear system where the KKT system is exactly expressed with the matrix exponential and its integrals. The trajectory tracking problem of various maneuvers like bob up, sidestep near hovering flight speed and hurdle hop, slalom, transient turn, acceleration and deceleration are analyzed to investigate the effects of algorithmic details. The results show the matrix exponential approach to compute gradients and the Hessian matrix is most efficient among the implemented methods when combined with the mixed time integration method for the system dynamics. The analyses with the proposed method show good convergence and capability of tracking the prescribed trajectory. Therefore, it can be used to solve critical areas of helicopter flight dynamic problems.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.6 no.4
• /
• pp.71-80
• /
• 1996

This paper presents stabilization and position control of the Inverted-Pendulum system with cart by using Evolution Strategies that is one of the Evolutionary Computation and is effective in searching real number. The control input of the Inverted-Pendulum is the element of chromosome corresponding to the divided space of Inverted-Pendulum state variable x, x, 0, 0 . In general, the larger the length of the chromosome is, the longer the time of evolution to search optimal solution is. So in this paper, we propose a scheme that reduce the state space by half by taking the method, that is, converting only the sign of the control input without obtaining separately for the symmetrical sections of the Inverted-Pendulum to improve the speed of Evolution, and improved the efficiency of the entire system in addition to the improvement of the chromosome's evolution time by carrying out the chromosome's evolutional process by two steps one of which is that cart is positioned near the control point and the other cart is positioned far from that point. We propose another method that is Neural Network-Evolution StrategiedNN-ES) Controller. We verify the effectiveness of the proposed control scheme by computer simulations.

• Journal of the Korea Society for Simulation
• /
• v.21 no.3
• /
• pp.1-9
• /
• 2012

This paper proposes automatic precision approach radar (PAR) control system using digital signal to increase the safety of aircraft, and discrete event systems specification (DEVS) methodology is utilized to verify the proposed system. Traditionally, a landing aircraft is controlled by the human voice of a final approach controller. However, the voice information can be missed during transmission, and pilots may also act improperly because of incorrectness of auditory signals. The proposed system enables the stable operation of the aircraft, regardless of the pilot's capability. Communicating DEVS (C-DEVS) is used to analyze and verify the behavior of the proposed system. A composed C-DEVS atomic model has overall composed discrete state sets of models, and the state sequence acquired through full state search is utilized to verify the safeness and the liveness of a system behavior. The C-DEVS model of the proposed system shows the same behavior with the traditional PAR control system.

• Journal of IKEEE
• /
• v.19 no.2
• /
• pp.225-231
• /
• 2015

The parameter K which decides how much to convert wind energy to electric energy in MPPT(maximum power point tracking) control of wind turbine system using torque controller is changed because blade shape and air density change. If the parameter K is not optimal value, power lose occur. The changed parameter K is important issue in wind turbine system. In this paper, to solve this problem, considering wind turbine system using back-to-back converter control and torque control, we propose the adaptive MPPT algorithm which performs fast control by using initial K, estimates mechanical power using Kalman filter method, uses the estimated mechanical power as input for MPPT algorithm again, and consequently performs optimal MPPT control.

• Journal of Korea Society of Industrial Information Systems
• /
• v.15 no.2
• /
• pp.59-67
• /
• 2010

Rice varietal information exchange is vital for agricultural experiments and trials. With the growing size of rice data gathered around the world, and numerous research and development achievements, the effective collection and convenient ways of data dissemination is an important aspect to be dealt with. The collection of this data is continuously worked out through various international cooperation and network programs. The problem in acquiring this information anytime anywhere is the new challenge faced by rice breeders, scientist and crop information specialists, in order to perform rapid analysis and obtain significant results in rice research, thus alleviating rice production. To address these constraints, we propose an Online Analytical Query System, a web query application to provide breeders and rice scientist around the world a fast web search engine for rice varieties, giving the users the freedom to choose from which trial it has been used, trait observation parameters as well as geographical or weather conditions, and location specifications. The application uses data warehouse techniques and OLAP for summarization of agricultural trials conducted, and statistical analysis in deriving outstanding varieties used in these trials, consolidated in an Model-View-Controller Web framework.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.18 no.5
• /
• pp.769-776
• /
• 2023

In this paper, we designed an MLSA(Match-line Sense Amplifier) for low-power CAM(Content Addressable Memory). By using the MLSA and precharge controller, we reduced power consumption during CAM operation by employing a selective match-line charging technique to mitigate power consumption caused by mismatch. Additionally, we further reduced power consumption due to leakage current by terminating precharge early when a mismatch occurs during the search operation. The designed circuit exhibited superior performance compared to the existing circuits, with a reduction of 6.92% and 23.30% in power consumption and propagation delay time, respectively. Moreover, it demonstrated a significant decrease of 29.92% and 52.31% in product-delay-product (PDP) and energy-delay-product (EDP). The proposed circuit was validated using SPECTRE simulation with TSMC 65nm CMOS process.

• Journal of Life Science
• /
• v.24 no.7
• /
• pp.798-803
• /
• 2014

Cathepsin D (CtsD), an aspartyl peptidase, is involved in apoptosis, resulting in the release of cytochrome C from mitochondria in cells. Here, we investigated microRNA regulation of CtsD expression in 3T3-L1 cells First, we observed the expression of CtsD in cells in response to doxorubicin (Dox). As expected, the level of CtsD mRNA was increased in 3T3-L1 cells exposed to Dox in a dose-dependent manner. Cellular viability of ectopically expressed CtsD cells was also decreased. Next, we used the miRanda program to search for particular microRNA targeting CtsD. MiR-145 was selected as a putative controller for CtsD because miR-145 had a high mirSVR score. In a reporter assay, the luciferase activity of cells containing the CtsD 3'-UTR region was decreased in cells transfected with miR-145 mimic compared to that of a control. The level of CtsD expression was down-regulated in preadipocytes ectopically expressing miR-145 and up-regulated by an miR-145 inhibitor. Cells also suppressed miR-145 expression when exposed to Dox. The miR-145 inhibitor reduced the cellular viability of 3T3-L1 cells. Taken together, these data suggest that miR-145 regulates CtsD-mediated cell death in adipocytes. These findings may have valuable implications concerning the molecular mechanism of CtsD-mediated cell death in obesity, suggesting that CtaD could be a useful therapeutic tool for the prevention and treatment of obesity by regulating fat cell numbers.

• Journal of Life Science
• /
• v.24 no.7
• /
• pp.777-783
• /
• 2014

Cathepsin D (CtsD), an aspartyl peptidase, is involved in apoptosis, resulting in the release of cytochrome C from mitochondria in cells. Here, we investigated microRNA regulation of CtsD expression in 3T3-L1 cells. First, we observed the expression of CtsD in cells in response to doxorubicin (Dox). As expected, the level of CtsD mRNA increased in 3T3-L1 cells exposed to Dox in a dose-dependent manner. The cellular viability of ectopically expressed CtsD cells was decreased. Next, we used the miRanda program to search for particular microRNA targeting CtsD. MiR-145 was selected as a putative controller of CtsD because it had a high mirSVR score. In a reporter assay, the luciferase activity of cells containing the CtsD 3'-UTR region decreased in cells transfected with a miR-145 mimic compared to that of a control. The level of CtsD expression was down-regulated in preadipocytes ectopically expressing miR-145 and up-regulated by an miR-145 inhibitor. Cells also suppressed miR-145 expression when exposed to Dox. The miR-145 inhibitor reduced the cellular viability of 3T3-L1 cells. Taken together, these data suggest that miR-145 regulates CtsD-mediated cell death in adipocytes. These findings may have valuable implications concerning the molecular mechanism of CtsD-mediated cell death in obesity, suggesting that CtsD could be a useful therapeutic tool for the prevention and treatment of obesity by regulating fat cell numbers.