• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.58 no.7
• /
• pp.1411-1417
• /
• 2009

In this paper, we consider the design of $H_{\infty}$ control of linear discrete-time systems having no mathematical model. The basic approach is to use Q-learning which is a reinforcement learning method based on actor-critic structure. The model-free control design is to use not the mathematical model of the system but the informations on states and inputs. As a result, the derived iterative algorithm is expressed as linear matrix inequalities(LMI) of measured data from system states and inputs. It is shown that, for a sufficiently rich enough disturbance, this algorithm converges to the standard $H_{\infty}$ control solution obtained using the exact system model. A simple numerical example is given to show the usefulness of our result on practical application.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.27 no.4
• /
• pp.179-186
• /
• 2004

The purpose of this study is to implement web-based quality cost management system to measure the performance of quality improvement activities in the business firms. Developed WQCMS(Web-based Q-Cost Management System) have ability to collect and analyze quality data generated from various different departments in the inside or outside of the enterprise without any limitations, if end-users are able to access wide area network. It provides the capability to integrate quality information from database and to generate various easy analysis reports to management's needs using built-in analysis tool modules with real-time. The proposed system was developed using Microsoft's .Net technology, ASP.NET and MS-SQL Server 2000. By web-enabling Q-cost management system, the effectiveness of the system management and utilization was realized by easiness of information integration and economical efficiency.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.11 no.3
• /
• pp.153-162
• /
• 2016

This paper proposes an optimal dynamic resource allocation method in IoT (Internet of Things) parking guidance system using Q-learning resource allocation model. In the proposed method, a resource allocation using a forecasting model based on Q-learning is employed for optimal utilization of parking guidance system. To demonstrate efficiency and availability of the proposed method, it is verified by computer simulation and practical testbed. Through simulation results, this paper proves that the proposed method can enhance total throughput, decrease penalty fee issued by SLA (Service Level Agreement) and reduce response time with the dynamic number of users.

• Communications of the Korean Mathematical Society
• /
• v.27 no.3
• /
• pp.557-564
• /
• 2012

This study concerns the existence of positive solution for the following nonlinear system $$\{-div(|x|^{-ap}|{\nabla}u|^{p-2}{\nabla}u)=|x|^{-(a+1)p+c_1}({\alpha}_1f(v)+{\beta}_1h(u)),x{\in}{\Omega},\\-div(|x|^{-bq}|{\nabla}v|q^{-2}{\nabla}v)=|x|^{-(b+1)q+c_2}({\alpha}_2g(u)+{\beta}_2k(v)),x{\in}{\Omega},\\u=v=0,x{\in}{\partial}{\Omega}$$, where ${\Omega}$ is a bounded smooth domain of $\mathbb{R}^N$ with $0{\in}{\Omega}$, 1 < $p,q$ < N, $0{{\leq}}a<\frac{N-p}{p}$, $0{{\leq}}b<\frac{N-q}{q}$ and $c_1$, $c_2$, ${\alpha}_1$, ${\alpha}_2$, ${\beta}_1$, ${\beta}_2$ are positive parameters. Here $f,g,h,k$ : $[0,{\infty}){\rightarrow}[0,{\infty})$ are nondecresing continuous functions and $$\lim_{s{\rightarrow}{\infty}}\frac{f(Ag(s)^{\frac{1}{q-1}})}{s^{p-1}}=0$$ for every A > 0. We discuss the existence of positive solution when $f,g,h$ and $k$ satisfy certain additional conditions. We use the method of sub-super solutions to establish our results.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.16 no.3
• /
• pp.470-475
• /
• 2012

In Q-algorithm of EPCglobal Class-1 Gen-2 RFID system, the initial value of $Q_{fp}$, which is the slot-count parameter, is not defined in the standard. And the values of weight C, which is the parameter for incrementing or decrementing the slot-count size, are not determined. Therefore, if the number of tags is small and we let the initial $Q_{fp}$ be large, the number of empty slot will be large. On the other hand, if we let the initial $Q_{fp}$ be small in spite of many tags, almost all the slots will be collided. Also, if the reader selects an inappropriate weight, there are a lot of empty or collided slots. As a result, the performance will be declined because the frame size does not converge to the optimal point quickly during the query round. In this paper, we propose a scheme to allocate the optimal initial $Q_{fp}$ through the tag number estimation and select the weight based on the slot-count size of current query round.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.17 no.12
• /
• pp.1333-1342
• /
• 1992

This paper deals with a robot manipulator having actuator which is described by equation $D(q)\ddot{q}=u-P(q\;\dot{q},\;\ddot{q})$ where u(t) is a control input. We employ two steps of controller design procedures. First, a global linearization is performed to yield a decoupled controllable linear system. Then a controller is designed for this linear system. We provide a rigorous analysis of the effect of uncertainty of the dynamics, which we study using robustness results in time domain based on a Lyapunov equation and the total stability theorem. Using this approach we simulate the performance of controller of a robot manipulator.

• The Transactions of the Korean Institute of Electrical Engineers
• /
• v.39 no.12
• /
• pp.1281-1287
• /
• 1990

A new thermal power plant feed-water system model, which is based on Astrom, is presented. Astrom's model has some difficulties in applying to practical systems because it is not able to measure the heat and energy transfer loss. Hence, in order to make up for these difficulties, the Gas State Equation is added to the model. Computer simulations are performed to show the validity of the new model at thermal power plant with practical boiler operating data and to verify the L.Q. controller effect on boiler drum level system.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37 no.5A
• /
• pp.358-366
• /
• 2012

LED-ID (Light Emitting Diode - Identification) is one of the key technologies for identification, data transmission, and illumination simultaneously. This is the new paradigm in the identification technology environment. There are many issues are still now challenging to achieve high performance in LED-ID system. Collision issue is one of them. Actually this is the most significant issue in all identification system. LED-ID system also suffers from collision problem. In our system, collision occurs when two or more readers transmit data to tag at the same time or vice versa. There are many anti-collision protocols to resolve this problem; such as: Slotted ALOHA, Basic Frame Slotted ALOHA, Query Tree, Tree Splitting, and Q-Algorithm etc. In this paper, we propose modified Q-Algorithm to resolve collision at tag. The proposed protocol is based on Q-Algorithm and used the information of arrived readers to a tag from neighbor. The information includes transmitting slot number of readers and the number of readers that can be arrived in next slot. Our proposed protocol can reduce the numbers of collision slot and the successful time to identify all readers. In this paper our simulation and theoretical results are presented.

• Journal of Auto-vehicle Safety Association
• /
• v.9 no.3
• /
• pp.31-38
• /
• 2017

For years, Q1.5 (anthropomorphic test device for 1.5 years old infant) and Q3 (anthropomorphic test device for 3 years old infant) dummy protection has been improved considerably by the effort of EuroNCAP. ISOFIX strength of vehicle structure has increased and many child occupant protection tests have made child restraint system (hereafter CRS) optimized for child safety. However, from 2016, EuroNCAP changed the dummy which is used for the child occupant protection from Q1.5/Q3 to Q6/Q10 and these were also adopted in KNCAP from 2017. Therefore, a new method is required to secure the safety for older children In this research, child dummies were tested by using adult safety systems, and the different results from each adult restraint system were compared. Finally, dummies were tested with the CRS harness belt commonly used for infants, which has yielded significant result. In this research, mid-sized sedan and small SUV were used for the test. The researchers of this paper performed sled tests to correlate between the different adult safety belt system and child injury. Following the sled test, an actual vehicle test was conducted to gather the injury data of Q-dummy with the CRS harness belts. This paper will show the advantages of applying a pre-tensioner in the second row for child protection and the necessity of CRS which has its own harness belts to improve safety for older children.

• 제어로봇시스템학회:학술대회논문집
• /
• 1990.10a
• /
• pp.263-268
• /
• 1990

This paper deals with the manipulator with actuator described by equation D over bar(q) $q^{...}$ = u-p over bar (q, $q^{.}$, $q^{..}$) with a control input u. We imploy a simple method of control design which bas two stages. First, a global linearization is performed to yield a decoupled controllable linear system. Then a controller is designed for this linear system. We provide a rigorous analysis Of the effect of uncertain dynamics, which we study using robustness results In time domain based on a Lyapunav equation and the total stability theorem. I)sing this approach we simulate the performance of controller about a robotic manipulator with actuator.tor.r.