• Journal of the Korean Institute of Intelligent Systems
• /
• v.15 no.1
• /
• pp.1-5
• /
• 2005

The purpose of reinforcement learning is to maximize rewards from environment, and reinforcement learning agents learn by interacting with external environment through trial and error. Q-Learning, a representative reinforcement learning algorithm, is a type of TD-learning that exploits difference in suitability according to the change of time in learning. The method obtains the optimal policy through repeated experience of evaluation of all state-action pairs in the state space. This study chose n-Queen problem as an example, to which we apply reinforcement learning, and used Q-Learning as a problem solving algorithm. This study compared the proposed method using reinforcement learning with existing methods for solving n-Queen problem and found that the proposed method improves the convergence rate to the optimal solution by reducing the number of state transitions to reach the goal.

• Journal of Digital Convergence
• /
• v.14 no.8
• /
• pp.415-421
• /
• 2016

A behavior tree is to express the behavior of artificial intelligence. The behavior tree has a characteristic that is easy to change state transitions than FSM(Finite State Machine), see the progress of the action. For these reasons, the behavior tree is widely used in more than FSM. This paper is to analyze the advantages and disadvantages on behavior trees of game engines, proposes the improved behavior tree based on analyzed them. To achieve this, in this paper, first, examines the role of node and the behavior tree structure of the unity engine, unreal engine. Second, discusses the advantages and disadvantages based on it. Third, proposes the behavior tree to improve the disadvantages of behavior tree of unity engine and unreal engine, depth of behavior tree and search time required to select the execution node. This paper can help developers using the tree to develop the game.

• Bulletin of the Korean Chemical Society
• /
• v.18 no.12
• /
• pp.1274-1280
• /
• 1997

The photodissociation dynamics of CH2I2 has been studied at 304 nm by state-selective photofragment translational spectroscopy. Velocity distributions, anisotropy parameters, and relative quantum yields are obtained for the ground I(2P3/2) and spin-orbit excited state I*(2P1/2) iodine atoms, which are produced from photodissociation of CH2I2 at this wavelength. These processes are found to occur via B1 ← A1 type electronic transitions. The quantum yield of I*(2P1/2) is determined to be 0.25, indicating that the formation of ground state iodine is clearly the favored dissociation channel in the 304 nm wavelength region. From the angular distribution of dissociation products, the anisotropy parameters are determined to be β(I)=0.4 for the I(2P3/2) and β(I*)=0.55 for the I*(2P1/2) which substantially differ from the limiting value of 1.13. The positive values of anisotropy parameter, however, show that the primary processes for I and I* formation channels proceed dominantly via a transition which is parallel to I-I axis. The above results are interpreted in terms of dual path formation of iodine atoms from two different excited states, i.e., a direct and an indirect dissociation via curve crossing between these states. The translational energy distributions of recoil fragments reveal that a large fraction of the available energy goes into the internal excitation of the CH2I photofragment; < Eint > /Eavl=0.80 and 0.82 for the I and I* formation channels, respectively. The quantitative analysis for the energy partitioning of available energy into the photofragments is used to compare the experimental results with the prediction of direct impulsive model for photodissociation dynamics.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.3 no.4
• /
• pp.795-804
• /
• 1999

The increasing number of users of mobile communication systems and the corresponding need for increased system capacity require the use of a modulation scheme which is both power and spectrally efficient. In this paper, we numerically calculate the BER performance of DS/CDMA-BPSK system in different fading channel (Rayleigh, Rician, Shadow Rician). Also, we calculate BER performance and the channel capacity of DS/CDMA-BPSK system which is constant or nearly constant envelopes in 3-state fading channel model. The Shadow Rician fading model described in this paper apply the parameters of the Canadian Mobile Satellite (MSAT). And we assume that the 3-state fading channel model is consist of Rayleigh fading state, Rician fading state, and shadow Rician fading state. This model can be used as a basis for the simulation of the land mobile satellite channel. The dynamic 3-state fading channel model is considered corresponding to different environments and the transitions between these environments. From the numerically calculate results, the DS/CDMA-BPSK system with MUI-20, PG-511 can not achieve the BER performance ($P_b\leq10^{-5}$). And the channel capacity did not meet the system requirement. Also, we know that the BER performance is depend m the occupancy probability of radio channel and the degree of shadow. From the results, we how that during shadowed time intervals it is necessary to use some form of error control coding and receiver diversity in order to support reliable data communication.

• Journal of Ginseng Research
• /
• v.44 no.1
• /
• pp.105-114
• /
• 2020

Background: Exploring the pharmacokinetic (PK) changes of various active components of single herbs and their combinations is necessary to elucidate the compatibility mechanism. However, the lack of chemical standards and low concentrations of multiple active ingredients in the biological matrix restrict PK studies. Methods: A putative multiple reaction monitoring strategy based on liquid chromatography coupled with mass spectrometry (LC-MS) was developed to extend the PK scopes of quantification without resorting to the use of chemical standards. First, the compounds studied, including components with available reference standard (ARS) and components lacking reference standard (LRS), were preclassified to several groups according to their chemical structures. Herb decoctions were then subjected to ultrahigh-performance liquid chromatography coupled with quadrupole time-of-flight mass spectrometry analysis with appropriate collision energy (CE) in MS² mode. Finally, multiple reaction monitoring transitions transformed from MS² of ultrahigh-performance liquid chromatography coupled with quadrupole time-of-flight mass spectrometry were used for ultrahigh-performance liquid chromatography coupled with triple quadrupole mass spectrometry to obtain the mass responses of LRS components. LRS components quantification was further performed by developing an assistive group-dependent semiquantitative method. Results: The developed method was exemplified by the comparative PK process of single herbs Radix Ginseng (RG), Radix Polygala (RP), and their combinations (RG-RP). Significant changes in PK parameters were observed before and after combination. Conclusion: Results indicated that Traditional Chinese Medicine combinations can produce synergistic effects and diminish possible toxic effects, thereby reflecting the advantages of compatibility. The proposed strategy can solve the quantitative problem of LRS and extend the scopes of PK studies.

• Journal of the Institute of Electronics Engineers of Korea SD
• /
• v.40 no.8
• /
• pp.619-630
• /
• 2003

We present a method of runtime configuration scheduling in reconfigurable SoC design. As a model of computation, we use a popular formal model of computation, hierarchical FSM (HFSM) with synchronous dataflow (SDF) model, in short, HFSM-SDF model. In reconfigurable SoC design with HFSM-SDF model, the problem of configuration scheduling becomes challenging due to the dynamic behavior of the system such as concurrent execution of state transitions (by AND relation), complex control flow (HFSM), and complex schedules of SDF actor firing. This makes it hard to hide configuration latency efficiently with compile-time static configuration scheduling. To resolve the problem, it is necessary to know the exact order of required configurations during runtime and to perform runtime configuration scheduling. To obtain the exact order of configurations, we exploit the inherent property of HFSM-SDF that the execution order of SDF actors can be determined before executing the state transition of top FSM. After obtaining the order information and storing it in the ready configuration queue (ready CQ), we execute the state transition. During the execution, whenever there is FPGA resource available, a new configuration is selected from the ready CQ and fetched by the runtime configuration scheduler. We applied the method to an MPEG4 decoder and IS95 design and obtained up to 21.8% improvement in system runtime with a negligible overhead of memory usage.

• Geomechanics and Engineering
• /
• v.15 no.5
• /
• pp.1071-1080
• /
• 2018

The study of behavior and values of deformations in the geological medium makes the scientific basis of the methodology of synthesis of true values of parameters of its physico-mechanical and density properties taking into account the influence of geodynamic impacts. The segments of continuous variation of homogeneous elastic uniform deformations are determined under overall compression of the medium. The limits of these segments are defined according to the criteria of instability (on geometric form changes and on "internal" instability). Analytical formulae are obtained to calculate current and limiting (critical) values of deformations within the framework of various variants of small and large initial deformations of the non-classically linearized approach of non-linear elastodynamics. The distribution of deformation becomes non-uniform in the medium while the limiting values of deformations are achieved. The proposed analytical formulae are applicable only within homogeneous distribution of deformations. Numerical experiments are carried out for various elastic potentials. It is found that various forms of instability can precede phase transitions and destruction. The influence of these deformation phenomena should be removed while the physico-mechanical and density parameters of the deformed media are determined. In particular, it is necessary to use the formulae proposed in this paper for this purpose.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.7 no.5
• /
• pp.983-989
• /
• 2012

IEEE 802.3az LPI mechanism allows an Ethernet link to reduce power consumption by entering a low-power sleeping mode and letting some components being powered off when there is no data to be transmitted through the link. However, if small amount of packets are being sent periodically, such a mechanism can not obtain energy efficiency due to a high overhead caused by excessive mode transitions. In this paper, we propose an enhanced LPI mechanism which can perform state transition adaptively based on the traffic characteristics on transport layer and network status. This simulation result shows that proposed mechanism improves energy efficiency than LPI mechanism with respect to energy consumption rate for various traffic loads.

• Journal of computational fluids engineering
• /
• v.16 no.1
• /
• pp.53-59
• /
• 2011

In this study, steady and unsteady aerodynamic analyses of a huge rocket configuration have been conducted in a transonic flow region. The launch vehicle structural response are coupled with the transonic flow state transitions at the nose of the payload fairing. Before performing the coupled fluid-structure transonic aeroealstic simulations transonic aerodynamic characteristics are investigated for the pitching motions of the rocket at finite angle-of-attack. An unsteady CFD analysis method with a moving grid technique based on the Reynolds-averaged Navier-Stokes equations with the k-w SST transition turbulence model is applied to accurately predict the transonic loads of the rocket at pitching motion. It is shown that the fluctuating amplitude of the lateral aerodynamic loads imposed on the rocket due to the pitching motion can be significantly increased in the transonic flow region.

• Journal of the Korean Crystal Growth and Crystal Technology
• /
• v.23 no.3
• /
• pp.142-145
• /
• 2013

The upconversion (UC) luminescence of $Li^+/Er^{3+}/Yb^{3+}$ co-doped $CaWO_4$ phosphors and effects of $Yb^{3+}$ concentration are investigated in detail. Single crystallized $CaWO_4$ : $Li^+/Er^{3+}/Yb^{3+}$ phosphor can be obtained, co-doped up to 35.0/5.0/30.0 mol% ($Li^+/Er^{3+}/Yb^{3+}$) by solid-state reaction. Under 980 nm excitation, $CaWO_4$ : $Li^+/Er^{3+}/Yb^{3+}$ phosphor exhibited strong green UC emissions visible to the naked eye at 530 and 550 nm induced by the intra 4f transitions of $Er^{3+}$ ($^4H_{11/2}$, $^4S_{3/2}{\rightarrow}^4I_{15/2}$). The optimum doping concentrations of $Yb^{3+}$ that would result in the highest UC luminescence were determined, and a possible UC mechanism that depends on the pumping power is discussed in detail.