• 제목/요약/키워드: Q Method

검색결과 2,714건 처리시간 0.031초

Region-based Q- learning For Autonomous Mobile Robot Navigation (자율 이동 로봇의 주행을 위한 영역 기반 Q-learning)

  • 차종환;공성학;서일홍
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2000년도 제15차 학술회의논문집
    • /
    • pp.174-174
    • /
    • 2000
  • Q-learning, based on discrete state and action space, is a most widely used reinforcement Learning. However, this requires a lot of memory and much time for learning all actions of each state when it is applied to a real mobile robot navigation using continuous state and action space Region-based Q-learning is a reinforcement learning method that estimates action values of real state by using triangular-type action distribution model and relationship with its neighboring state which was defined and learned before. This paper proposes a new Region-based Q-learning which uses a reward assigned only when the agent reached the target, and get out of the Local optimal path with adjustment of random action rate. If this is applied to mobile robot navigation, less memory can be used and robot can move smoothly, and optimal solution can be learned fast. To show the validity of our method, computer simulations are illusrated.

  • PDF

A Study on the Electrochemical Properties of Carbon Nanotube Anodes Using a Gradual Increasing State of Charge Method

  • Doh, Chil-Hoon;Park, Cheol-Wan;Jin, Bong-Soo;Moon, Seong-In;Yun, Mun-Soo
    • KIEE International Transactions on Electrophysics and Applications
    • /
    • 제4C권1호
    • /
    • pp.21-25
    • /
    • 2004
  • From the gradual increasing state of charge (GISOC) observations, electrochemical behavior of multi-walled carbon nanotube│(lM LiP $F_{6}$ , EC,DEC,DME 3:5:5 volume ratio)│lithium cells was evaluated using the galvanostatic charge-discharge process. A MWCNT delivers a specific charge capacity of 1,300 mAh/g in a Li cell when cycled up to an end voltage of 0 V (vs. Li/L $i^{+}$ )at a constant current rate every 10 hours. However, in the present study, the specific discharge capacity obtained is 338 mAh/g, thus amounting to a coulombic efficiency of only 26%. Further, when the MWCNT│Li cells were tested using the GISOC method, two distinguishable linear-fit ranges were observed due to the intercalation/deintercalation of lithium, which were found to have II $E_1$, IIC $s_1$ and II $E_2$of 27.3%, 372 mAh/g, and 25.5%, respectively. Q $c_1$, could be calculated from the data of IIE and IICs of each range by the modified equation "II $C_{sum}$= $\Sigma$( $Q_{C}$- $Q_{D}$)=(II $E_{1}$$^{-1}$ ) $Q_{Dl}$ +(II $E_2$$^{-1}$ -1) ( $Q_{D2}$- $Q_{Dl}$ ) + IIC $s_1$= $Q_{Cl}$ - $Q_{Dl}$ ". Results of the GISOC method could be converted to the results of galvanostatic charge-discharge process, irrespective of the state of charge of the cell or battery.ery.y.y.

The direct digital frequency synthesizer of QD-ROM reduction using the differential quantization (차동 양자화를 사용한 QD-ROM 압축 방식의 직접 디지털 주파수 합성기)

  • Kim, Chong-Il;Lim, So-Young;Lee, Ho-Jin
    • Journal of the Institute of Convergence Signal Processing
    • /
    • 제8권3호
    • /
    • pp.192-198
    • /
    • 2007
  • In this paper, a new method to reduce the size of ROM in the direct digital frequency synthesizer(DDFS) is proposed. The new ROM compression method can reduce the ROM size by using the two ROM. The quantized value of sine is stored by the quantized-ROM(Q-ROM) and the differential ROM(D-ROM). To reduce the ROM size, we use the differential quantization technique with this two ROM. First, we quantize the quarter sine wave with the $2^L$ address and store the quantized value at the Q-ROM. Second, after the $2^L$ address are equally divided into $2^M$ sampling intervals, the sampling value is quantized. And the D-ROM store only the difference between this quantized value and the Q-ROM. So the total size of the ROM in the proposed DDFS is significantly reduced compared to the original ROM. The ROM compression ratio of 67.5% is achieved by this method. Also, the power consumption is affected mostly by this ROM reduction.

  • PDF

Study of the Analysis Method for the Aspherical Tolerance of a Korsch Telescope Using a Q Polynomial (Q-Polynomial을 이용한 Korsch 망원경의 비구면 공차 분석 방법 연구)

  • Jun, Won-Kyoun;Lee, Han-Yul;Lee, Sang-min;Kim, Ki-hwan;Park, Seung Han;Jung, Mee-Suk
    • Korean Journal of Optics and Photonics
    • /
    • 제31권6호
    • /
    • pp.328-333
    • /
    • 2020
  • In this paper, we study the analysis method for the aspherical tolerance of a Korsch telescope using a Q polynomial. It is important to analyze the tolerances for evaluating quality in high-precision fabrication of aspherical reflectors for high-resolution satellites. Thus we express the aspheric surface in terms of a Q polynomial in which each coefficient term is composed independently, and analyze the tolerance of a Korsch telescope. We also analyze the tolerance using Zernike fringe sag, which expresses the shape error of an aspherical mirror. By comparing the two results, we confirm that the Q-polynomial method can be used to analyze an aspherical mirror.

Numerical Method for Computing the Resonant Frequencies and Q-factor in Microwave Dielectric Resonator

  • Kim, Nam-young;Yoo, Hojoon
    • Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
    • /
    • 한국전기전자재료학회 1997년도 춘계학술대회 논문집
    • /
    • pp.245-248
    • /
    • 1997
  • The dielectric resonators(DRs) with dielectric properties are widely used in microwave integrated circuit(MICs) and monolithic microwave integrated circuits(MMICS). The variational method as numerical simulation scheme would be applied to calculate the resonant frequencies(fr) and Q-factors of microwave dielectric resonators. The dielectric resonator with a cylindrical “puck” structure of high dielectric material is modeled in this simulation. The parameters, such as the diameter, the height, and the dielectric constant of dielectric resonator, would determine the resonant frequency and the Q-factor. The relationship between these parameters would effect each other to evaluate the approximate resonant frequency. This simulation method by the variational formula is very effective to calculate fr, and Q-factor. in high frequency microwave dielectric resonator The error rate of the simulation results and the measured results would be considered to design the microwave dielectric resonators.

  • PDF

Analytical Study Considering Both Core Loss Resistance and Magnetic Cross Saturation of Interior Permanent Magnet Synchronous Motors

  • Kim, Young-Kyoun
    • Journal of Magnetics
    • /
    • 제17권4호
    • /
    • pp.280-284
    • /
    • 2012
  • This paper presents a method for evaluating interior permanent magnet synchronous motor (IPMSM) performance over the entire operation region. Using a d-q axis equivalent circuit model consisting of motor parameters such as the permanent magnetic flux, copper resistance, core loss resistance, and d-q axis inductance, a conventional mathematical model of an IPMSM has been developed. It is well understood that in IPMSMs, magnetic operating conditions cause cross saturation and that the iron loss resistance - upon which core losses depend - changes according to the motor speed; for the sake of convenience, however, d-q axis machine models usually neglect the influence of magnetic cross saturation and assume that the iron loss resistance is constant. This paper proposes an analysis method based on considering a magnetic cross saturation and estimating a core loss resistance that changes with the operating conditions and speed. The proposed method is then verified by means of a comparison between the computed and the experimental results.

Initial Pole Position Estimation Algorithm of a Z-Axis PMLSM (Z축 선형 영구자석 동기전동기의 초기각 추정 알고리즘)

  • Lee, Jin-Woo
    • Proceedings of the KIPE Conference
    • /
    • 전력전자학회 2007년도 하계학술대회 논문집
    • /
    • pp.328-330
    • /
    • 2007
  • This paper deals with the estimation method on the initial pole position of a z-axis permanent magnet linear synchronous motor(PMLSM) without magnetic pole sensors such as Hall sensors. The proposed method takes account of the z-axis conditions such as the gravitational force and also the load conditions. The algorithm consists of two steps. The first step is to estimate the initial q-axis approximately by monitoring the movements at predefined different test q-axes. The second step is to estimate the real q-axis as accurately as possible based on the results at three different test q-axes. Experimental results on the z-axis PMLSM show good estimation characteristics of the proposed method.

  • PDF

A Study on design inductor with PGS for improvement in Noise Figure of LNA (LNA 잡음 특성 개선을 위한 PGS 구조를 갖는 인덕터 설계에 관한 연구)

  • Ko, Jae-Hyeong;Kim, Dong-Hun;Kim, Hyeong-Seok
    • 한국정보통신설비학회:학술대회논문집
    • /
    • 한국정보통신설비학회 2008년도 정보통신설비 학술대회
    • /
    • pp.35-38
    • /
    • 2008
  • In this paper, study noise performance of LNA to enhance Q-factor of input circuit by patterned ground shield is inserted inductor using TSMC 0.18um. Applied LNA technology is cascode method. The input matching circuit was constituted on-chip and wirebonding inductor. Taguchi's method is used for the best suited structure of PGS. We confirmed enhancement of Q-factor by inserted PGS into inductor. The input matching circuit enhanced Q-factor by inductor with PGS improve noise figure of LNA.

  • PDF

INFINITELY MANY SOLUTIONS FOR (p(x), q(x))-LAPLACIAN-LIKE SYSTEMS

  • Heidari, Samira;Razani, Abdolrahman
    • Communications of the Korean Mathematical Society
    • /
    • 제36권1호
    • /
    • pp.51-62
    • /
    • 2021
  • Variational method has played an important role in solving problems of uniqueness and existence of the nonlinear works as well as analysis. It will also be extremely useful for researchers in all branches of natural sciences and engineers working with non-linear equations economy, optimization, game theory and medicine. Recently, the existence of infinitely many weak solutions for some non-local problems of Kirchhoff type with Dirichlet boundary condition are studied [14]. Here, a suitable method is presented to treat the elliptic partial derivative equations, especially (p(x), q(x))-Laplacian-like systems. This kind of equations are used in the study of fluid flow, diffusive transport akin to diffusion, rheology, probability, electrical networks, etc. Here, the existence of infinitely many weak solutions for some boundary value problems involving the (p(x), q(x))-Laplacian-like operators is proved. The method is based on variational methods and critical point theory.

Assessment of Korean Paddy Soil Microbial Community Structure by Use of Quantitative Real-time PCR Assays (한국의 논 토양 미생물 다양성 분석을 위한 Quantitative Real-time PCR의 응용)

  • Choe, Myeong-Eun;Lee, In-Jung;Shin, Jae-Ho
    • Korean Journal of Environmental Agriculture
    • /
    • 제30권4호
    • /
    • pp.367-376
    • /
    • 2011
  • BACKGROUND: In order to develop effective assessment method for Korean paddy soil microbial community structure, reliable genomic DNA extraction method from paddy soil and quantitative real-time PCR (qRT-PCR) method are needed to establish METHODS AND RESULTS: Out of six conventional soil genomic DNA extraction methods, anion exchange resin purification method was turn to be the most reliable. Various PCR primers for distinguishing five bacterial phylum (${\alpha}$-Proteobacteria, ${\beta}$-Proteobacteria, Actinobacteria, Bacteroidetes, Firmicutes), all bacteria, and all fungi were tested. Various qRT-PCR temperature conditions were also tested by repeating experiment. Finally, both genomic DNA extraction and qRT-PCR methods for paddy soil were well established. CONCLUSION: Quantitative real-time PCR (qRT-PCR) method to assess paddy soil microbial community was established.