• Title/Summary/Keyword: Q-difference

Search Result 736, Processing Time 0.029 seconds

Multi Colony Intensification.Diversification Interaction Ant Reinforcement Learning Using Temporal Difference Learning (Temporal Difference 학습을 이용한 다중 집단 강화.다양화 상호작용 개미 강화학습)

  • Lee Seung-Gwan
    • The Journal of the Korea Contents Association
    • /
    • v.5 no.5
    • /
    • pp.1-9
    • /
    • 2005
  • In this paper, we suggest multi colony interaction ant reinforcement learning model. This method is a hybrid of multi colony interaction by elite strategy and reinforcement teaming applying Temporal Difference(TD) learning to Ant-Q loaming. Proposed model is consisted of some independent AS colonies, and interaction achieves search according to elite strategy(Intensification, Diversification strategy) between the colonies. Intensification strategy enables to select of good path to use heuristic information of other agent colony. This makes to select the high frequency of the visit of a edge by agents through positive interaction of between the colonies. Diversification strategy makes to escape selection of the high frequency of the visit of a edge by agents achieve negative interaction by search information of other agent colony. Through this strategies, we could know that proposed reinforcement loaming method converges faster to optimal solution than original ACS and Ant-Q.

  • PDF

The Effect of Combined Exercise Training to Knee Joint Isokinetic Muscular Function in the Taekwondo Athlete (복합운동처치가 태권도 선수의 슬관절 등속성 근 기능에 미치는 영향)

  • Choi, Kyung-Suk
    • Journal of Life Science
    • /
    • v.18 no.1
    • /
    • pp.30-37
    • /
    • 2008
  • The purpose of this study was to investigate the effect of Isotonic Training and Isotonic isometric complex Training to Knee joint Isokinetic muscle function in the high-school Taekwondo athlete. This subjects were randomly divided into two groups; a Isotonic Training group (n=7) Isotonic isometric complex Training group (n=7), Taekwondo athletes share each, 12 weeks between executes a motion. peak torque, H/Q ratio, bilateral muscular ratio muscular endurance of knee joint measured. For this study, two-way ANOVA with repeated measure were used. The result of this study presents between groups was not plain difference expressed. H/Q ratio, bilateral muscular ratio, muscular endurance was plain difference expressed after 12 weeks point of time (p>0.05) and peak torque was plain difference expressed (p<0.05). Conclusion each group did not appear all but one (peak torque), but point of view exercise was effect H/Q ratio, bilateral muscular ratio, muscular endurance, peak torque plain difference expressed.

Max-Mean N-step Temporal-Difference Learning Using Multi-Step Return (멀티-스텝 누적 보상을 활용한 Max-Mean N-Step 시간차 학습)

  • Hwang, Gyu-Young;Kim, Ju-Bong;Heo, Joo-Seong;Han, Youn-Hee
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.10 no.5
    • /
    • pp.155-162
    • /
    • 2021
  • n-step TD learning is a combination of Monte Carlo method and one-step TD learning. If appropriate n is selected, n-step TD learning is known as an algorithm that performs better than Monte Carlo method and 1-step TD learning, but it is difficult to select the best values of n. In order to solve the difficulty of selecting the values of n in n-step TD learning, in this paper, using the characteristic that overestimation of Q can improve the performance of initial learning and that all n-step returns have similar values for Q ≈ Q*, we propose a new learning target, which is composed of the maximum and the mean of all k-step returns for 1 ≤ k ≤ n. Finally, in OpenAI Gym's Atari game environment, we compare the proposed algorithm with n-step TD learning and proved that the proposed algorithm is superior to n-step TD learning algorithm.

Effect of Mulligan Taping and Flossing Bands on Q-angle and Lower Limb Muscular Activity in Men with Chronic Ankle Instability (멀리건 테이핑과 플로싱 밴드가 만성 발목 불안정성 남성 환자의 Q-각과 하지 근 활성도에 미치는 효과)

  • Jeong, Hyo-chang;Park, Se-jin;Yu, Seung-hun
    • The Journal of Korean Academy of Orthopedic Manual Physical Therapy
    • /
    • v.27 no.3
    • /
    • pp.17-24
    • /
    • 2021
  • Background: The study aimed to examine changes in muscle activity by measuring the Q-angle and lower extremity activity when going down the stairs, after the application of either Mulligan taping or flossing bands to patients with chronic ankle instability. Methods: A total of 19 men with chronic ankle instability in their 20s and 30s participated in the study. Participants were randomly divided into two groups: the Mulligan taping group (n = 9) and the flossing band group (n=10). The Mulligan taping group had three sets of Mulligan joint operations repeated 10 times, after which the Mulligan tape was applied. The flossing band group either performed functional activities or exercised for 2 minutes after flossing band application. After the application of either Mulligan taping or flossing bands, changes in the Q-angle and lower limb muscular activity while going down the stairs were measured and compared. Results: In the Mulligan taping group, the Q-angle significantly decreased from 13.63° to 12.7° during the step down. Similarly, the Q-angle of the flossing band group significantly decreased from 15.95° to 15.48° (p<.05). There was no difference in lower limb muscle activity between the two groups when going down the stairs. The muscle activity of the tibialis anterior significantly increased from 34.12% to 40.2%, and the difference between the two groups were statistically significant (p<.05). Conclusions: The study found that the application of Mulligan taping and flossing bands to patients with chronic ankle instability decreased the Q-angle and lower limb muscle activity when going down the stairs.

OSCILLATION OF NONLINEAR SECOND ORDER NEUTRAL DELAY DYNAMIC EQUATIONS ON TIME SCALES

  • Agwo, Hassan A.
    • Bulletin of the Korean Mathematical Society
    • /
    • v.45 no.2
    • /
    • pp.299-312
    • /
    • 2008
  • In this paper, we establish some oscillation criteria for nonautonomous second order neutral delay dynamic equations $(x(t){\pm}r(t)x({\tau}(t)))^{{\Delta}{\Delta}}+H(t,\;x(h_1(t)),\;x^{\Delta}(h_2(t)))=0$ on a time scale ${\mathbb{T}}$. Oscillatory behavior of such equations is not studied before. This is a first paper concerning these equations. The results are not only can be applied on neutral differential equations when ${\mathbb{T}}={\mathbb{R}}$, neutral delay difference equations when ${\mathbb{T}}={\mathbb{N}}$ and for neutral delay q-difference equations when ${\mathbb{T}}=q^{\mathbb{N}}$ for q>1, but also improved most previous results. Finally, we give some examples to illustrate our main results. These examples arc [lot discussed before and there is no previous theorems determine the oscillatory behavior of such equations.

An Experimental Method for Measuring Q (Q의 실험적 측정법)

  • Kim, Dong-Hak;Lee, Jeong-Hyun;Kang, Ki-Ju
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.27 no.9
    • /
    • pp.1607-1613
    • /
    • 2003
  • An experimental method to measure Q-parameter in-situ is described. The basic idea comes from the fact that the side necking near a crack tip indicates the loss of stress triaxiality, which can be scaled by Q. From the out-of-plane displacement and the in-plane strain near the surface of side necking, stress field averaged through the thickness is calculated and then Q is determined from the difference between the stress field and the HRR field corresponding to the identical J-integral. To prove the validity, three-dimensional finite element analysis has been performed for a CT configuration with side-groove. Q-value which was calculated directly from the near-tip stress field is compared with that determined by simulating the experimental procedure according to the proposed method, that is, the Q-value determined from the lateral displacement and the in-plane strain. In addition, the effect of location where the displacement and strain are measured is explored.

The Effect of Coenzyme Q10 Supplementation on Oxidative Stress Index and Antioxidant Capacity in the Elderly (Coenzyme Q10 섭취가 노인들의 혈중 산화적 스트레스 지표 및 항산화 능력에 미치는 영향)

  • Kim, Jung-Kyu;Roh, Seong-Kyu
    • Korean Journal of Exercise Nutrition
    • /
    • v.13 no.1
    • /
    • pp.29-35
    • /
    • 2009
  • The purpose of this study was to investigate the effects of oral supplementation of coenzyme Q10 (CoQ10) for 4 weeks on the plasma free oxygen radical and total antioxidant capacity at resting and after one bout exercise in healthy old men. Thirty volunteers with an average (+/-SD) age of 62.59+/-5.3 years participated in this study and were divided with three groups; CoQ10 (200 mg daily) group, vitamin C & E (800mg, 400 IU daily) group, and placebo group. A cycle exercise (60% HRR) test was performed at the end of study. Blood samples were taken for the analyses at rest and pre-, post-, 30min after cycle exercise, before and after the 4 weeks of supplementation. After supplementation, there were no significant differences in the plasma free oxygen radical levels and total antioxidant capacity at resting. Plasma free oxygen radical level and total antioxidant capacity in three groups were significantly elevated after exercise, however, it did not vary significantly between groups. CoQ10 supplementation showed significant difference in total antioxidant capacity during recovery phase compared with placebo group. Our results demonstrated that supplementation of CoQ10 in healthy old men improve blood total antioxidant capacity after one bout exercise, despite no alteration of plasma free oxygen radical levels.

ON A CLASS OF q-BI-UNIVALENT FUNCTIONS OF COMPLEX ORDER RELATED TO SHELL-LIKE CURVES CONNECTED WITH THE FIBONACCI NUMBERS

  • Ahuja, Om P.;Cetinkaya, Asena;Bohra, Nisha
    • Honam Mathematical Journal
    • /
    • v.42 no.2
    • /
    • pp.319-330
    • /
    • 2020
  • We introduce a new subclass of q-bi-univalent functions of complex order related to shell-like curves connected with the Fibonacci numbers. We obtain the coefficient estimates and Fekete-Szegö inequalities for the functions belonging to this class. Relevant connections with various other known classes have been illustrated.

EXTREME PRESERVERS OF RANK INEQUALITIES OF BOOLEAN MATRIX SUMS

  • Song, Seok-Zun;Jun, Young-Bae
    • Journal of applied mathematics & informatics
    • /
    • v.26 no.3_4
    • /
    • pp.643-652
    • /
    • 2008
  • We construct the sets of Boolean matrix pairs, which are naturally occurred at the extreme cases for the Boolean rank inequalities relative to the sums and difference of two Boolean matrices or compared between their Boolean ranks and their real ranks. For these sets, we consider the linear operators that preserve them. We characterize those linear operators as T(X) = PXQ or $T(X)\;=\;PX^tQ$ with appropriate invertible Boolean matrices P and Q.

  • PDF

DIFFERENCES OF WEIGHTED COMPOSITION OPERATORS ON BERGMAN SPACES INDUCED BY DOUBLING WEIGHTS

  • Jiale Chen
    • Bulletin of the Korean Mathematical Society
    • /
    • v.60 no.5
    • /
    • pp.1201-1219
    • /
    • 2023
  • We characterize the boundedness and compactness of differences of weighted composition operators acting from weighted Bergman spaces Apω to Lebesgue spaces Lq(dµ) for all 0 < p, q < ∞, where ω is a radial weight on the unit disk admitting a two-sided doubling condition.