• Title/Summary/Keyword: TD-오류

Search Result 7, Processing Time 0.028 seconds

A Reinforcement Loaming Method using TD-Error in Ant Colony System (개미 집단 시스템에서 TD-오류를 이용한 강화학습 기법)

  • Lee, Seung-Gwan;Chung, Tae-Choong
    • The KIPS Transactions:PartB
    • /
    • v.11B no.1
    • /
    • pp.77-82
    • /
    • 2004
  • Reinforcement learning takes reward about selecting action when agent chooses some action and did state transition in Present state. this can be the important subject in reinforcement learning as temporal-credit assignment problems. In this paper, by new meta heuristic method to solve hard combinational optimization problem, examine Ant-Q learning method that is proposed to solve Traveling Salesman Problem (TSP) to approach that is based for population that use positive feedback as well as greedy search. And, suggest Ant-TD reinforcement learning method that apply state transition through diversification strategy to this method and TD-error. We can show through experiments that the reinforcement learning method proposed in this Paper can find out an optimal solution faster than other reinforcement learning method like ACS and Ant-Q learning.

Online Reinforcement Learning to Search the Shortest Path in Maze Environments (미로 환경에서 최단 경로 탐색을 위한 실시간 강화 학습)

  • Kim, Byeong-Cheon;Kim, Sam-Geun;Yun, Byeong-Ju
    • The KIPS Transactions:PartB
    • /
    • v.9B no.2
    • /
    • pp.155-162
    • /
    • 2002
  • Reinforcement learning is a learning method that uses trial-and-error to perform Learning by interacting with dynamic environments. It is classified into online reinforcement learning and delayed reinforcement learning. In this paper, we propose an online reinforcement learning system (ONRELS : Outline REinforcement Learning System). ONRELS updates the estimate-value about all the selectable (state, action) pairs before making state-transition at the current state. The ONRELS learns by interacting with the compressed environments through trial-and-error after it compresses the state space of the mage environments. Through experiments, we can see that ONRELS can search the shortest path faster than Q-learning using TD-ewor and $Q(\lambda{)}$-learning using $TD(\lambda{)}$ in the maze environments.

What Effect can Simple Hand Tapping Have on the Accuracy and Fluency of Speech Production in Children With and Without Speech Sound Disorders? (단순 손동작 반복이 말소리장애 아동과 일반 아동의 말소리산출의 정확성과 유창성에 미치는 영향)

  • Shin, Yu-Na;Ha, Ji-Wan
    • Therapeutic Science for Rehabilitation
    • /
    • v.8 no.2
    • /
    • pp.67-78
    • /
    • 2019
  • Objective : The purpose of this study was to investigate the effect of hand tapping on the accuracy and the fluency of speech production in children with speech sound disorder(SSD) and their typically developing peers(TD). Methods : The study subjects were 15 SSD children and 15 TD children aged 4, 5, and 6 years of age. Subjects were asked to give a picture name without hand tapping in the first experimental condition, and with hand tapping in the second experiment condition. Results : The results showed that hand tapping significantly increased disfluency in TD, whereas in SSD. it did not affect the accuracy or fluency of speech production. In addition, TD demonstrated a significant positive correlation with the changes of accuracy and disfluency due to hand tapping, whereas SSD had no correlation. Conclusion : We discussed the possibility that hand tapping could serve as an obstacle distracting attention from SSD and TD, acting as a motor gesture to facilitate phonological processing when facing the difficulty in lexical retrieval for SSD.

Rotation Errors of Breast Cancer on 3D-CRT in TomoDirect (토모다이렉트 3D-CRT을 이용한 유방암 환자의 회전 오차)

  • Jung, Jae Hong;Cho, Kwang Hwan;Moon, Seong Kwon;Bae, Sun Hyun;Min, Chul Kee;Kim, Eun Seog;Yeo, Seung-Gu;Choi, Jin Ho;Jung, Joo-Yong;Choe, Bo Young;Suh, Tae Suk
    • Progress in Medical Physics
    • /
    • v.26 no.1
    • /
    • pp.6-11
    • /
    • 2015
  • The purpose of this study was to analyze the rotational errors of roll, pitch, and yaw in the whole breast cancer treated by the three-dimensional radiation therapy (3D-CRT) using TomoDirect (TD). Twenty-patient previously treated with TD 3D-CRT was selected. We performed a retrospective clinical analysis based on 80 images of megavoltage computed tomography (MVCT) including the systematic and random variation with patient setup errors and treatment setup margin (mm). In addition, a rotational error (degree) for each patient was analyzed using the automatic image registration. The treatment margin of X, Y, and Z directions were 4.2 mm, 6.2 mm, and 6.4 mm, respectively. The mean value of the rotational error for roll, pitch, and yaw were $0.3^{\circ}$, $0.5^{\circ}$, $0.1^{\circ}$, and all of systematic and random error was within $1.0^{\circ}$. The errors of patient positioning with the Y and Z directions have generally been mainly higher than the X direction. The percentage in treatment fractions in less than $2^{\circ}$ at roll, pitch, and yaw are 95.1%, 98.8%, and 97.5%, respectively. However, the edge of upper and lower (i.e., bottom) based on the center of therapy region (point) will quite a possibility that it is expected to twist even longer as the length of treatment region. The patient-specific characters should be considered for the accuracy and reproducibility of treatment and it is necessary to confirm periodically the rotational errors, including patient repositioning and repeating MVCT scan.

Diadochokinetic Skills in Typically developing Children Aged 4-6 Years : Pilot Study (학령전기 정상발달 아동의 자모음 교대운동특성 : 예비연구)

  • Jeong, Han-Jin;Lee, Ok-Bun;Sehr, Kyeung-Hee
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.12 no.7
    • /
    • pp.3149-3155
    • /
    • 2011
  • The purpose of this study was to know the characteristics of DDK performance between CV(e.g. 'pa') and VV(e.g., 'ai') syllables in typically developing children aged 4 to 6 years old. 12 TD children performed DDK with CV structure(/pʰə/, /tʰə/, /kʰə/, /pʰətʰə/, /tʰəkʰə?/, /pʰətʰəkʰə/) and with VV structure(/ai/, /ɔi/, /ɑɔi/). Spoken syllables were counted in one second, and all spoken DDK were measured by PC-quirer. The results showed that all spoken DDK became faster as the age of children were increased. This trend was also appeared in both CV and VV syllables repetition. In addition, there was no differences in DDK rate with CV and VV syllables. The frequency of articulatory error during DDK performance was very high in the age of 3, and there was no pattern in the frequency of articulatory error according to the developmental age.

Acoustic differences according to the epileptic focus in benign partial epilepsy with centrotemporal spikes patients (양성 부분 간질 환아에서 간질 발생 위치에 따른 음성언어 분석)

  • Kim, Jung Tae;Choi, Sang Hoon;Kim, Sun Jun
    • Clinical and Experimental Pediatrics
    • /
    • v.50 no.9
    • /
    • pp.896-900
    • /
    • 2007
  • Purpose : The aim of this study was to investigate the speech problems in benign rolandic epilepsy (BRE) according to the seizure focus in EEG and semiology. Methods : Twenty three patients [right origin (13 patients) or left side (10 patients)] who met the BRE criteria by International League Against Epilepsy (ILAE) were prospectively enrolled. We excluded the patients who had abnormal MRI or showed both side spikes in EEG. Computerized Speech Lab was used to assess the speech characteristics of the patients. Results : The error pattern of laryngeal articulation in BRE was exclusively substitution of stop consonants, these errors showed more frequent in the left group (16.0% vs 25.5%). Voice onset time (VOT) of stop consonants and Total duration (TD) of word in both groups were prolonged than normal control group, especially in left group (P<0.05). The first formant of vowel /o/ and second formant of /e/ were significantly decreased in left group (P<0.05). The right group scored wider on pitch range ($192.9{\pm}54.0Hz$) and energy range in spontaneous speech ($14.2{\pm}6.4db$) than the left group ($233.3{\pm}12.5Hz$, $19.4{\pm}9.3db$, respectively, P>0.05). Duration of counting (5 to 9) in left group slower than right group ($8.6{\pm}1.7$ vs $7.9{\pm}1.8sec$). Conclusion : Our data suggested that interictal spikes and seizures in either centrotemporal sides, especially left side group, may induce speech problems. We recommend the logopedic and phoniatric evaluations of speech in BRE patients.

A Study of Use of Auto Rigging Tool To Increase Effectiveness of 3D Animation Production (3D애니메이션제작의 효율성 향상을 위한 오토 리깅 툴의 활용에 대한 연구)

  • Baek, Jong-Yeol
    • Cartoon and Animation Studies
    • /
    • s.49
    • /
    • pp.247-265
    • /
    • 2017
  • With the increasingly diverse, sophisticated and complex character animations that can be represented in 3D animations, the importance of rigging, which can most directly affect animating quality, is becoming more and more important. In addition, rapidity is another crucial aspect of 3D animation production. So, the importance of technical director's role which is accurate and rapid handling of rigging pipeline building and immediate application and, corrections of errors during the longest and manpower consuming animation production is more becoming key. Baek Ji Won and Kim Jae-woong (2014) said, "The technical director is adding new importance to the new job, which is created by 3D animation, in conjunction with the limited production period, manpower, budget and production process." Most major overseas studios are developing in-house software to handle rigging and animation processes. Software development code is used to freely develop and modify production pipelines in accordance with the direction of the work. They are making efforts to build an optimal environment for animators. However, too many efforts and ineffective efforts have been made to develop, adapt, and stabilize the rigging process for small producers, creators, and students who do not have the capacity to develop their own in-house software or hire a technical director. This study suggests the most suitable auto-rigging tool among the many auto-rigging tools released in the market, and suggests the most accurate and quick auto-rigging process setting method for those who have insufficient knowledge about 3D character rigging. The efficiency of use of auto-rigging tool was examined.