• Title/Summary/Keyword: Temporal Difference

Search Result 809, Processing Time 0.026 seconds

Barycentric Approximator for Reinforcement Learning Control

  • Whang Cho
    • International Journal of Precision Engineering and Manufacturing
    • /
    • v.3 no.1
    • /
    • pp.33-42
    • /
    • 2002
  • Recently, various experiments to apply reinforcement learning method to the self-learning intelligent control of continuous dynamic system have been reported in the machine learning related research community. The reports have produced mixed results of some successes and some failures, and show that the success of reinforcement learning method in application to the intelligent control of continuous control systems depends on the ability to combine proper function approximation method with temporal difference methods such as Q-learning and value iteration. One of the difficulties in using function approximation method in connection with temporal difference method is the absence of guarantee for the convergence of the algorithm. This paper provides a proof of convergence of a particular function approximation method based on \"barycentric interpolator\" which is known to be computationally more efficient than multilinear interpolation .

Moving Object Segmentation Using Spatio-Temporal Information (시공간 정보를 이용한 움직이는 물체의 분할)

  • 장재식;김종배;이창우;김항준
    • Proceedings of the Korea Institute of Convergence Signal Processing
    • /
    • 2001.06a
    • /
    • pp.217-220
    • /
    • 2001
  • In this paper, we propose a segmentation method of moving object using the spatio-temporal information in image sequences. Proposed method consists of motion detection step using difference image, region segmentation step using k-means algorithm, motion estimation step and segmenting step using intensity and motion information. Experimental results show that the method is capable of segmenting variously moving objects in image sequences.

  • PDF

Capacitated Fab Scheduling Approximation using Average Reward TD(${\lambda}$) Learning based on System Feature Functions (시스템 특성함수 기반 평균보상 TD(${\lambda}$) 학습을 통한 유한용량 Fab 스케줄링 근사화)

  • Choi, Jin-Young
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.34 no.4
    • /
    • pp.189-196
    • /
    • 2011
  • In this paper, we propose a logical control-based actor-critic algorithm as an efficient approach for the approximation of the capacitated fab scheduling problem. We apply the average reward temporal-difference learning method for estimating the relative value functions of system states, while avoiding deadlock situation by Banker's algorithm. We consider the Intel mini-fab re-entrant line for the evaluation of the suggested algorithm and perform a numerical experiment by generating some sample system configurations randomly. We show that the suggested method has a prominent performance compared to other well-known heuristics.

Comparison of Two Conditional Connectives -(u)myen and -ta/la-myen in Korean

  • Yeom, Jae-Il
    • Language and Information
    • /
    • v.8 no.1
    • /
    • pp.137-161
    • /
    • 2004
  • In this paper, I will look at two conditional connectives in Korean and point out differences between -(u)myen and -ta/la-myen in their distributions and semantics. One of the differences is that -ta/la-myen always allows epistemic interpretation, whereas -(u)myen allows epistemic interpretation only when the event time of the antecedent clause is in the past or present. A second difference is that only -(u)myen is used in purely temporal and habitual conditionals. A third difference is that the modality marker -keyss, which can have volitional or predictive interpretation with -(u)myen, cannot have predictive interpretation with -ta/la-myen. I propose that -ta/la-myen has the operator of settledness, which is defined with respect to the speech time, and explain the differences listed based on the semantics of settledness.

  • PDF

UNIFORMLY CONVERGENT NUMERICAL SCHEME FOR SINGULARLY PERTURBED PARABOLIC DELAY DIFFERENTIAL EQUATIONS

  • WOLDAREGAY, MESFIN MEKURIA;DURESSA, GEMECHIS FILE
    • Journal of applied mathematics & informatics
    • /
    • v.39 no.5_6
    • /
    • pp.623-641
    • /
    • 2021
  • In this paper, numerical treatment of singularly perturbed parabolic delay differential equations is considered. The considered problem have small delay on the spatial variable of the reaction term. To treat the delay term, Taylor series approximation is applied. The resulting singularly perturbed parabolic PDEs is solved using Crank Nicolson method in temporal direction with non-standard finite difference method in spatial direction. A detail stability and convergence analysis of the scheme is given. We proved the uniform convergence of the scheme with order of convergence O(N-1 + (∆t)2), where N is the number of mesh points in spatial discretization and ∆t is mesh length in temporal discretization. Two test examples are used to validate the theoretical results of the scheme.

Comparison of Spatio-temporal Fusion Models of Multiple Satellite Images for Vegetation Monitoring (식생 모니터링을 위한 다중 위성영상의 시공간 융합 모델 비교)

  • Kim, Yeseul;Park, No-Wook
    • Korean Journal of Remote Sensing
    • /
    • v.35 no.6_3
    • /
    • pp.1209-1219
    • /
    • 2019
  • For consistent vegetation monitoring, it is necessary to generate time-series vegetation index datasets at fine temporal and spatial scales by fusing the complementary characteristics between temporal and spatial scales of multiple satellite data. In this study, we quantitatively and qualitatively analyzed the prediction accuracy of time-series change information extracted from spatio-temporal fusion models of multiple satellite data for vegetation monitoring. As for the spatio-temporal fusion models, we applied two models that have been widely employed to vegetation monitoring, including a Spatial and Temporal Adaptive Reflectance Fusion Model (STARFM) and an Enhanced Spatial and Temporal Adaptive Reflectance Fusion Model (ESTARFM). To quantitatively evaluate the prediction accuracy, we first generated simulated data sets from MODIS data with fine temporal scales and then used them as inputs for the spatio-temporal fusion models. We observed from the comparative experiment that ESTARFM showed better prediction performance than STARFM, but the prediction performance for the two models became degraded as the difference between the prediction date and the simultaneous acquisition date of the input data increased. This result indicates that multiple data acquired close to the prediction date should be used to improve the prediction accuracy. When considering the limited availability of optical images, it is necessary to develop an advanced spatio-temporal model that can reflect the suggestions of this study for vegetation monitoring.

The Relationships among Gait Asymmetry, the Gait Velocity and Motor Function of Lower Extremity in Stroke Patients (뇌졸중 환자의 보행 비대칭성과 속도, 하지 운동 기능과의 상관관계)

  • Nam, Hyoung-Chun;Kim, Seong-Yeol;An, Seung-Heon
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.5 no.3
    • /
    • pp.385-394
    • /
    • 2010
  • Purpose : The present study was to examine the difference and severity of asymmetry in independently ambulating stroke survivors and to establish the association between gait asymmetry, velocity, and the motor function of lower extremity. Methods : The subjects used in this study were 43 subjects with hemiparesis being able to walk independently. Motor function of lower extremity was measured clinically with the Fugl Meyer-Lower /Extremity Assessment. Overground gait velocity and spatia-temporal parameters were collected by the GAITRite system. Results : Thirty(69.77%) patients showed statistically significant temporal asymmetry while 28(65.1%) exhibited statistically significant spatial asymmetry. One-way ANOVA results showed a main effect of temporal asymmetry group(normative, mild, severe) for gait velocity(F=74.129), FM-L/E(F=17.270), swing-stance symmetry(F=66.869, F=13.485, respectively), spatio-temporal asymmetry(F=13.166, F=31.800, respectively) 66, F=31.800, respectively). Gait velocity was negatively associated with temporal asymmetry(r=-.83), spatial asymmetry(r=-.60). Motor function of lower extremity was also associated with temporal asymmetry(r=-.58), and spatial asymmetry(r=-.50). Conclusion : The study attempted to establish the standard assessment of hemiparesis gait symmetry in light of the complex relationship with motor impairment and gait velocity. More future work will need to link the degree of gait asymmetry to clinically relevant outcomes to better establish the clinical significance of such observations.

Temporal-perceptual Judgement of Visuo-Auditory Stimulation (시청각 자극의 시간적 인지 판단)

  • Yu, Mi;Lee, Sang-Min;Piao, Yong-Jun;Kwon, Tae-Kyu;Kim, Nam-Gyun
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.24 no.1 s.190
    • /
    • pp.101-109
    • /
    • 2007
  • In situations of spatio-temporal perception about visuo-auditory stimulus, researches propose optimal integration hypothesis that perceptual process is optimized to the interaction of the senses for the precision of perception. So, when the visual information considered generally dominant over any other sense is ambiguous, the information of the other sense like auditory stimulus influences the perceptual process in interaction with visual information. Thus, we performed two different experiments to certain the conditions of the interacting senses and influence of the condition. We consider the interaction of the visuo-auditory stimulation in the free space, the color of visual stimulus and sex difference of testee with normal people. In first experiment, 12 participants were asked to judge the change in the frequency of audio-visual stimulation using a visual flicker and auditory flutter stimulation in the free space. When auditory temporal cues were presented, the change in the frequency of the visual stimulation was associated with a perceived change in the frequency of the auditory stimulation as the results of the previous studies using headphone. In second experiment, 30 male and 30 female were asked to judge the change in the frequency of audio-visual stimulation using a color of visual flicker and auditory flutter stimulation. In the color condition using red and green. Both male and female testees showed same perceptual tendency. male and female testees showed same perceptual tendency however, in case of female, the standard deviation is larger than that of male. This results implies that audio-visual asymmetry effects are influenced by the cues of visual and auditory information, such as the orientation between auditory and visual stimulus, the color of visual stimulus.

Diagnostic Accuracy of Temporal Artery Temperatures Measurements (이마 체온의 진단정확도)

  • Park, Yumi;Jung, Wonje;Oh, Hyun;Kim, Yoonkyoung;Kim, Eunyoung;Kim, Mikyung;Shin, Heeyeon
    • Journal of Korean Clinical Nursing Research
    • /
    • v.24 no.2
    • /
    • pp.227-234
    • /
    • 2018
  • Purpose: This study compared the temporal artery temperature (TAT) measured by infrared temporal artery thermometers to the axillary temperature (AT) measured by standard mercury-in-glass thermometers, and evaluated accuracy of the TAT measurement for clinical practice. Methods: A total of 247 adult inpatients in general wards in a tertiary medical center located in Seoul participated in the study. The TAT was measured within one minute after the AT measurement. Data were analyzed using descriptive statistics, paired t-test, Pearson correlation coefficient, linear regression, and the Bland-Altman plot. Results: There was a significant difference in mean temperature between AT and TAT, $36.89^{\circ}C$ (SD=0.70) versus $37.35^{\circ}C$ (SD=0.72). The Bland-Altman plots demonstrated the difference between the AT and TAT as -1.29 to +0.33. The specificity and sensitivity of the TAT in detecting fever were high. The positive predictive values were 57.5% and 71.0% when the AT were higher than $38.0^{\circ}C$ and the TAT fever cutoff levels were $38.0^{\circ}C$ and $38.3^{\circ}C$ respectively. Conclusion: TAT and AT were highly correlated and agreeable, indicating that TAT is as accurate as AT. The findings suggested that TAT measurement can be used in clinical practice. For accurate communication between medical personnel, medical institutions need to provide guidelines for temperature measurement, especially for the use of thermometer and measurement sites.

Evaluation of Spatio-temporal Fusion Models of Multi-sensor High-resolution Satellite Images for Crop Monitoring: An Experiment on the Fusion of Sentinel-2 and RapidEye Images (작물 모니터링을 위한 다중 센서 고해상도 위성영상의 시공간 융합 모델의 평가: Sentinel-2 및 RapidEye 영상 융합 실험)

  • Park, Soyeon;Kim, Yeseul;Na, Sang-Il;Park, No-Wook
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.5_1
    • /
    • pp.807-821
    • /
    • 2020
  • The objective of this study is to evaluate the applicability of representative spatio-temporal fusion models developed for the fusion of mid- and low-resolution satellite images in order to construct a set of time-series high-resolution images for crop monitoring. Particularly, the effects of the characteristics of input image pairs on the prediction performance are investigated by considering the principle of spatio-temporal fusion. An experiment on the fusion of multi-temporal Sentinel-2 and RapidEye images in agricultural fields was conducted to evaluate the prediction performance. Three representative fusion models, including Spatial and Temporal Adaptive Reflectance Fusion Model (STARFM), SParse-representation-based SpatioTemporal reflectance Fusion Model (SPSTFM), and Flexible Spatiotemporal DAta Fusion (FSDAF), were applied to this comparative experiment. The three spatio-temporal fusion models exhibited different prediction performance in terms of prediction errors and spatial similarity. However, regardless of the model types, the correlation between coarse resolution images acquired on the pair dates and the prediction date was more significant than the difference between the pair dates and the prediction date to improve the prediction performance. In addition, using vegetation index as input for spatio-temporal fusion showed better prediction performance by alleviating error propagation problems, compared with using fused reflectance values in the calculation of vegetation index. These experimental results can be used as basic information for both the selection of optimal image pairs and input types, and the development of an advanced model in spatio-temporal fusion for crop monitoring.