• Title/Summary/Keyword: Temporal Difference

Search Result 809, Processing Time 0.035 seconds

Human Adaptive Device Development based on TD method for Smart Home

  • Park, Chang-Hyun;Sim, Kwee-Bo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.1072-1075
    • /
    • 2005
  • This paper presents that TD method is applied to the human adaptive devices for smart home with context awareness (or recognition) technique. For smart home, the very important problem is how the appliances (or devices) can adapt to user. Since there are many humans to manage home appliances (or devices), managing the appliances automatically is difficult. Moreover, making the users be satisfied by the automatically managed devices is much more difficult. In order to do so, we can use several methods, fuzzy controller, neural network, reinforcement learning, etc. Though the some methods could be used, in this case (in dynamic environment), reinforcement learning is appropriate. Among some reinforcement learning methods, we select the Temporal Difference learning method as a core algorithm for adapting the devices to user. Since this paper assumes the environment is a smart home, we simply explained about the context awareness. Also, we treated with the TD method briefly and implement an example by VC++. Thereafter, we dealt with how the devices can be applied to this problem.

  • PDF

Analysis of Offshore Tubulars Subjected to Collision Impacts Using a Spring-Beam Model (스프링-보 모형을 이용한 해양구조물 원통부재의 충돌 해석)

  • 조상래;권종식
    • Journal of Ocean Engineering and Technology
    • /
    • v.9 no.1
    • /
    • pp.22-35
    • /
    • 1995
  • A simplified numerical procedure have proposed to trace the dynamic behaviour of offshore tubulars subjected to lateral collision impacts. The local denting and overall bending deformation of the struck tubular are represented by a non-linear spring and an elastic visco-plastic beam respectively. In this method a temporal finite difference method and a spacial finite element method are employed. Using this method various boundary conditions are able to considered and their effects on the extent of damage can be quantified. The extent of damage due to collision can be obtained as results of the dynamic analysis. The predictions using the proposed method have been correlated with existing test results and then the reliability of the procedure has been substantiated. The characteristics of the dynamic response of tubulars under lateral impacts are compared for simply supported roller and fixed end conditions and their effects on the extent of damage are specfied.

  • PDF

Adaptive Actor-Critic Learning of Mobile Robots Using Actual and Simulated Experiences

  • Rafiuddin Syam;Keigo Watanabe;Kiyotaka Izumi;Kazuo Kiguchi;Jin, Sang-Ho
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.43.6-43
    • /
    • 2001
  • In this paper, we describe an actor-critic method as a kind of temporal difference (TD) algorithms. The value function is regarded as a current estimator, in which two value functions have different inputs: one is an actual experience; the other is a simulated experience obtained through a predictive model. Thus, the parameter´s updating for the actor and critic parts is based on actual and simulated experiences, where the critic is constructed by a radial-basis function neural network (RBFNN) and the actor is composed of a kinematic-based controller. As an example application of the present method, a tracking control problem for the position coordinates and azimuth of a nonholonomic mobile robot is considered. The effectiveness is illustrated by a simulation.

  • PDF

Effect of Swirling Flow by Normal Injection of Secondary Air on the Gas Residence Time and Mixing Characteristics in a Combustor (연소로 내 2차공기의 주유동 수직방향 선회분사로 인한 선회류가 스월수에 따른 가스 체류시간과 혼합 특성에 미치는 영향)

  • Park Sang-Uk;Jeon Byoung-Il;Yu Tae-U;Hwang Jung-Ho
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.30 no.1 s.244
    • /
    • pp.48-56
    • /
    • 2006
  • We investigated gas residence time and mixing characteristics due to various swirl numbers generated by normal injection of secondary air to a lab-scale cylinderical combustor. The residence time was estimated by measuring the temporal pressure difference which was caused by deposition of test particles on a filter media after the injection by a syringe. The mixing characteristics were evaluated by standard deviation value of test gas concentration at different measuring points. The test gas concentration was detected by a gas analyzer. The swirl number of $20{\sim}30$ for ${\theta}=5^{\circ}$ caused long residence time enough to improve mixing characteristics. Numerical calculations were also carried out to understand physical meanings of the experimental results.

Vector Channel Modeling & Position Estimation using Direction Finding Methods for CDMA Mobile Wireless Systems (CDMA 환경에서 위치추정을 위한 벡터채널 모델링과 Direction Finding을 이용한 위치 추정)

  • 김장섭;이용우;정우곤
    • Proceedings of the IEEK Conference
    • /
    • 1999.11a
    • /
    • pp.27-30
    • /
    • 1999
  • A spatio-temporal vector channel model is introduced for the position location (PL) estimation problem for CDMA cellular system environment. Two common ways for the PL make use of the AOA (Angle Of Arrival) and TDOA (Time Difference Of Arrival) from a subscriber to the multiple sensors (base stations). In this paper, we applied the derived vector channel to simulate the multipath channel for the angle of the signal arrival in CDMA systems. Cross-correlation method is a good candidate among other direction finding algorithms available in literature, especially in wideband modulation as in the CDMA system. The PL estimation errors are evaluated for different channels, which are obtained as a parameter of scattering radius of the suggested model. We noted that the number of sensors (base-stations) are related to the PL errors in favor of the available data.

  • PDF

Now and Cikum: A Pragmatic Account to Cikum ('Now' 와 '지금' : '지금' 에 대한 화용적 접근)

  • Yoon, Jae-Hak
    • Language and Information
    • /
    • v.19 no.1
    • /
    • pp.103-117
    • /
    • 2015
  • Not fully satisfied with the treatment of the so-called two nows in Korean by Lee & Choi (2009), this article seeks to furnish the issue with a firmer ground to base on in the relevant conversation. A close comparison between now and cikum appearing in the present perfect and present tense results in the two findings that (i) a crucial difference between the two adverbs is that Korean cikum lacks English now's ability to be identified with the reference time and (ii) further, seeming differences between them are not real but in fact due to tense and aspectual discrepancies between English and Korean. Thus, it claims, contra Lee (1976) and Park (2004), that cikum is a temporal locating adverb which invariably locates the event time of a given eventuality at the utterance time. In particular, it motivates that a past-tensed sentence with cikum should be understood as holding in the recent past mainly from pragmatic inferences rather than semantic entailments.

  • PDF

Estimating groundwater recharge from time series measurements of subsurface temperature

  • Koo, Min-Ho;Kim, Yongje
    • Proceedings of the Korean Society of Soil and Groundwater Environment Conference
    • /
    • 2003.09a
    • /
    • pp.213-216
    • /
    • 2003
  • Efforts for better understanding of the interaction between groundwater recharge and thermal regime of the subsurface medium is gaining momentum for its diverse applications in water resources. A numerical model is developed to simulate temperature variations of the subsurface under time varying groundwater recharge. The model utilizes MacCormack scheme for finite difference approximation of the partial differential equation describing the conductive and advective heat transport. For the estimation of recharge rate, optimization of the model is realized by searching for the unknown parameters which minimize the root-mean-square error between simulated and measured temperatures. Simulation results for 22-year time series data of temperature measurements reveal that the proposed model can accurately simulate subsurface temperature variations resulting from the redistribution of the heat due to the movement of water and it can also estimate temporal variations of recharge. Seasonal variations of recharge and a linear relationship between precipitation and recharge are clearly reflected in the simulated results.

  • PDF

Two-Dimensional Adaptive Mesh Generation Algorithm and its Application with Higher-Order Compressible Flow Solver

  • Phongthanapanich, Sutthisak;Dechaumphai, Pramote
    • Journal of Mechanical Science and Technology
    • /
    • v.18 no.12
    • /
    • pp.2190-2203
    • /
    • 2004
  • A combined procedure for two-dimensional Delaunay mesh generation algorithm and an adaptive remeshing technique with higher-order compressible flow solver is presented. A pseudo-code procedure is described for the adaptive remeshing technique. The flux-difference splitting scheme with a modified multidimensional dissipation for high-speed compressible flow analysis on unstructured meshes is proposed. The scheme eliminates nonphysical flow solutions such as the spurious bump of the carbuncle phenomenon observed from the bow shock of the flow over a blunt body and the oscillation in the odd-even grid perturbation in a straight duct for the Quirk's odd-even decoupling test. The proposed scheme is further extended to achieve higher-order spatial and temporal solution accuracy. The performance of the combined procedure is evaluated on unstructured triangular meshes by solving several steady-state and transient high-speed compressible flow problems.

Flow Routing in Prismatic Symmetrical Compound Channels by Applications of the Apparent Shear Force (ASF)

  • Chun, Moo-Kap;Jee, Hong-Kee
    • Korean Journal of Hydrosciences
    • /
    • v.8
    • /
    • pp.41-56
    • /
    • 1997
  • A new routing computer model for the symmetric compound channel called the ASRMCS(Apparent Shear Force Muskingum-Cunge Method in Symmetry) has been developed. The Muskingum-Cunge routing method is adapted. The Apparent Shear Force (ASF) between the deep main channel and the shallow floodplan flow is introduced while the flow is routed. The nonlinear parameter method is applied. The temporal and spatial increments are varied according to the flow rate. The adaptation of above schemes is tested against the routed hydrographs using the DAMBRK model. The results of general routing practice of Muskingum-Cunge Method(GPMC) are also compared with those of above two models. The results of the new model match remarkably well with those of DAMBRK. The routed hydrographs show a smooth variation from the inflow boundary condition without any distortions caused by the difference of cross-section shape. However, the results of GPMC, showing early rise and fall of routed hydrograph, have considerable differences from those of the ASFMCS and DAMBRK.

  • PDF

An Improved Method for Detection of Moving Objects in Image Sequences Using Statistical Hypothesis Tests

  • Park, Jae-Gark;Kim, Munchurl;Lee, Myoung-Ho;Ahn, Chei-Teuk
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 1998.06b
    • /
    • pp.171-176
    • /
    • 1998
  • This paper resents a spatio-temporal video segmentation method. The algorithm segments each frame of video sequences captured by a static or moving camera into moving objects (foreground) and background using a statistical hypothesis test. In the proposed method, three consecutive image frames are exploited and a hypothesis testing is performed by comparing two means from two consecutive difference images, which results in a T-test. This hypothesis test yields change detection mask that indicates moving areas (foreground) and non-moving areas (background). Moreover, an effective method for extracting object mask form change detection mask is proposed.

  • PDF