• Title/Summary/Keyword: 지연 공간

Search Result 655, Processing Time 0.027 seconds

Design and implementation of Robot Soccer Agent Based on Reinforcement Learning (강화 학습에 기초한 로봇 축구 에이전트의 설계 및 구현)

  • Kim, In-Cheol
    • The KIPS Transactions:PartB
    • /
    • v.9B no.2
    • /
    • pp.139-146
    • /
    • 2002
  • The robot soccer simulation game is a dynamic multi-agent environment. In this paper we suggest a new reinforcement learning approach to each agent's dynamic positioning in such dynamic environment. Reinforcement learning is the machine learning in which an agent learns from indirect, delayed reward an optimal policy to choose sequences of actions that produce the greatest cumulative reward. Therefore the reinforcement learning is different from supervised learning in the sense that there is no presentation of input-output pairs as training examples. Furthermore, model-free reinforcement learning algorithms like Q-learning do not require defining or learning any models of the surrounding environment. Nevertheless these algorithms can learn the optimal policy if the agent can visit every state-action pair infinitely. However, the biggest problem of monolithic reinforcement learning is that its straightforward applications do not successfully scale up to more complex environments due to the intractable large space of states. In order to address this problem, we suggest Adaptive Mediation-based Modular Q-Learning (AMMQL) as an improvement of the existing Modular Q-Learning (MQL). While simple modular Q-learning combines the results from each learning module in a fixed way, AMMQL combines them in a more flexible way by assigning different weight to each module according to its contribution to rewards. Therefore in addition to resolving the problem of large state space effectively, AMMQL can show higher adaptability to environmental changes than pure MQL. In this paper we use the AMMQL algorithn as a learning method for dynamic positioning of the robot soccer agent, and implement a robot soccer agent system called Cogitoniks.

Generating a Slot Assihnment Rule for Outbound Containers Having Imprecise Weight Information (부정확한 무게 정보를 가진 수출 컨테이너를 위한 장치 위치 결정 규칙 생성 방법)

  • Kang, Jae-Ho;Ryu, Kwang-Ryel;Kim, Kap-Hwan
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • v.29 no.1
    • /
    • pp.391-398
    • /
    • 2005
  • The outbound containers in a container terminal are classified into a few groups by their weights and stocked separately in a yard for easy and efficient handling. In order to maintain the balance of a ship during loading, containers of heavier weight groups should be fetched out of a yard and loaded onto the ship before those of lighter weight groups. However, the weight information used to determine the weight group is usually imprecise. Therefore stacks will actually be filled with mixture of different weight groups and rehandlings are unavoidable during loading operation. This paper presents a method for estimating the number of rehandlings caused by imprecise information and a scheme for generating a simple but efficient slot assignment rule. Experiments have shown that a rule generated by the proposed method can reduce the number of rehandlings by about 20%compared to the traditional slot assignment method which stacks only the containers of the same weight group in a single stack.

  • PDF

ORTHODONTIC TRACTION OF AN IMPACTED MAXILLARY CENTRAL INCISOR (변위 매복된 상악 중절치의 교정적 맹출 유도)

  • Kim, Jae-Gon;Jung, Jin-Woo;Baik, Byeong-Ju;Yang, Yeon-Mi;Lee, Yong-Hee
    • Journal of the korean academy of Pediatric Dentistry
    • /
    • v.31 no.3
    • /
    • pp.355-361
    • /
    • 2004
  • Impaction is generally defined as the lack of eruption of a tooth after the normal age for the eruption. An impacted tooth may appear blocked by another tooth, bone, or soft tissue, but cause of tooth impaction is often unknown. The clinician should consider the various treatment options available : (a) No treatment and observation, (b) surgical exposure and orthodontic traction (c) auto transplantation (d) extraction. These cases were about the patients with delayed eruption of maxillary central incisor. We surgically exposed impacted tooth and guided it into normal position by the orthodontic traction. Especially, in case 1, #21 was ectopic impacted state with root dilaceration. It is required to examine further root development and alignment of dentition serially.

  • PDF

Adaptation of SVC to Packet Loss and its Performance Analysis (패킷 손실에 대한 스케일러블 비디오(SVC) 적응기법 및 성능분석)

  • Jang, Euy-Doc;Kim, Jae-Gon;Thang, Truong Cong;Kang, Jung-Won
    • Journal of Broadcast Engineering
    • /
    • v.14 no.6
    • /
    • pp.796-806
    • /
    • 2009
  • SVC (Scalable Video Coding) is a new video coding standard to provide convergence media service in heterogeneous environments with different networks and diverse terminals through spatial-temporal-quality combined flexible scalabilities. This paper presents the performance analysis on packet loss in the delivery of SVC over IP networks and an efficient adaptation method to packet loss caused by buffer overflow. In particular, SVC with MGS (Medium Grained Scalability) as well as spatial and temporal scalabilities is addressed in the consideration of packet-based adaptation since finer adaptation is possible with a sufficient numbers of quality layers in MGS. The effect on spatio-temporal quality due to the packet loss of SVC with MGS is evaluated. In order to minimize quality degradation resulted by packet loss, the proposed adaptation of MGS based SVC first sets adaptation unit of AU (Access Unit) or GOP corresponding to allowed delay and then selectively discards packets in order of importance in terms of layer dependency. In the experiment, the effects of packet loss on quantitative qualities are analyzed and the effectiveness of the proposed adaptation to packet loss is shown.

Improvement of Recognition Speed for Real-time Address Speech Recognition (실시간 주소 음성인식을 위한 인식 시스템의 인식속도 개선)

  • Hwang Cheol-Jun;Oh Se-Jin;Kim Bum-Koog;Jung Ho-Youl;Chung Hyun-Yeol
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • spring
    • /
    • pp.74-77
    • /
    • 1999
  • 본 논문에서는 본 연구실에서 개발한 주소 음성인식 시스템의 인식 속도를 개선시키기 위하예 새로운 가변 프루닝 문턱치를 적용하는 방법을 제안하고 실험을 통하여 그 유효성을 확인하였다. 기존의 가변 프루닝 문턱치는 일정 프레임이 경과하면 일정 값을 가진 문턱치를 계속하여 감소시켜나가는 방법을 반복하기 때문에, 불필요한 탐색공간을 탐색하게 된다. 본 논문에서 새로이 제안하는 가변 프루닝 문턱치를 채용하는 방법은 처음 일정 구간이 경과되면 일정 문턱치를 감소시키나, 다음 일정 프레임에서는 탐색되어야할 후보에 따라서 문턱치를 변화시켜 프루닝시키기 때문에 탐색공간을 효과적으로 감소시킬 수 있다. 제안된 방법의 유효성을 확인하기 위하여, 본 연구실에서 개발한 한국어 주소 입력 시스템에 적용하였다. 이 시스템은 48개의 연속 HMM 유사음소단위(Phoneme Like Units; PLUs)를 인식의 기본단위로 하고, .사용환경 변화에 의한 인식성능의 저하를 최소화하기 위해 최대사후 확률추정법(Maximum A Posteriori Probability Estimation; MAP)을 사용하며, 인식알고리즘으로는OPDP(One Pass Dynamic Programming)법을 이용하고 있다. 남성화자 3인에 의한 75개의 연결주소명을 이용하여 인식 실험을 수행한 결과 고정 프루닝 문턱치를 적용한 경우 인식률은 평균 $96.0\%$, 인식 시간은 5.26초였고, 기존의 가변 프루닝 문턱치의 경우 인식률은 평균 $96.0\%$, 인식 시간은 5.1초인 데 비하여, 새로운 가변 프루닝 문턱치를 적용찬 경우에는 인식률 저하없이 인식 시간이 4.34초로, 기존에 비해 각각 0.92초, 0.76초 인식 시간이 감소되어 제안한 방법의 유효성을 확인할 수 있었다.는 달리 각 산란 영역에서 그 지수는 1씩 작은 값을 갖는다.향에 따라 음장변화가 크게 다를 것이 예상되므로 이를 규명하기 위해서는 궁극적으로 3차원적인 음장분포 연구가 필요하다. 음향센서를 해저면에 매설할 경우 수충의 수온변화와 센서 주변의 수온변화 사이에는 어느 정도의 시간지연이 존재하게 되므로 이에 대한 영향을 규명하는 것도 센서의 성능예측을 위해서 필요하리라 사료된다.가지는 심부 가스의 개발 성공률을 증가시키기 위하여 심부 가스가 존재하는 지역의 지질학적 부존 환경 및 조성상의 특성과 생산시 소요되는 생산비용을 심도에 따라 분석하고 생산에 수반되는 기술적 문제점들을 정리하였으며 마지막으로 향후 요구되는 연구 분야들을 제시하였다. 또한 참고로 현재 심부 가스의 경우 미국이 연구 개발 측면에서 가장 활발한 활동을 전개하고 있으며 그 결과 다수의 신뢰성 있는 자료들을 확보하고 있으므로 본 논문은 USGS와 Gas Research Institute(GRI)에서 제시한 자료에 근거하였다.ऀĀ耀Ā삱?⨀؀Ā Ā?⨀ጀĀ耀Ā?돀ꢘ?⨀硩?⨀ႎ?⨀?⨀넆돐쁖잖⨀쁖잖⨀/ࠐ?⨀焆덐瀆倆Āⶇ퍟ⶇ퍟ĀĀĀĀ磀鲕좗?⨀肤?⨀⁅Ⴅ?⨀쀃잖⨀䣙熸ጁ↏?⨀

  • PDF

Design and Implementation of a Main Memory Index based on the R-tree for Moving Object Databases (이동체 데이터베이스를 위한 R-tree 기반 메인 메모리 색인의 설계 및 구현)

  • Ahn, Sung-Woo;An, Kyoung-Hwan;Lee, Chaug-Woo;Hong, Bong-Hee
    • Journal of Korea Spatial Information System Society
    • /
    • v.8 no.2 s.17
    • /
    • pp.53-73
    • /
    • 2006
  • Recently, the need for Location-Based Services (LBS) has increased due to the development of mobile devices, such as PDAs, cellular phones and GPS. As a moving object database that stores and manages the positions of moving objects is the core technology of LBS, the scheme for maintaining the main memory DBMS to the server is necessary to store and process frequent reported positions of moving objects efficiently. However, previous works on a moving object database have studied mostly a disk based moving object index that is not guaranteed to work efficiently in the main memory DBMS because these indexes did not consider characteristics of the main memory. It is necessary to study the main memory index scheme for a moving object database. In this paper, we propose the main memory index scheme based on the R-tree for storing and processing positions of moving objects efficiently in the main memory DBMS. The proposed index scheme, which uses a growing node structure, prevents the splitting cost from increasing by delaying the node splitting when a node overflows. The proposed scheme also improves the search performance by using a MergeAndSplit policy for reducing overlaps between nodes and a LargeDomainNodeSplit policy for reducing a ratio of a domain size occupied by node's MBRs. Our experiments show that the proposed index scheme outperforms the existing index scheme on the maximum 30% for range queries.

  • PDF

TBM risk management system considering predicted ground condition ahead of tunnel face: methodology development and application (막장전방 예측기법에 근거한 TBM 터널의 리스크 관리 시스템 개발 및 현장적용)

  • Chung, Heeyoung;Park, Jeongjun;Lee, Kang-Hyun;Park, Jinho;Lee, In-Mo
    • Journal of Korean Tunnelling and Underground Space Association
    • /
    • v.18 no.1
    • /
    • pp.1-12
    • /
    • 2016
  • When utilizing a Tunnel Boring Machine (TBM) for tunnelling work, unexpected ground conditions can be encountered that are not predicted in the design stage. These include fractured zones or mixed ground conditions that are likely to reduce the stability of TBM excavation, and result in considerable economic losses such as construction delays or increases in costs. Minimizing these potential risks during tunnel construction is therefore a crucial issue in any mechanized tunneling project. This paper proposed the potential risk events that may occur due to risky ground conditions. A resistivity survey is utilized to predict the risky ground conditions ahead of the tunnel face during construction. The potential risk events are then evaluated based on their occurrence probability and impact. A TBM risk management system that can suggest proper solution methods (measures) for potential risk events is also developed. Multi-Criterion Decision Making (MCDM) is utilized to determine the optimal solution method (optimal measure) to handle risk events. Lastly, an actual construction site, at which there was a risk event during Earth Pressure-Balance (EPB) Shield TBM construction, is analyzed to verify the efficacy of the proposed system.

Development of penetration rate model and optimum operational conditions of shield TBM for electricity transmission tunnels (터널식 전력구를 위한 순굴진율 모델 개발 및 이를 활용한 쉴드TBM 최적운전 조건 제안)

  • Kim, Jeong-Ju;Ryu, Hui-Hwan;Kim, Gyeong-Yeol;Hong, Seong-Yeon;Jeong, Ju-Hwan;Bae, Du-San
    • Journal of Korean Tunnelling and Underground Space Association
    • /
    • v.22 no.6
    • /
    • pp.623-641
    • /
    • 2020
  • About 5 km length of tunnels were constructed by mechanized tunnelling method using closed type shield TBM. In order to avoid construction delay problems for ensuring timely electricity transmission, it is necessary to increase the prediction accuracy of the excavation process involving machines according to rock mass types. This is important to corroborate the project duration and optimum operation for various considerations involved in the machine. So, full-scale tunnelling tests were performed for developing the advance rate model to be appropriately used for 3.6 m diameter shield TBM. About 100 test cases were established and performed using various operational parameters such as thrust force and rotational speed of cuttterhead in representative uniaxial compressive strengths. Accordingly, relationships between normal force and penetration depth and, between UCS and torque were suggested which consider UCS and thrust force conditions according to weathered, soft, hard rocks. Capacity analysis of cutterhead was performed and optimum operational conditions were also suggested based on the developed model. Based on this study, it can be expected that the project construction duration can be reduced and users can benefit from the provision of earlier service.

The Extraction of the Edge Histogram using Wavelet Coefficients in the Wavelet Domain (웨이블릿 영역에서의 웨이블릿 계수들을 이용한 에지 히스토그램 추출 기법 연구)

  • Song, Jin-Ho;Eom, Min-Young;Choe, Yoon-Sik
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.42 no.5 s.305
    • /
    • pp.137-144
    • /
    • 2005
  • In this paper, the extraction method of the edge histogram directly using wavelet coefficients in the wavelet domain for JPEG2000 images is proposed. MPEG-7 Edge Histogram Descriptor(EHD) extracts edge histogram in the spacial domain. This algorithm has much multiplication and addition for the edge extraction because it needs the decoding processing. However because the proposed algorithm extracts the edge histogram in the wavelet domain, it doesn't need the decoding processing and it decreases multiplication and addition. The Discrete Wavelet Transform(DWT) is a standard transform in JPEG2000. The proposed algorithm uses Le Gall 5/3 filter in JPEG2000 and odd coefficients in LH2 and HL2 sub-band. The edge direction can be decided to use rate of HL2 and LH2 odd coefficients. According to experiments, there is no difference of the efficiency between EHD and the proposed algorithm And the proposed algorithm is much better than EHD for multiplication and addition in the edge extraction of images.

A numerical analysis study on the flammable volume by leakage of hydrogen fuel vehicles in parking lot (지하주차장 내 수소연료차의 수소 방출시 가연체적에 관한 수치해석적 연구)

  • Lee, Ho-Hyung;Kim, Hyo-Gyu;Yoo, Ji-Oh;Kim, Doo-Young
    • Journal of Korean Tunnelling and Underground Space Association
    • /
    • v.23 no.6
    • /
    • pp.439-449
    • /
    • 2021
  • The recent reduction in greenhouse gases, interest in environmental pollution such as low-carbon emission policies is increasing. Accordingly, the penetration rate of eco-friendly vehicles, including hydrogen battery vehicles capable of reducing carbon emission, is increasing, and thus it is required for disaster prevention and safety-related measures. In this study, the degree of risk for the concentration distribution of hydrogen when leaking hydrogen fuel vehicles according to ventilation conditions was analyzed through numerical analysis, limited to places in parking lots. As a result, when only one hydrogen tank was released, the combustible volume ratio of hydrogen in the underground parking lot was up to 8.6%, and as ventilation continued, the volume ratio of combustible hydrogen decreased to less than 1% after 150 seconds, indicating that mechanical ventilation is essential. In the case of simultaneous release or stage release of three hydrogen tanks, the final combustible volume ratio of hydrogen is similar, but the increase in the combustible volume ratio of hydrogen in the early stage of release is low, and further research is expected.