• Title/Summary/Keyword: Defining Model

Search Result 585, Processing Time 0.021 seconds

Dynamic Positioning of Robot Soccer Simulation Game Agents using Reinforcement learning

  • Kwon, Ki-Duk;Cho, Soo-Sin;Kim, In-Cheol
    • Proceedings of the Korea Inteligent Information System Society Conference
    • /
    • 2001.01a
    • /
    • pp.59-64
    • /
    • 2001
  • The robot soccer simulation game is a dynamic multi-agent environment. In this paper we suggest a new reinforcement learning approach to each agent's dynamic positioning in such dynamic environment. Reinforcement learning is the machine learning in which an agent learns from indirect, delayed reward an optimal policy to chose sequences of actions that produce the greatest cumulative reward. Therefore the reinforcement learning is different from supervised learning in the sense that there is no presentation of input pairs as training examples. Furthermore, model-free reinforcement learning algorithms like Q-learning do not require defining or learning any models of the surrounding environment. Nevertheless it can learn the optimal policy if the agent can visit every state- action pair infinitely. However, the biggest problem of monolithic reinforcement learning is that its straightforward applications do not successfully scale up to more complex environments due to the intractable large space of states. In order to address this problem. we suggest Adaptive Mediation-based Modular Q-Learning (AMMQL)as an improvement of the existing Modular Q-Learning (MQL). While simple modular Q-learning combines the results from each learning module in a fixed way, AMMQL combines them in a more flexible way by assigning different weight to each module according to its contribution to rewards. Therefore in addition to resolving the problem of large state effectively, AMMQL can show higher adaptability to environmental changes than pure MQL. This paper introduces the concept of AMMQL and presents details of its application into dynamic positioning of robot soccer agents.

  • PDF

Development of Ubiquitous Sensor Network Applications based on Software Product Line Approach (프로덕트 라인 기반의 센서 네트워크 응용 소프트웨어 개발)

  • Kim, Young-Hee;Lee, Woo-Jin;Choi, Il-Woo
    • The KIPS Transactions:PartA
    • /
    • v.14A no.7
    • /
    • pp.399-408
    • /
    • 2007
  • Currently various techniques for efficiently developing sensor network applications are developed. However, these techniques provide the method for developing only single sensor network application easily and rapidly. Since sensor network applications control various sensor nodes based on core components of operating system, the technique to develop applications by defining common functionalities of various applications and selecting variable functionalities according to the work flow of specific application is efficient. Accordingly, this paper presents an experimental study that identifies commonality of sensor network application domain and supports optional development according to the variability of application by applying product line approach to developing sensor network application. Through the experimental study, we describe the characteristics of sensor network application domain compared with general business domain for product line development. Also, we show the effectiveness of the proposed approach by presenting that core assets designed using the proposed variability feature model and VEADL are reused according to the functionalities of each sensor node.

Different Criteria for the Definition of Insulin Resistance and Its Relation with Dyslipidemia in Overweight and Obese Children and Adolescents

  • Nogueira-de-Almeida, Carlos Alberto;de Mello, Elza Daniel
    • Pediatric Gastroenterology, Hepatology & Nutrition
    • /
    • v.21 no.1
    • /
    • pp.59-67
    • /
    • 2018
  • Purpose: to compare cut off points corrected for age and gender (COOP) with fixed cut off points (FCOP) for fasting plasma insulin and Homeostatic model assessment-insulin resistance (HOMA-IR) for the diagnosis of IR in obese children and adolescents and their correlation with dyslipidemia. Methods: A multicenter, cross-sectional study including 383 subjects aged 7 to 18 years, evaluating fasting blood glucose, plasma insulin, and lipid profile. Subjects with high insulin levels and/or HOMA-IR were considered as having IR, based on two defining criteria: FCOP or CCOP. The frequency of metabolic abnormalities, the presence of IR, and the presence of dyslipidemia in relation to FCOP or CCOP were analyzed using Fisher and Mann-Whitney exact tests. Results: Using HOMA-IR, IR was diagnosed in 155 (40.5%) and 215 (56.1%) patients and, using fasting insulin, 150 (39.2%) and 221 (57.7%), respectively applying FCOP and CCOP. The use of CCOP resulted in lower insulin and HOMA-IR values than FCOP. Dyslipidemia was not related to FCOP or CCOP. Blood glucose remained within normal limits in all patients with IR. There was no difference in the frequency of IR identified by plasma insulin or HOMA-IR, both for FCOP and CCOP. Conclusion: The CCOP of plasma insulin or of HOMA-IR detected more cases of IR as compared to the FCOP, but were not associated with the frequency of dyslipidemia. As blood glucose has almost no fluctuation in this age group, even in the presence of IR, fasting plasma insulin detected the same cases of IR that would be detected by HOMA-IR.

Reliability Analysis of Maximum Overtopping Volume for Evaluating Freeboard of Vertical Breakwaters (직립식 방파제의 마루높이 산정을 위한 최대월파량에 대한 신뢰성 해석)

  • Lee, Cheol-Eung
    • Journal of Korean Society of Coastal and Ocean Engineers
    • /
    • v.23 no.2
    • /
    • pp.154-162
    • /
    • 2011
  • A reliability analysis model is developed for evaluating the crest freeboard of vertical breakwaters based on the concepts of maximum overtopping volume of individual wave. A reliability function is formulated by defining the margin of admissible overtopping volume and maximum overtopping volume that is depend on the number of overtopping waves, dimensionless crest freeboard, and mean overtopping discharge. In addition, Level III MCS technique is straightforwardly suggested by which the related empirical parameters to reliability function can be considered to be random variables with the wide range of different uncertainties. It can be possible to calculate the probabilities of failure according to the relative crest freeboard with the variations of the incident wave directions, the structural types of vertical breakwaters, and admissible overtopping volumes in conditions of the long and short crested-waves.

Decision-making of alternative pylon shapes of a benchmark cable-stayed bridge using seismic risk assessment

  • Akhoondzade-Noghabi, Vahid;Bargi, Khosrow
    • Earthquakes and Structures
    • /
    • v.11 no.4
    • /
    • pp.583-607
    • /
    • 2016
  • One of the main applications of seismic risk assessment is that an specific design could be selected for a bridge from different alternatives by considering damage losses alongside primary construction costs. Therefore, in this paper, the focus is on selecting the shape of pylon, which is a changeable component in the design of a cable-stayed bridge, as a double criterion decision-making problem. Different shapes of pylons include H, A, Y, and diamond shape, and the two criterion are construction costs and probable earthquake losses. In this research, decision-making is performed by using developed seismic risk assessment process as a powerful method. Considering the existing uncertainties in seismic risk assessment process, the combined incremental dynamic analysis (IDA) and uniform design (UD) based fragility assessment method is proposed, in which the UD method is utilized to provide the logical capacity models of the structure, and the IDA method is employed to give the probabilistic seismic demand model of structure. Using the aforementioned models and by defining damage states, the fragility curves of the bridge system are obtained for the different pylon shapes usage. Finally, by combining the fragility curves with damage losses and implementing the proposed cost-loss-benefit (CLB) method, the seismic risk assessment process is developed with financial-comparative approach. Thus, the optimal shape of the pylon can be determined using double criterion decision-making. The final results of decision-making study indicate that the optimal pylon shapes for the studied span of cable-stayed bridge are, respectively, H shape, diamond shape, Y shape, and A shape.

Surface Reconstruction from Cross-Sectional Images using the Shrink-Wrapping Algorithm (Shrink-Wrapping 알고리즘을 이용한 단층영상으로부터의 표면 재구성)

  • Park, Eun-Jin;Choi, Young-Kyu
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.34 no.1
    • /
    • pp.28-37
    • /
    • 2007
  • This paper addresses a new surface reconstruction scheme for approximating the isosurface from a set of tomographic cross sectional images. Differently from the novel Marching cube algorithm, our method does not extract iso-density surface(isosurface) directly from the voxels but calculates the iso-density point(isopoint) first. After building the relatively coarse initial mesh by the Cell-boundary algorithm approximating the isosurface, it produces the final isosurface by iteratively shrinking and smoothing the initial mesh. Comparing with the Marching Cube algorithm, our method is robust and does not make any crack in resulting surface model. Furthermore, the proposed method surmounts the O(1)-adjacency limitation of MC in defining the isopoints by permitting the O(2) and O(3)-adjacent isopoints in surface reconstruction, and can produce more accurate isosurface. According to experiments, it is proved to be very robust and efficient for isosurface reconstruction from cross sectional images.

Effects of Acoustic Boundary Conditions on Combustion Instabilities in a Gas Turbine Combustor (음향 경계 조건이 가스터빈 연소기에서의 연소불안정에 미치는 영향)

  • Lim, Jaeyoung;Kim, Deasik;Kim, Seong-Ku;Cha, Dong Jin
    • Journal of the Korean Society of Propulsion Engineers
    • /
    • v.19 no.4
    • /
    • pp.15-23
    • /
    • 2015
  • This study predicts the basic characteristics of combustion instabilities in a gas turbine lean premixed combustor using ASCI3D code which is a FEM(Finite Element Method)-based Helmholtz solver. The prediction results show the good agreement with the measured data in modeling the overall combustion instability features, however, the code is found to overpredict the unstable conditions. As one of the efforts to improve the model accuracy, the effects of acoustic boundary conditions on the instability growth rate are analyzed. As a result, it is shown that the acoustic reflection coefficient has a great impact on the instability and the prediction accuracy can be enhanced by defining the precise acoustic conditions.

Behavior of semi-rigid steel frames under near- and far-field earthquakes

  • Sharma, Vijay;Shrimali, Mahendra K.;Bharti, Shiv D.;Datta, Tushar K.
    • Steel and Composite Structures
    • /
    • v.34 no.5
    • /
    • pp.625-641
    • /
    • 2020
  • The realistic modeling of the beam-column semi-rigid connection in steel frames attracted the attention of many researchers in the past for the seismic analysis of semi-rigid frames. Comparatively less studies have been made to investigate the behavior of steel frames with semi-rigid connections under different types of earthquake. Herein, the seismic behavior of semi-rigid steel frames is investigated under both far and near-field earthquakes. The semi-rigid connection is modeled by the multilinear plastic link element consisting of rotational springs. The kinematic hysteresis model is used to define the dynamic behavior of the rotational spring, describing the nonlinearity of the semi-rigid connection as defined in SAP2000. The nonlinear time history analysis (NTHA) is performed to obtain response time histories of the frame under scaled earthquakes at three PGA levels denoting the low, medium and high-level earthquakes. The other important parameters varied are the stiffness and strength parameters of the connections, defining the degree of semi-rigidity. For studying the behavior of the semi-rigid frame, a large number of seismic demand parameters are considered. The benchmark for comparison is taken as those of the corresponding rigid frame. Two different frames, namely, a five-story frame and a ten-story frame are considered as the numerical examples. It is shown that semi-rigid frames prove to be effective and beneficial in resisting the seismic forces for near-field earthquakes (PGA ≈ 0.2g), especially in reducing the base shear to a considerable extent for the moderate level of earthquake. Further, the semi-rigid frame with a relatively weaker beam and less connection stiffness may withstand a moderately strong earthquake without having much damage in the beams.

A Study on the Libraries' Quintessence by Interpreting Information as Ubiquitous (정보의 유비쿼터스적 해석을 통한 도서관 본질에 관한 연구)

  • Chung, Jun-Min;Park, Seong-Woo
    • Journal of the Korean Society for information Management
    • /
    • v.21 no.4 s.54
    • /
    • pp.265-279
    • /
    • 2004
  • This study is to research quintessence of information service in the libraries by interpreting 'Information' as it is ubiquitous. For the purpose, it investigates and analyzes information behaviors of the libraries in information-cultural history. The meaning of 'ubiquitous' is understood as a practice that everything we need should be inherent in our lives for its usefulness and effectiveness. Information is intrinsic in our lives and the libraries, information management systems, have been evolved by extending the intrinsic value of information, 'ubiquity'. Human being's history results from information behaviors and the meaning of the libraries consists of production, accumulation, organization and distribution of the libraries. It should be recognized that the ultimate purpose of the library services is for their users. Consequently information systems and technological networks in the libraries should be focused on applications and inherence for the purpose. Model studies of the libraries should be developed to user-centered information services that substantialize the interpretation of information, as it is ubiquitous. This study is a trial for defining the quintessence of the libraries. Furthermore, it provides foundation of understanding what the libraries are.

H-Anim-based Definition of Character Animation Data (캐릭터 애니메이션 데이터의 H-Anim 기반 정의)

  • Lee, Jae-Wook;Lee, Myeong-Won
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.15 no.10
    • /
    • pp.796-800
    • /
    • 2009
  • Currently, there are many software tools that can generate 3D human figure models and animations based on the advancement of computer graphics technology. However, we still have problems in interoperability of human data models in different applications because common data models do not exist. To address this issue, the Web3D Consortium and the ISO/IEC JTC1 SC24 WG6 have developed the H-Anim standard. However, H-Anim does not include human motion data formats although it defines the structure of a human figure. This research is intended to obtain interoperable human animation by defining the data for human motions in H- Anim figures. In this paper, we describe a syntactic method to define motion data for the H-Anim figure and its implementation. In addition, we describe a method of specifying motion parameters necessary for generating animations by using an arbitrary character model data set created by a general graphics tool.