• Title/Summary/Keyword: Deterministic design

Search Result 438, Processing Time 0.034 seconds

Reinforcement Learning based on Deep Deterministic Policy Gradient for Roll Control of Underwater Vehicle (수중운동체의 롤 제어를 위한 Deep Deterministic Policy Gradient 기반 강화학습)

  • Kim, Su Yong;Hwang, Yeon Geol;Moon, Sung Woong
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.24 no.5
    • /
    • pp.558-568
    • /
    • 2021
  • The existing underwater vehicle controller design is applied by linearizing the nonlinear dynamics model to a specific motion section. Since the linear controller has unstable control performance in a transient state, various studies have been conducted to overcome this problem. Recently, there have been studies to improve the control performance in the transient state by using reinforcement learning. Reinforcement learning can be largely divided into value-based reinforcement learning and policy-based reinforcement learning. In this paper, we propose the roll controller of underwater vehicle based on Deep Deterministic Policy Gradient(DDPG) that learns the control policy and can show stable control performance in various situations and environments. The performance of the proposed DDPG based roll controller was verified through simulation and compared with the existing PID and DQN with Normalized Advantage Functions based roll controllers.

New hybrid stochastic-deterministic rock block analysis method in tunnels (터널의 신 하이브리드 추계학적-확정론적 암반블럭 해석기법)

  • Hwang, Jae-Yun
    • Journal of Korean Tunnelling and Underground Space Association
    • /
    • v.12 no.3
    • /
    • pp.265-274
    • /
    • 2010
  • In many tunnels, falling or sliding of rock blocks often occur, which cannot be predicted because of the complexity of rock discontinuities and it has brought an exponential increase in costs and time to manage. It is difficult to estimate the properties of rock masses before the tunnel excavation. The observational design and construction method in tunnels has been becoming important recently. In this study, a new hybrid stochastic-deterministic rock block analysis method for the prediction of the unstable rock blocks before the tunnel excavation is proposed, and then applied to the tunnel construction based on actual rock discontinuity information observed in the field. The comparisons and investigations with the analytical results in the tunnel construction have confirmed the validity and applicability of this new hybrid stochastic-deterministic rock block analysis method in tunnels.

Analysis Technique on Time-dependent PDF (Probability of Durability Failure) Considering Equivalent Surface Chloride Content (균등 표면 염화물량을 고려한 시간 의존적 내구적 파괴확률 해석기법)

  • Lee, Hack-Soo;Kwon, Seung-Jun
    • Journal of the Korea institute for structural maintenance and inspection
    • /
    • v.21 no.2
    • /
    • pp.46-52
    • /
    • 2017
  • Recently durability design based on deterministic or probabilistic method has been attempted since service life evaluation in RC(Reinforced Concrete) structure exposed to chloride attack is important. The deterministic durability design contains a reasonable method with time effect on surface chloride content and diffusion coefficient, however the probabilistic design procedure has no consideration of time effect on both. In the paper, a technique on PDF(Probability of Durability Failure) evaluation is proposed considering time effect on diffusion and surface chloride content through equivalent surface chloride content which has same induced chloride content within a given period and cover depth. With varying period to built-up from 10 to 30 years and maximum surface chloride content from $5.0kg/m^3$ to $10.0kg/m^3$, the changing PDF and the related service life are derived. The proposed method can be reasonably applied to actual durability design with preventing conservative design parameters and considering the same analysis conditions of the deterministic method.

Study on Optimization of Design Parameters for Offshore Mooring System using Sampling Method (샘플링 기법을 통한 계류 시스템 설계 변수 최적화 방안에 관한 연구)

  • Kang, Soo-Won;Lee, Seung-Jae
    • Journal of Ocean Engineering and Technology
    • /
    • v.32 no.4
    • /
    • pp.215-221
    • /
    • 2018
  • In this study, the optimal design of a mooring system was carried out. Unlike almost all design methods, which are based on the deterministic method, this study focused on the probabilistic method. The probabilistic method, especially the design of experiment (DOE), could be a good way to cover some of the drawbacks of the deterministic approach. There various parameters for a mooring system, as widely known, including the weight, length, and stiffness of line. Scenarios for the mooring system parameters were produced using the Latin Hypercube Sampling method of the probabilistic approach. Next, a vessel-mooring system coupled analysis was performed in Orcaflex. A total of 50 scenarios were used in this study to optimize the initial design by means of a genetic algorithm. Finally, after determining the optimal process, a reliability analysis was performed to understand the system validity.

Design of Stochastic Observer for The Optimal Control of A Flexible Manipulator (유연성 매니퓨레이터의 최적제어를 위한 STOCHASTIC관측기의 설계)

  • 남호범;박종국
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.38 no.9
    • /
    • pp.753-760
    • /
    • 1989
  • A method is suggested to design a stochastic observer which can be used as a state estimator for the optimal control of a one link flexible manipulator. This stochastic observer is derived from unifying the two concepts of reduced-state deterministic observer theory and optimal Kalman filtering theory. In estimating state variables for the optimal control, instead of using the two different state estimators for the deterministic system with noise free measurements and stochastic system with noise measurements, only one stochastic observer is designed which is to be used in both systems commonly. Through the simulation, it has been shown that the flexible system with the stochastic observer is similar in characteristics to the flexible system assuming that all states can be measured.

  • PDF

Design of Cellular Manufacturing System with Alternative Process Plans under Uncertain Demand (수요가 불확실한 환경에서 대체공정계획을 고려한 셀형제조시스템 설계)

  • Ko, Chang-Seong;Lee, Sang-Hun;Lee, Yang-Woo
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.24 no.4
    • /
    • pp.559-569
    • /
    • 1998
  • Cellular manufacturing system (CMS) has been recognized as an alternative to improve manufacturing productivity in conventional batch-type manufacturing systems through reducing set-up times, work-in-process inventories and throughput times by means of group technology. Most of the studies on the design of CMS assumed that each part has a unique process plan, and that its demand is known as a deterministic value despite of the probabilistic nature of the real world problems. This study suggests an approach for designing CMS, considering both alternative process plans and uncertain demand. A mathematical model is presented to show how to minimize the expected amortized and operating costs satisfying these two relaxations. Four heuristic algorithms are developed based on tabu search which is well suited for getting an optimal or near-optimal solution. Example problems are carried out to illustrate the heuristic algorithms and each of them is compared with the deterministic counterpart.

  • PDF

Service Life Variation for RC Structure under Carbonation Considering Korean Design Standard and Design Cover Depth (국내설계기준과 피복두께를 고려한 RC 구조물의 탄산화 내구수명의 변동성)

  • Kim, Yun-Shik;Kwon, Seung-Jun
    • Journal of the Korea institute for structural maintenance and inspection
    • /
    • v.25 no.5
    • /
    • pp.15-23
    • /
    • 2021
  • In this paper, service life for RC(Reinforced Concrete) substructure subjective to carbonation was evaluated through deterministic and probabilistic method considering field investigation data and Design Code(KDS 14 20 40). Furthermore changes in service life with increasing COV(Coefficient of Variation) and equivalent safety index meeting the same service life were studied. From the investigation, the mean and its COV of cover depth were evaluated to 70.0 ~ 90.0 mm and 0.2, respectively. With intended failure probability of 10.0 % and 70 mm of cover depth, service life decreased to 137 years, 123 years, and 91 years with increasing COV of 0.05, 0.1, and 0.2, respectively. In the case of 80 mm of cover depth, it changes to 179 years, 161 years, and 120 years with increasing COV. The equivalent safety index meeting the same service life from deterministic method showed 1.66 ~ 3.43 for 70 mm of cover depth and 1.61 ~ 3.24 for 80 mm of cover depth, respectively. The various design parameters covering local environment and quality condition in deterministic method yields a considerable difference of service life, so that determination of design parameters are required for exposure conditions and parameter variation.

General Framework for Risk-based Seismic Design (위험도 기반 내진 설계의 일반적인 프레임워크)

  • 장승필;오윤숙;김남희
    • Proceedings of the Earthquake Engineering Society of Korea Conference
    • /
    • 2002.09a
    • /
    • pp.285-291
    • /
    • 2002
  • This paper proposes the concept and the general framework of the risk-based seismic design. Because earthquakes and the behaviors of structures are very unpredictable, probabilistic seismic design methods have been proposed after deterministic design methods. Considering these changes, we can find that the important point of seismic design is not the structural behavior itself, but the consequence of structural behavior under possible earthquakes. Risk-based seismic design can tell these consequences under any earthquakes. In this paper, structural confidences are considered by using fragility curve, and risk is modeled by failure probability and consequence-property damage cost, casualty cost.

  • PDF

Response transformation factors for deterministic-based and reliability-based seismic design

  • Bojorquez, Eden;Bojorquez, Juan;Ruiz, Sonia E.;Reyes-Salazar, Alfredo;Velazquez-Dimas, Juan
    • Structural Engineering and Mechanics
    • /
    • v.46 no.6
    • /
    • pp.755-773
    • /
    • 2013
  • One of the main requirements of the seismic design codes must be its easy application by structural engineers. The use of practically-applicable models or simplified models as single-degree-of-freedom (SDOF) systems is a good alternative to achieve this condition. In this study, deterministic and probabilistic response transformation factors are obtained to evaluate the response in terms of maximum ductility and maximum interstory drifts of multi-degree-of-freedom (MDOF) systems based on the response of equivalent SDOF systems. For this aim, five steel frames designed with the Mexican City Building Code (MCBC) as well as their corresponding equivalent SDOF systems (which represent the characteristics of the frames) are analyzed. Both structural systems are subjected to ground motions records. For the MDOF and the simplified systems, incremental dynamic analyses IDAs are developed in first place, then, structural demand hazard curves are obtained. The ratio between the IDAs curves corresponding to the MDOF systems and the curves corresponding to the simplified models are used to obtain deterministic response transformation factors. On the other hand, demand hazard curves are used to calculate probabilistic response transformation factors. It was found that both approaches give place to similar results.

Probabilistic Analysis and Design of the Spacing of Prefabricated Vertical Drains Considering Uncertainties in Geotechnical Property (지반 불확실성을 고려한 연직배수재 배치간격의 확률론적 해석과 결정)

  • Kim, Bang-Sig;Kim, Byung-Il
    • Journal of the Korean Geotechnical Society
    • /
    • v.23 no.4
    • /
    • pp.125-132
    • /
    • 2007
  • The oedometer, radial CRS and Rowe cell tests, composite discharge capacity tests and smear effect tests are carried out to estimate the parameters for the reliability-based design of vertical drain method. Also the sensitivity analysis, the probabilistic and deterministic solutions of radial consolidation theory are presented. The result of probabilistic analysis was compared to that of deterministic analysis using the tested and estimated parameters. The results indicated that the drain spacing in the deterministic method is larger than that in the probabilistic method because the former does not consider the uncertainties in the geotechnical property. The divergence of two methods is dependent on the probability of achieving target degree of consolidation by a given time and the coefficient of variation (COV) of the coefficient of horizontal consolidation ($c_h$).