• 제목/요약/키워드: stochastic optimization methods

검색결과 81건 처리시간 0.023초

은닉 마르코프 모델의 확률적 최적화를 통한 자동 독순의 성능 향상 (Improved Automatic Lipreading by Stochastic Optimization of Hidden Markov Models)

  • 이종석;박철훈
    • 정보처리학회논문지B
    • /
    • 제14B권7호
    • /
    • pp.523-530
    • /
    • 2007
  • 본 논문에서는 자동 독순(automatic lipreading)의 인식기로 쓰이는 은닉 마르코프 모델(HMM: hidden Markov model)의 새로운 확률적 최적화 기법을 제안한다. 제안하는 기법은 전역 최적화가 가능한 확률적 기법인 모의 담금질과 지역 최적화 기법을 결합하는 것으로써, 알고리즘의 빠른 수렴과 좋은 해로의 수렴을 가능하게 한다. 제안하는 알고리즘이 전역 최적해로 수렴함을 수학적으로 보인다. 제안하는 기법을 통해 HMM을 학습함으로써 기존의 알고리즘이 지역해만을 찾는 단점을 개선함으로써 향상된 독순 성능을 나타냄을 실험으로 보인다.

시뮬레이션 최적화 기법과 절삭공정에의 응용 (Simulation Optimization Methods with Application to Machining Process)

  • 양병희
    • 한국시뮬레이션학회논문지
    • /
    • 제3권2호
    • /
    • pp.57-67
    • /
    • 1994
  • For many practical and industrial optimization problems where some or all of the system components are stochastic, the objective functions cannot be represented analytically. Therefore, modeling by computer simulation is one of the most effective means of studying such complex systems. In this paper, with discussion of simulation optimization techniques, a case study in machining process for application of simulation optimization is presented. Most of optimization techniques can be classified as single-or multiple-response techniques. The optimization of single-response category, these strategies are gradient based search methods, stochastic approximate method, response surface method, and heuristic search methods. In the multiple-response category, there are basically five distinct strategies for treating the responses and finding the optimum solution. These strategies are graphical method, direct search method, constrained optimization, unconstrained optimization, and goal programming methods. The choice of the procedure to employ in simulation optimization depends on the analyst and the problem to be solved.

  • PDF

Design Centering by Genetic Algorithm and Coarse Simulation

  • Jinkoo Lee
    • 한국CDE학회논문집
    • /
    • 제2권4호
    • /
    • pp.215-221
    • /
    • 1997
  • A new approach in solving design centering problem is presented. Like most stochastic optimization problems, optimal design centering problems have intrinsic difficulties in multivariate intergration of probability density functions. In order to avoid to avoid those difficulties, genetic algorithm and very coarse Monte Carlo simulation are used in this research. The new algorithm performs robustly while producing improved yields. This result implies that the combination of robust optimization methods and approximated simulation schemes would give promising ways for many stochastic optimizations which are inappropriate for mathematical programming.

  • PDF

A Modified Particle Swarm Optimization for Optimal Power Flow

  • Kim, Jong-Yul;Lee, Hwa-Seok;Park, June-Ho
    • Journal of Electrical Engineering and Technology
    • /
    • 제2권4호
    • /
    • pp.413-419
    • /
    • 2007
  • The optimal power flow (OPF) problem was introduced by Carpentier in 1962 as a network constrained economic dispatch problem. Since then, it has been intensively studied and widely used in power system operation and planning. In the past few decades, many stochastic optimization methods such as Genetic Algorithm (GA), Evolutionary Programming (EP), and Particle Swarm Optimization (PSO) have been applied to solve the OPF problem. In particular, PSO is a newly proposed population based stochastic optimization algorithm. The main idea behind it is based on the food-searching behavior of birds and fish. Compared with other stochastic optimization methods, PSO has comparable or even superior search performance for some hard optimization problems in real power systems. Nowadays, some modifications such as breeding and selection operators are considered to make the PSO superior and robust. In this paper, we propose the Modified PSO (MPSO), in which the mutation operator of GA is incorporated into the conventional PSO to improve the search performance. To verify the optimal solution searching ability, the proposed approach has been evaluated on an IEEE 3D-bus test system. The results showed that performance of the proposed approach is better than that of the standard PSO.

On procedures for reliability assessment of mechanical systems and structures

  • Schueller, G.I.
    • Structural Engineering and Mechanics
    • /
    • 제25권3호
    • /
    • pp.275-289
    • /
    • 2007
  • In this paper a brief overview of methods to assess the reliability of mechanical systems and structures is presented. A selection of computational procedures, stochastic structural dynamics, stochastic fatigue crack growth and reliability based optimization are discussed. It is shown that reliability based methods may form the basis for a rational decision making.

마코프 누적 프로세스에서의 확률적 콘벡스성 (Stochastic convexity in markov additive processes)

  • 윤복식
    • 한국경영과학회:학술대회논문집
    • /
    • 대한산업공학회/한국경영과학회 1991년도 춘계공동학술대회 발표논문 및 초록집; 전북대학교, 전주; 26-27 Apr. 1991
    • /
    • pp.147-159
    • /
    • 1991
  • Stochastic convexity(concvity) of a stochastic process is a very useful concept for various stochastic optimization problems. In this study we first establish stochastic convexity of a certain class of Markov additive processes through the probabilistic construction based on the sample path approach. A Markov additive process is obtained by integrating a functional of the underlying Markov process with respect to time, and its stochastic convexity can be utilized to provide efficient methods for optimal design or for optimal operation schedule of a wide range of stochastic systems. We also clarify the conditions for stochatic monotonicity of the Markov process, which is required for stochatic convexity of the Markov additive process. This result shows that stochastic convexity can be used for the analysis of probabilistic models based on birth and death processes, which have very wide application area. Finally we demonstrate the validity and usefulness of the theoretical results by developing efficient methods for the optimal replacement scheduling based on the stochastic convexity property.

  • PDF

마코프 누적 프로세스에서의 확률적 콘벡스성과 그 응용 (Stochastic convexity in Markov additive processes and its applications)

  • 윤복식
    • 한국경영과학회지
    • /
    • 제16권1호
    • /
    • pp.76-88
    • /
    • 1991
  • Stochastic convexity (concavity) of a stochastic process is a very useful concept for various stochastic optimization problems. In this study we first establish stochastic convexity of a certain class of Markov additive processes through probabilistic construction based on the sample path approach. A Markov additive process is abtained by integrating a functional of the underlying Markov process with respect to time, and its stochastic convexity can be utilized to provide efficient methods for optimal design or optimal operation schedule wide range of stochastic systems. We also clarify the conditions for stochastic monotonicity of the Markov process. From the result it is shown that stachstic convexity can be used for the analysis of probabilitic models based on birth and death processes, which have very wide applications area. Finally we demonstrate the validity and usefulness of the theoretical results by developing efficient methods for the optimal replacement scheduling based on the stochastic convexity property.

  • PDF

A Study on the Optimum Structural Design for Oil Tankers Using Multi-Objective Optimization

  • Jang, Chang-Doo;Shin, Sang-Hun
    • 한국전산구조공학회:학술대회논문집
    • /
    • 한국전산구조공학회 1998년도 봄 학술발표회 논문집
    • /
    • pp.245-253
    • /
    • 1998
  • Recently, the importance of multi-objective optimization techniques and stochastic search methods is increasing. The stochastic search methods have the concepts of the survival of the fittest and natural selection such as genetic algorithms(GA), simulated annealing(SA) and evolution strategies (ES). As many accidents of oil tankers cause marine pollution, oil tankers of double hull or mid deck structure are being built to minimize the marine pollution. For the improvement of oil tanker design technique, an efficient optimization technique is proposed in this study. Multi-objective optimization problem of weight and cost of double hull and mid deck tanker is formulated. Discrete design variables are used considering real manufacturing, and the concept of relative production cost is also introduced. The ES method is used as an optimization technique, and the ES algorithm was developed to generate a more efficient Pareto optimal set.

  • PDF

A STOCHASTIC VARIANCE REDUCTION METHOD FOR PCA BY AN EXACT PENALTY APPROACH

  • Jung, Yoon Mo;Lee, Jae Hwa;Yun, Sangwoon
    • 대한수학회보
    • /
    • 제55권4호
    • /
    • pp.1303-1315
    • /
    • 2018
  • For principal component analysis (PCA) to efficiently analyze large scale matrices, it is crucial to find a few singular vectors in cheaper computational cost and under lower memory requirement. To compute those in a fast and robust way, we propose a new stochastic method. Especially, we adopt the stochastic variance reduced gradient (SVRG) method [11] to avoid asymptotically slow convergence in stochastic gradient descent methods. For that purpose, we reformulate the PCA problem as a unconstrained optimization problem using a quadratic penalty. In general, increasing the penalty parameter to infinity is needed for the equivalence of the two problems. However, in this case, exact penalization is guaranteed by applying the analysis in [24]. We establish the convergence rate of the proposed method to a stationary point and numerical experiments illustrate the validity and efficiency of the proposed method.

Multi-Objective Stochastic Optimization in Water Resources System

  • Shim, Soon Bo
    • 한국경영과학회지
    • /
    • 제8권1호
    • /
    • pp.41-59
    • /
    • 1983
  • The purpose of this paper is to present a method of multi-objective, stochastic optimization in water resources system which investigates the development of potential non-normal deterministic equivalents for subsequent use in multiobjective stochastic programming methods, Given probability statement involving a function of several random variables, it is often possible to obtain a deterministic equivalent of it that does not include any orginal random variables. A Stochastic trade-off technique-MSTOT is suggested to help a decision maker achieve satisfactory levels for several objective functions. This makes use of deterministic equivalents to handle random variables in the objective functions. The emphasis is in the development of non-normal deterministic equivalents for use in multiobjective stochastic techniques.

  • PDF