• 제목/요약/키워드: SVM regression

검색결과 253건 처리시간 0.021초

Support Vector Machine을 이용한 플라즈마 공정 모델링 (Modeling of Plasma Process Using Support Vector Machine)

  • 김민재;김병환
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2006년 학술대회 논문집 정보 및 제어부문
    • /
    • pp.211-213
    • /
    • 2006
  • In this study, plasma etching process was modeled by using support vector machine (SVM). The data used in modeling were collected from the etching of silica thin films in inductively coupled plasma. For training and testing neural network, 9 and 6 experiments were used respectively. The performance of SVM was evaluated as a function of kernel type and function type. For the kernel type, Epsilon-SVR and Nu-SVR were included. For the function type, linear, polynomial, and radial basis function (RBF) were included. The performance of SVM was optimized first in terms of kernel type, then as a function of function type. Five film characteristics were modeled by using SVM and the optimized models were compared to statistical regression models. The comparison revealed that statistical regression models yielded better predictions than SVM.

  • PDF

Prediction Intervals for LS-SVM Regression using the Bootstrap

  • Shim, Joo-Yong;Hwang, Chang-Ha
    • Journal of the Korean Data and Information Science Society
    • /
    • 제14권2호
    • /
    • pp.337-343
    • /
    • 2003
  • In this paper we present the prediction interval estimation method using bootstrap method for least squares support vector machine(LS-SVM) regression, which allows us to perform even nonlinear regression by constructing a linear regression function in a high dimensional feature space. The bootstrap method is applied to generate the bootstrap sample for estimation of the covariance of the regression parameters consisting of the optimal bias and Lagrange multipliers. Experimental results are then presented which indicate the performance of this algorithm.

  • PDF

Human Detection 을 위한 Bayesian Logistic Regression (Bayesian Logistic Regression for Human Detection)

  • ;;이칠우
    • 한국HCI학회:학술대회논문집
    • /
    • 한국HCI학회 2008년도 학술대회 1부
    • /
    • pp.569-572
    • /
    • 2008
  • The possibility to extent the solution in human detection problem for plug-in on vision-based Human Computer Interaction domain is very attractive, since the successful of the machine leaning theory and computer vision marriage. Bayesian logistic regression is a powerful classifier performing sparseness and high accuracy. The difficulties of finding people in an image will be conquered by implementing this Bavesian model as classifier. The comparison with other massive classifier e.g. SVM and RVM will introduce acceptance of this method for human detection problem. Our experimental results show the good performance of Bavesian logistic regression in human detection problem, both in trade-off curves (ROC, DET) and real-implementation compare to SVM and RVM.

  • PDF

Kernel-Trick Regression and Classification

  • Huh, Myung-Hoe
    • Communications for Statistical Applications and Methods
    • /
    • 제22권2호
    • /
    • pp.201-207
    • /
    • 2015
  • Support vector machine (SVM) is a well known kernel-trick supervised learning tool. This study proposes a working scheme for kernel-trick regression and classification (KtRC) as a SVM alternative. KtRC fits the model on a number of random subsamples and selects the best model. Empirical examples and a simulation study indicate that KtRC's performance is comparable to SVM.

Hybrid Fuzzy Least Squares Support Vector Machine Regression for Crisp Input and Fuzzy Output

  • Shim, Joo-Yong;Seok, Kyung-Ha;Hwang, Chang-Ha
    • Communications for Statistical Applications and Methods
    • /
    • 제17권2호
    • /
    • pp.141-151
    • /
    • 2010
  • Hybrid fuzzy regression analysis is used for integrating randomness and fuzziness into a regression model. Least squares support vector machine(LS-SVM) has been very successful in pattern recognition and function estimation problems for crisp data. This paper proposes a new method to evaluate hybrid fuzzy linear and nonlinear regression models with crisp inputs and fuzzy output using weighted fuzzy arithmetic(WFA) and LS-SVM. LS-SVM allows us to perform fuzzy nonlinear regression analysis by constructing a fuzzy linear regression function in a high dimensional feature space. The proposed method is not computationally expensive since its solution is obtained from a simple linear equation system. In particular, this method is a very attractive approach to modeling nonlinear data, and is nonparametric method in the sense that we do not have to assume the underlying model function for fuzzy nonlinear regression model with crisp inputs and fuzzy output. Experimental results are then presented which indicate the performance of this method.

Software Reliability Assessment with Fuzzy Least Squares Support Vector Machine Regression

  • Hwang, Chang-Ha;Hong, Dug-Hun;Kim, Jang-Han
    • 한국지능시스템학회논문지
    • /
    • 제13권4호
    • /
    • pp.486-490
    • /
    • 2003
  • Software qualify models can predict the risk of faults in the software early enough for cost-effective prevention of problems. This paper introduces a least squares support vector machine (LS-SVM) as a fuzzy regression method for predicting fault ranges in the software under development. This LS-SVM deals with the fuzzy data with crisp inputs and fuzzy output. Predicting the exact number of bugs in software is often not necessary. This LS-SVM can predict the interval that the number of faults of the program at each session falls into with a certain possibility. A case study on software reliability problem is used to illustrate the usefulness of this LS -SVM.

Kernel Adatron Algorithm for Supprot Vector Regression

  • Kyungha Seok;Changha Hwang
    • Communications for Statistical Applications and Methods
    • /
    • 제6권3호
    • /
    • pp.843-848
    • /
    • 1999
  • Support vector machine(SVM) is a new and very promising classification and regression technique developed by Bapnik and his group at AT&T Bell laboratories. However it has failed to establish itself as common machine learning tool. This is partly due to the fact that SVM is not easy to implement and its standard implementation requires the optimization package for quadratic programming. In this paper we present simple iterative Kernl Adatron algorithm for nonparametric regression which is easy to implement and guaranteed to converge to the optimal solution and compare it with neural networks and projection pursuit regression.

  • PDF

의사결정나무 기반 회귀분석과 SVM 회귀분석을 이용한 커터 관입깊이에 따른 최적 커터간격 비 연구 (A study on the optimum cutter spacing ratio according to penetration depth using decision tree-based and SVM regressions)

  • 이기준;류희환;권태혁
    • 한국터널지하공간학회 논문집
    • /
    • 제22권5호
    • /
    • pp.501-513
    • /
    • 2020
  • TBM 터널굴착에서 실질적으로 지반을 굴착하는 역할을 하는 부분인 커터헤드 설계 시, 커터 관입깊이와 커터 간격을 달리하여 커터절삭 시험 시 최소 비에너지에서의 커터간격을 반영하고 있으나, 암반 조건에 따라서 동일한 커터 관입깊이에서의 최적 커터간격이 달라지기 때문에 최적 커터간격을 설정하는 연구가 활발히 진행되어야 한다. 이러한 비선형적인 커터 관입깊이와 커터 간격의 관계에서 커터 관입깊이에 따른 최적 커터간격을 예측하기 위해 머신러닝 기법인 의사결정나무 기반 랜덤 포레스트 회귀 모델과 SVM 회귀모델을 이용하여 커터 관입깊이에 따른 최적 커터 간격을 예측하였다. 랜덤 포레스트 분석기법은 SVM 분석기법보다 데이터 개수에 더 큰 영향을 받기 때문에 커터 관입깊이에 따른 최적 커터간격비의 예측에 SVM이 더 정확한 예측을 하였다. 데이터가 많이 축적되면 SVM 회귀모델이 보다 더 정확한 예측값으로 커터헤드 설계 시 커터간격을 설정하는데 효율적으로 사용될 수 있을 것으로 판단된다.

On Approximate Prediction Intervals for Support Vector Machine Regression

  • 황창하;석경하;조대현
    • Journal of the Korean Data and Information Science Society
    • /
    • 제13권2호
    • /
    • pp.65-75
    • /
    • 2002
  • The support vector machine (SVM), first developed by Vapnik and his group at AT &T Bell Laboratories, is being used as a new technique for regression and classification problems. In this paper we present an approach to estimating approximate prediction intervals for SVM regression based on posterior predictive densities. Furthermore, the method is illustrated with a data example.

  • PDF

Least-Squares Support Vector Machine for Regression Model with Crisp Inputs-Gaussian Fuzzy Output

  • Hwang, Chang-Ha
    • Journal of the Korean Data and Information Science Society
    • /
    • 제15권2호
    • /
    • pp.507-513
    • /
    • 2004
  • Least-squares support vector machine (LS-SVM) has been very successful in pattern recognition and function estimation problems for crisp data. In this paper, we propose LS-SVM approach to evaluating fuzzy regression model with multiple crisp inputs and a Gaussian fuzzy output. The proposed algorithm here is model-free method in the sense that we do not need assume the underlying model function. Experimental result is then presented which indicate the performance of this algorithm.

  • PDF