• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2003.05a
• /
• pp.81-84
• /
• 2003

$\varepsilon$-SVR(e-Support Vector Regression)학습방법은 SV(Support Vector)들을 이용하여 함수 근사(Regression)하는 방법으로 최근 주목받고 있는 기법이다. SVM(SV machine)의 한 가지 방법으로, 신경망을 기반으로 한 다른 알고리즘들이 학습과정에서 지역적 최적해로 수렴하는 등의 문제를 한계로 갖는데 반해, 이러한 구조들을 대체할 수 있는 학습방법으로 사용될 수 있다. 일반적인 $\varepsilon$-SVR에서는 학습 데이터와 관사 함수 f사이에 허용 가능한 에러범위 $\varepsilon$값이 학습하기 전에 정해진다. 그러나 Nu-SVR(ν-version SVR)학습방법은 학습의 결과로 최적화 된 $\varepsilon$값을 얻을 수 있다. 정해진 기저함수가 포함되는 $\varepsilon$-SVR 학습방법(Sermparametric SVR)은 정해진 독립 기저함수를 사용하여 함수를 근사하는 방법으로, 일반적인 $\varepsilon$-SVR 학습방범에 비해 우수한 결과를 나타내는 것이 성공적으로 입증된 바 있다. 이에 따라, 본 논문에서는 정해진 기저함수가 포함된 ν-SVR 학습 방법을 제안하고, 이에 대한 수식을 유도하였다. 그리고, 모의 실험을 통하여 제안된 Sermparametric ν-SVR 학습 방법의 적용 가능성을 알아보았다.

• Proceedings of the Korean Information Science Society Conference
• /
• 2002.10d
• /
• pp.265-267
• /
• 2002

인터넷으로부터 필요한 정보를 얻기 위하여 무의미한 탐색을 반복하는 경우가 자주 나타나고 있다. 이러한 Dizzy Web에서 사용자와 관련 있는 정보를 추천해 주는 방법에 대한 연구가 많이 진행되고 있다. 특히 협동 추천시스템에 대한 연구가 활발히 진행되고 있다. 이 시스템의 구현 알고리즘 중에서 기존의 메모리 기반은 수행 시간에 대한 부담이 매우 크며, 모델 기반은 연속성 데이터에 대한 처리가 어렵거나 불가능하다는 문제가 있다. 본 논문에서는 특히 웹 사용자 모델에서 효과적인 연속성 피드백 데이터를 이용한 사용자 모델링 방법을 제안하고 이를 통해 웹 페이지 예측을 수행하는 시스템을 구현하였다. 논문에 사용된 연속성 데이터는 사용자의 웹 페이지 방문시간이고 이 데이터를 분석하기 위해 기존의 모델 기반 알고리즘에 Support Vector Regression 기법을 결합하는 알고리즘을 설계하였다. 실험에서는 제안 모델의 정확성과 예측 능력에 대하여 기존의 Pearson 알고리즘과 비교하였다. 논문에서 제안하는 방법이 매우 적은 시간 비용을 요구하면서도 유의할 수 있는 수준의 결과가 얻을 수 있음이 확인되었다.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.12 no.2
• /
• pp.108-112
• /
• 2012

A sustainable production of electricity is essential for low carbon green growth in South Korea. The generation of wind power as renewable energy has been rapidly growing around the world. Undoubtedly wind energy is unlimited in potential. However, due to its own intermittency and volatility, there are difficulties in the effective harvesting of wind energy and the integration of wind power into the current electric power grid. To cope with this, many works have been done for wind speed and power forecasting. It is reported that, compared with physical persistent models, statistical techniques and computational methods are more useful for short-term forecasting of wind power. Among them, support vector regression (SVR) has much attention in the literature. This paper proposes an SVR based wind speed forecasting. To improve the forecasting accuracy, a fuzzy clustering is adopted in the process of SVR modeling. An illustrative example is also given by using real-world wind farm dataset. According to the experimental results, it is shown that the proposed method provides better forecasts of wind power.

• Communications for Statistical Applications and Methods
• /
• v.17 no.2
• /
• pp.183-191
• /
• 2010

Support vector quantile regression(SVQR) is capable of providing more complete description of the linear and nonlinear relationships among random variables. In this paper we propose an iterative reweighted least squares(IRWLS) procedure to solve the problem of SVQR with a weighted quadratic loss function. Furthermore, we introduce the generalized approximate cross validation function to select the hyperparameters which affect the performance of SVQR. Experimental results are then presented which illustrate the performance of the IRWLS procedure for SVQR.

• Proceedings of the Korean Society for Bioinformatics Conference
• /
• 2005.09a
• /
• pp.51-56
• /
• 2005

There are many sources of systematic variations in cDNA microarray experiments which affect the measured gene expression levels like differences in labeling efficiency between the two fluorescent dyes. Print-tip lowess normalization is used in situations where dye biases can depend on spot overall intensity and/or spatial location within the array. However, print-tip lowess normalization performs poorly in situation where error variability for each gene is heterogeneous over intensity ranges. We proposed the new print-tip normalization methods based on support vector machine regression(SVMR) and support vector machine quantile regression(SVMQR). SVMQR was derived by employing the basic principle of support vector machine (SVM) for the estimation of the linear and nonlinear quantile regressions. We applied our proposed methods to previous cDNA micro array data of apolipoprotein-AI-knockout (apoAI-KO) mice, diet-induced obese mice, and genistein-fed obese mice. From our statistical analysis, we found that the proposed methods perform better than the existing print-tip lowess normalization method.

• Communications for Statistical Applications and Methods
• /
• v.18 no.2
• /
• pp.171-177
• /
• 2011

In order to construct approximation functions for real data, it is necessary to remove the outliers from the measured raw data before constructing the model. Conventionally, visualization and maximum residual error have been used for outlier detection, but they often fail to detect outliers for nonlinear functions with multidimensional input. Although the standard support vector regression based outlier detection methods for nonlinear function with multidimensional input have achieved good performance, they have practical issues in computational cost and parameter adjustments. In this paper we propose a practical approach to outlier detection using support vector regression that reduces computational time and defines outlier threshold suitably. We apply this approach to real data examples for validity.

• Journal of Information Processing Systems
• /
• v.14 no.6
• /
• pp.1385-1397
• /
• 2018

There are many factors that affect the wind speed. In addition, the randomness of wind speed also leads to low prediction accuracy for wind speed. According to this situation, this paper constructs the short-time forecasting model based on the least squares support vector machines (LSSVM) to forecast the wind speed. The basis of the model used in this paper is support vector regression (SVR), which is used to calculate the regression relationships between the historical data and forecasting data of wind speed. In order to improve the forecast precision, historical data is clustered by cluster analysis so that the historical data whose changing trend is similar with the forecasting data can be filtered out. The filtered historical data is used as the training samples for SVR and the parameters would be optimized by particle swarm optimization (PSO). The forecasting model is tested by actual data and the forecast precision is more accurate than the industry standards. The results prove the feasibility and reliability of the model.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.14 no.6
• /
• pp.789-792
• /
• 2004

In various fields as web mining, bioinformatics, statistical data analysis, and so forth, very diversely missing values are found. These values make training data to be sparse. Largely, the missing values are replaced by predicted values using mean and mode. We can used the advanced missing value imputation methods as conditional mean, tree method, and Markov Chain Monte Carlo algorithm. But general imputation models have the property that their predictive accuracy is decreased according to increase the ratio of missing in training data. Moreover the number of available imputations is limited by increasing missing ratio. To settle this problem, we proposed statistical learning theory to preprocess for missing values. Our statistical learning theory is the support vector regression by Vapnik. The proposed method can be applied to sparsely training data. We verified the performance of our model using the data sets from UCI machine learning repository.

• Journal of the Korean Data and Information Science Society
• /
• v.17 no.2
• /
• pp.609-617
• /
• 2006

A new fuzzy c-regression algorithm for switching regression analysis is presented, which combines fuzzy c-means clustering and least squares support vector machine. This algorithm can detect outliers in switching regression models while yielding the simultaneous estimates of the associated parameters together with a fuzzy c-partitions of data. It can be employed for the model-free nonlinear regression which does not assume the underlying form of the regression function. We illustrate the new approach with some numerical examples that show how it can be used to fit switching regression models to almost all types of mixed data.

• Nuclear Engineering and Technology
• /
• v.49 no.7
• /
• pp.1423-1430
• /
• 2017

Detonation cell width is an important parameter in hydrogen explosion assessments. The experimental data on gas detonation are statistically analyzed to establish a universal method to numerically predict detonation cell widths. It is commonly understood that detonation cell width, ${\lambda}$, is highly correlated with the characteristic reaction zone width, ${\delta}$. Classical parametric regression methods were widely applied in earlier research to build an explicit semiempirical correlation for the ratio of ${\lambda}/{\delta}$. The obtained correlations formulate the dependency of the ratio ${\lambda}/{\delta}$ on a dimensionless effective chemical activation energy and a dimensionless temperature of the gas mixture. In this paper, support vector regression (SVR), which is based on nonparametric machine learning, is applied to achieve functions with better fitness to experimental data and more accurate predictions. Furthermore, a third parameter, dimensionless pressure, is considered as an additional independent variable. It is found that three-parameter SVR can significantly improve the performance of the fitting function. Meanwhile, SVR also provides better adaptability and the model functions can be easily renewed when experimental database is updated or new regression parameters are considered.