• 제목/요약/키워드: Linear Regression Algorithm

검색결과 282건 처리시간 0.024초

퍼지 최소 자승 선형회귀분석 알고리즘을 이용한 특수일 전력수요예측 (Load Forecasting for Holidays Using a Fuzzy Least Squares Linear Regression Algorithm)

  • 송경빈;구본석;백영식
    • 대한전기학회논문지:시스템및제어부문D
    • /
    • 제52권4호
    • /
    • pp.233-237
    • /
    • 2003
  • An accurate load forecasting is essential for economics and stability power system operation. Due to high relationship between the electric power load and the electric power price, the participants of the competitive power market are very interested in load forecasting. The percentage errors of load forecasting for holidays is relatively large. In order to improve the accuarcy of load forecasting for holidays, this paper proposed load forecasting method for holidays using a fuzzy least squares linear regression algorithm. The proposed algorithm is tested for load forecasting for holidays in 1996, 1997, and 2000. The test results show that the proposed algorithm is better than the algorithm using fuzzy linear regression.

Constrained $L_1$-Estimation in Linear Regression

  • Kim, Bu-Yong
    • Communications for Statistical Applications and Methods
    • /
    • 제5권3호
    • /
    • pp.581-589
    • /
    • 1998
  • An algorithm is proposed for the $L_1$-estimation with linear equality and inequality constraints in linear regression model. The algorithm employs a linear scaling transformation to obtain the optimal solution of linear programming type problem. And a special scheme is used to maintain the feasibility of the updated solution at each iteration. The convergence of the proposed algorithm is proved. In addition, the updating and orthogonal decomposition techniques are employed to improve the computational efficiency and numerical stability.

  • PDF

선형 회귀 분석법을 이용한 머신 러닝 기반의 SOH 추정 알고리즘 (Machine Learning-based SOH Estimation Algorithm Using a Linear Regression Analysis)

  • 강승현;노태원;이병국
    • 전력전자학회논문지
    • /
    • 제26권4호
    • /
    • pp.241-248
    • /
    • 2021
  • A battery state-of-health (SOH) estimation algorithm using a machine learning-based linear regression method is proposed for estimating battery aging. The proposed algorithm analyzes the change trend of the open-circuit voltage (OCV) curve, which is a parameter related to SOH. At this time, a section with high linearity of the SOH and OCV curves is selected and used for SOH estimation. The SOH of the aged battery is estimated according to the selected interval using a machine learning-based linear regression method. The performance of the proposed battery SOH estimation algorithm is verified through experiments and simulations using battery packs for electric vehicles.

음성인식을 위한 변환 공간 모델에 근거한 순차 적응기법 (Sequential Adaptation Algorithm Based on Transformation Space Model for Speech Recognition)

  • 김동국;장준혁;김남수
    • 음성과학
    • /
    • 제11권4호
    • /
    • pp.75-88
    • /
    • 2004
  • In this paper, we propose a new approach to sequential linear regression adaptation of continuous density hidden Markov models (CDHMMs) based on transformation space model (TSM). The proposed TSM which characterizes the a priori knowledge of the training speakers associated with maximum likelihood linear regression (MLLR) matrix parameters is effectively described in terms of the latent variable models. The TSM provides various sources of information such as the correlation information, the prior distribution, and the prior knowledge of the regression parameters that are very useful for rapid adaptation. The quasi-Bayes (QB) estimation algorithm is formulated to incrementally update the hyperparameters of the TSM and regression matrices simultaneously. Experimental results showed that the proposed TSM approach is better than that of the conventional quasi-Bayes linear regression (QBLR) algorithm for a small amount of adaptation data.

  • PDF

Algorithm for the Constrained Chebyshev Estimation in Linear Regression

  • Kim, Bu-yong
    • Communications for Statistical Applications and Methods
    • /
    • 제7권1호
    • /
    • pp.47-54
    • /
    • 2000
  • This article is concerned with the algorithm for the Chebyshev estimation with/without linear equality and/or inequality constraints. The algorithm employs a linear scaling transformation scheme to reduce the computational burden which is induced when the data set is quite large. The convergence of the proposed algorithm is proved. And the updating and orthogonal decomposition techniques are considered to improve the computational efficiency and numerical stability.

  • PDF

Ensemble variable selection using genetic algorithm

  • Seogyoung, Lee;Martin Seunghwan, Yang;Jongkyeong, Kang;Seung Jun, Shin
    • Communications for Statistical Applications and Methods
    • /
    • 제29권6호
    • /
    • pp.629-640
    • /
    • 2022
  • Variable selection is one of the most crucial tasks in supervised learning, such as regression and classification. The best subset selection is straightforward and optimal but not practically applicable unless the number of predictors is small. In this article, we propose directly solving the best subset selection via the genetic algorithm (GA), a popular stochastic optimization algorithm based on the principle of Darwinian evolution. To further improve the variable selection performance, we propose to run multiple GA to solve the best subset selection and then synthesize the results, which we call ensemble GA (EGA). The EGA significantly improves variable selection performance. In addition, the proposed method is essentially the best subset selection and hence applicable to a variety of models with different selection criteria. We compare the proposed EGA to existing variable selection methods under various models, including linear regression, Poisson regression, and Cox regression for survival data. Both simulation and real data analysis demonstrate the promising performance of the proposed method.

다중선형회귀모형에서의 변수선택기법 평가 (Evaluating Variable Selection Techniques for Multivariate Linear Regression)

  • 류나현;김형석;강필성
    • 대한산업공학회지
    • /
    • 제42권5호
    • /
    • pp.314-326
    • /
    • 2016
  • The purpose of variable selection techniques is to select a subset of relevant variables for a particular learning algorithm in order to improve the accuracy of prediction model and improve the efficiency of the model. We conduct an empirical analysis to evaluate and compare seven well-known variable selection techniques for multiple linear regression model, which is one of the most commonly used regression model in practice. The variable selection techniques we apply are forward selection, backward elimination, stepwise selection, genetic algorithm (GA), ridge regression, lasso (Least Absolute Shrinkage and Selection Operator) and elastic net. Based on the experiment with 49 regression data sets, it is found that GA resulted in the lowest error rates while lasso most significantly reduces the number of variables. In terms of computational efficiency, forward/backward elimination and lasso requires less time than the other techniques.

단기수요예측 알고리즘 (An Algorithm of Short-Term Load Forecasting)

  • 송경빈;하성관
    • 대한전기학회논문지:전력기술부문A
    • /
    • 제53권10호
    • /
    • pp.529-535
    • /
    • 2004
  • Load forecasting is essential in the electricity market for the participants to manage the market efficiently and stably. A wide variety of techniques/algorithms for load forecasting has been reported in many literatures. These techniques are as follows: multiple linear regression, stochastic time series, general exponential smoothing, state space and Kalman filter, knowledge-based expert system approach (fuzzy method and artificial neural network). These techniques have improved the accuracy of the load forecasting. In recent 10 years, many researchers have focused on artificial neural network and fuzzy method for the load forecasting. In this paper, we propose an algorithm of a hybrid load forecasting method using fuzzy linear regression and general exponential smoothing and considering the sensitivities of the temperature. In order to consider the lower load of weekends and Monday than weekdays, fuzzy linear regression method is proposed. The temperature sensitivity is used to improve the accuracy of the load forecasting through the relation of the daily load and temperature. And the normal load of weekdays is easily forecasted by general exponential smoothing method. Test results show that the proposed algorithm improves the accuracy of the load forecasting in 1996.

Optimized Neural Network Weights and Biases Using Particle Swarm Optimization Algorithm for Prediction Applications

  • Ahmadzadeh, Ezat;Lee, Jieun;Moon, Inkyu
    • 한국멀티미디어학회논문지
    • /
    • 제20권8호
    • /
    • pp.1406-1420
    • /
    • 2017
  • Artificial neural networks (ANNs) play an important role in the fields of function approximation, prediction, and classification. ANN performance is critically dependent on the input parameters, including the number of neurons in each layer, and the optimal values of weights and biases assigned to each neuron. In this study, we apply the particle swarm optimization method, a popular optimization algorithm for determining the optimal values of weights and biases for every neuron in different layers of the ANN. Several regression models, including general linear regression, Fourier regression, smoothing spline, and polynomial regression, are conducted to evaluate the proposed method's prediction power compared to multiple linear regression (MLR) methods. In addition, residual analysis is conducted to evaluate the optimized ANN accuracy for both training and test datasets. The experimental results demonstrate that the proposed method can effectively determine optimal values for neuron weights and biases, and high accuracy results are obtained for prediction applications. Evaluations of the proposed method reveal that it can be used for prediction and estimation purposes, with a high accuracy ratio, and the designed model provides a reliable technique for optimization. The simulation results show that the optimized ANN exhibits superior performance to MLR for prediction purposes.

Support Vector Machine for Interval Regression

  • Hong Dug Hun;Hwang Changha
    • 한국통계학회:학술대회논문집
    • /
    • 한국통계학회 2004년도 학술발표논문집
    • /
    • pp.67-72
    • /
    • 2004
  • Support vector machine (SVM) has been very successful in pattern recognition and function estimation problems for crisp data. This paper proposes a new method to evaluate interval linear and nonlinear regression models combining the possibility and necessity estimation formulation with the principle of SVM. For data sets with crisp inputs and interval outputs, the possibility and necessity models have been recently utilized, which are based on quadratic programming approach giving more diverse spread coefficients than a linear programming one. SVM also uses quadratic programming approach whose another advantage in interval regression analysis is to be able to integrate both the property of central tendency in least squares and the possibilistic property In fuzzy regression. However this is not a computationally expensive way. SVM allows us to perform interval nonlinear regression analysis by constructing an interval linear regression function in a high dimensional feature space. In particular, SVM is a very attractive approach to model nonlinear interval data. The proposed algorithm here is model-free method in the sense that we do not have to assume the underlying model function for interval nonlinear regression model with crisp inputs and interval output. Experimental results are then presented which indicate the performance of this algorithm.

  • PDF