e-SVR using IRWLS Procedure

  • Shim, Joo-Yong (Department of Applied Statistics, Catholic University of Daegu)
  • Published : 2005.11.30

Abstract

e-insensitive support vector regression(e-SVR) is capable of providing more complete description of the linear and nonlinear relationships among random variables. In this paper we propose an iterative reweighted least squares(IRWLS) procedure to solve the quadratic problem of e-SVR with a modified loss function. Furthermore, we introduce the generalized approximate cross validation function to select the hyperparameters which affect the performance of e-SVR. Experimental results are then presented which illustrate the performance of the IRWLS procedure for e-SVR.

Keywords

References

  1. Journal of Mathematical Analysis and its Applications no.33 Some Results on Tchebycheffian Spline Functions Kimeldorf, G.S.;Wahba, G.
  2. IEEE Transactions on Neural Networks v.14 no.3 Linear dependency between epsilon and the input noise in epsilon-support vector regression Kwok, J.T.;Tsang, I.W.
  3. Philosophical Transactions of Royal Society, A Functions of Positive and Negative Type and Their Connection with Theory of Integral Equations Mercer, J.
  4. Journal of American Statistical Association v.432 A Nonparametric Approach Syringe Grading for Quality Improvement Nychka, D.;Gray, G.;Haaland, P.;Martin, D.;O'Connell, M.
  5. Proceedings of European Association for Signal Processing An IRWLSprocedure for SVR Perez-Cruz, F.;Navia-Vazquez, A.;Alarcon-Diana, P.L.;Artes-Rodriguez, A.
  6. Sequential Minimal Optimization: A Fast Algorithm for Training Support Vector Machines. Microsoft Research Technical Report MSR-TR-98-14 Platt, J.
  7. Algorithmica v.22 On a Kernel-Based Method for Pattern Recognition, Regression Approximation and Operator Inversion Smola, A.;Scholkopf, B.
  8. The Nature of Statistical Learning Theory Vapnik, V.N.
  9. Statistical Learning Theory Vapnik, V.N.
  10. Support Vector Machines: Theory and Application Wang, L.(ed.)