Communications for Statistical Applications and Methods

The Korean Statistical Society (한국통계학회)
권호 표지
DOI QR코드

DOI QR Code

A model-free soft classification with a functional predictor

  • Received : 2019.08.26
  • Accepted : 2019.10.07
  • Published : 2019.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

Class probability is a fundamental target in classification that contains complete classification information. In this article, we propose a class probability estimation method when the predictor is functional. Motivated by Wang et al. (Biometrika, 95, 149-167, 2007), our estimator is obtained by training a sequence of functional weighted support vector machines (FWSVM) with different weights, which can be justified by the Fisher consistency of the hinge loss. The proposed method can be extended to multiclass classification via pairwise coupling proposed by Wu et al. (Journal of Machine Learning Research, 5, 975-1005, 2004). The use of FWSVM makes our method model-free as well as computationally efficient due to the piecewise linearity of the FWSVM solutions as functions of the weight. Numerical investigation to both synthetic and real data show the advantageous performance of the proposed method.

Keywords

References

  1. James GM (2002). Generalized linear models with functional predictors, Journal of the Royal Statistical Society: Series B (Statistical Methodology), 64, 411-432. https://doi.org/10.1111/1467-9868.00342
  2. Kimeldorf G and Wahba G (1971). Some results on Tchebycheffian spline functions, Journal of Mathematical Analysis and Applications, 33, 82-95. https://doi.org/10.1016/0022-247X(71)90184-3
  3. Park C, Koo JY, Kim S, Sohn I, and Lee JW (2008). Classification of gene functions using support vector machine for time-course gene expression data, Computational Statistics & Data Analysis, 52, 2578-2587. https://doi.org/10.1016/j.csda.2007.09.002
  4. Rossi F and Villa N (2006). Support vector machine for functional data classification, Neurocomputing, 69, 730-742. https://doi.org/10.1016/j.neucom.2005.12.010
  5. Shin SJ, Wu Y, and Zhang HH (2014). Two-dimensional solution surface for weighted support vector machines, Journal of Computational and Graphical Statistics, 23, 383-402. https://doi.org/10.1080/10618600.2012.761139
  6. Vapnik VN (1995). The Nature of Statistical Learning Theory, Springer-Verlag, Berlin, Heidelberg.
  7. Wahba G (1990). Spline Models for Observational Data, Society for Industrial and Applied Mathematics, Philadelphia.
  8. Wahba G (2002). Soft and hard classification by reproducing kernel Hilbert space methods, Proceedings of the National Academy of Sciences, 99, 16524-16530. https://doi.org/10.1073/pnas.242574899
  9. Wang J, Shen X, and Liu Y (2007). Probability estimation for large-margin classifiers, Biometrika, 95, 149-167. https://doi.org/10.1093/biomet/asm077
  10. Wu TF, Lin CJ, and Weng RC (2004). Probability estimates for multi-class classification by pairwise coupling, Journal of Machine Learning Research, 5, 975-1005.