Information Theoretic Learning with Maximizing Tsallis Entropy

  • Aruga, Nobuhide (Department of Information and Computer Sciences, Faculty of Engineering Saitama University) ;
  • Tanaka, Masaru (Department of Information and Computer Sciences, Faculty of Engineering Saitama University)
  • Published : 2002.07.01

Abstract

We present the information theoretic learning based on the Tsallis entropy maximization principle for various q. The Tsallis entropy is one of the generalized entropies and is a canonical entropy in the sense of physics. Further, we consider the dependency of the learning on the parameter $\sigma$, which is a standard deviation of an assumed a priori distribution of samples such as Parzen window.

Keywords