A Method to Improve the Performance of Adaboost Algorithm by Using Mixed Weak Classifier

혼합 약한 분류기를 이용한 AdaBoost 알고리즘의 성능 개선 방법

  • 김정현 (부산대학교 기계공학부) ;
  • 등죽 (부산대학교 기계공학부) ;
  • 김진영 (동명대학교 메카트로닉스공학과) ;
  • 강동중 (부산대학교 기계공학부)
  • Published : 2009.05.01


The weak classifier of AdaBoost algorithm is a central classification element that uses a single criterion separating positive and negative learning candidates. Finding the best criterion to separate two feature distributions influences learning capacity of the algorithm. A common way to classify the distributions is to use the mean value of the features. However, positive and negative distributions of Haar-like feature as an image descriptor are hard to classify by a single threshold. The poor classification ability of the single threshold also increases the number of boosting operations, and finally results in a poor classifier. This paper proposes a weak classifier that uses multiple criterions by adding a probabilistic criterion of the positive candidate distribution with the conventional mean classifier: the positive distribution has low variation and the values are closer to the mean while the negative distribution has large variation and values are widely spread. The difference in the variance for the positive and negative distributions is used as an additional criterion. In the learning procedure, we use a new classifier that provides a better classifier between them by selective switching between the mean and standard deviation. We call this new type of combined classifier the "Mixed Weak Classifier". The proposed weak classifier is more robust than the mean classifier alone and decreases the number of boosting operations to be converged.



  1. M. Jones and P. Viola, 'Fast multi-view face detection,'Technical Report TR2003-96, MERL, June 2003
  2. H. Zhang, W. Jia, X. He, and Q. Wu, 'Learning-based license plate detection using global and local features,' In: ICPR Proceedings of International onference on Pattern Recognition, pp. 1102-1105, 2006
  3. P. Viola, M. J. Jones, and D. Snow, 'Detecting pedestrians using patterns of motion and appearance,' The 9th ICCV, Nice, France, volume1, pp. 734-741, 2003
  4. P. Viola and M. Jones, 'Rapid object detection using a boosted cascade of simple features,' In Proceedings, IEEE Coriference on Computer Vision and Pattern Recognition, 2001
  5. Y. Freund and R E. Schapire, 'A short introduction to boosting,' J of Japanese Society for Artificial Intelligence, vol. 14, no. 5, pp. 771-780, 1999
  6. R Frank, 'The perceptron: A probabilistic model for information storage and organization in the brain,' Psychological Review(Cornell Aeronautical Laboratory), vol. 65, no. 6, pp. 386-408, 1958
  7. R E. Schapire, Y. Freund, P. Bartlett, and W. S. Lee, 'Boosting the margin: a new explanation for the effectiveness of voting methods,' Proc. of the 14th Int. Conference on Machine Learning, 1997
  8. J.-H. Kim, B.-G. Kwon, J.-Y. Kim, and D.-J. Kang, 'Method to improve the performance of the AdaBoost algorithm by combining weak classifiers,' CBMI 2008, international workshop, pp. 357-364, 2007