The Journal of the Korea Contents Association (한국콘텐츠학회논문지)

The Korea Contents Association (한국콘텐츠학회)
권호 표지
DOI QR코드

DOI QR Code

Ant Colony Optimization for Feature Selection in Pattern Recognition

패턴 인식에서 특징 선택을 위한 개미 군락 최적화

  • 오일석 (전북대학교 컴퓨터공학부/영상정보신기술연구소) ;
  • 이진선 (우석대학교 게임콘텐츠학과)
  • Received : 2010.01.19
  • Accepted : 2010.04.02
  • Published : 2010.05.28
Download PDF
⟨ Previous Next ⟩

Abstract

This paper propose a novel scheme called selective evaluation to improve convergence of ACO (ant colony optimization) for feature selection. The scheme cutdown the computational load by excluding the evaluation of unnecessary or less promising candidate solutions. The scheme is realizable in ACO due to the valuable information, pheromone trail which helps identify those solutions. With the aim of checking applicability of algorithms according to problem size, we analyze the timing requirements of three popular feature selection algorithms, greedy algorithm, genetic algorithm, and ant colony optimization. For a rigorous timing analysis, we adopt the concept of atomic operation. Experimental results showed that the ACO with selective evaluation was promising both in timing requirement and recognition performance.

이 논문은 특징 선택에 사용되는 개미 군락 최적화의 수렴 특성을 개선하기 위해 선택적 평가라는 새로운 기법을 제시한다. 이 방법은 불필요하거나 가능성이 덜한 후보 해를 배제함으로써 계산량을 줄인다. 이 방법은, 그런 해를 찾아내는데 사용할 수 있는 페로몬 정보 때문에 구현이 가능하다. 문제 크기에 따른 알고리즘의 적용가능성을 판단할 목적으로, 특징 선택에 사용되는 세 가지 알고리즘인 탐욕 알고리즘, 유전 알고리즘, 그리고 개미 군락 최적화의 계산 시간을 분석한다. 엄밀한 분석을 위해 원자 연산이라는 개념을 사용한다. 실험 결과는 선택적 평가를 채택한 개미 군락 최적화가 계산 시간과 인식 성능 모두에서 우수함을 보여준다.

Keywords

References

  1. O. D. Trier, A. K. Jain, and T. Taxt, “Feature extraction methods for character recognition-a survey,” Pattern Recognition, Vol.29, No.4, pp.641-662, 1996. https://doi.org/10.1016/0031-3203(95)00118-2
  2. S. Theodoridis and K. Koutroumbas, Pattern Recognition, 3rd ed., Academic Press, 2006.
  3. J. Kittler, "Feature selection and extraction," in Handbook of Pattern Recognition and Image Processing, Academic Press (Edited by T.Y. Young and K.S. Fu), pp.59-83, 1986.
  4. M. Kudo and J. Sklansky, “Comparison of algorithms that select features for pattern recognition,” Pattern Recognition, Vol.33, No.1, pp.25-41, 2000. https://doi.org/10.1016/S0031-3203(99)00041-2
  5. P. M. Murphy and D. W. Aha, UCI repository for machine learning databases, (http://www.ics. uci.edu/~mlearn/databases/), 1994.
  6. Marco Dorigo and Christian Blum, “Ant colony optimization: a survey,” Theoretical Computer Science, Vol.344, pp.243-278, 2005. https://doi.org/10.1016/j.tcs.2005.05.020
  7. Christine Solnon and Derek Bridge, “An ant colony optimization meta-heuristic for subset selection problems,” in System Engineering using Particle Swarm Optimization (Edited by Nadia Nedjah and Luiza Mourelle), Nova Science publisher, pp.7-29, 2006.
  8. M. H. Aghdam, N. Ghasem-Aghaee, and M. E. Basiri, “Text feature selection using ant colony optimization,” Expert Systems with Applications, Vol.36, pp.6843-6853, 2009. https://doi.org/10.1016/j.eswa.2008.08.022
  9. P. Langley, “Selection of relevant features in machine learning,” Proc. of AAAI Fall Symposium on Relevance, pp.1-5, 1994.
  10. Christian Blum and Andrea Roli,“Metaheuristics in combinatorial optimization:overview and conceptual comparison,” ACM Computing Surveys, Vol.35, No.3, pp.268-308, 2003. https://doi.org/10.1145/937503.937505
  11. David E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley, Boston, 1989
  12. I. S. Oh, J. S. Lee, and B. R. Moon, “Hybrid genetic algorithms for feature selection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.26, No.11, pp.1424-1437, 2004. https://doi.org/10.1109/TPAMI.2004.105
  13. C.L. Liu, “Handwritten digit recognition:benchmarking of state-of-the-art techniques,”Pattern Recognition, Vol.36, No.10, pp.2271-2285, 2003. https://doi.org/10.1016/S0031-3203(03)00085-2
  14. I. S. Oh and C. Y. Suen, “Distance features for neural network-based recognition of handwritten characters," International Journal on Document Analysis and Recognition, Vol.1, pp.73-88, 1998. https://doi.org/10.1007/s100320050008

Cited by

  1. Convergence Characteristics of Ant Colony Optimization with Selective Evaluation in Feature Selection vol.11, pp.10, 2011, https://doi.org/10.5392/JKCA.2011.11.10.041