Journal of Information Processing Systems

  • 제16권2호
  • /
  • Pages.360-376
  • /
  • 2020
  • /
  • 1976-913X(pISSN)
  • /
  • 2092-805X(eISSN)
한국정보처리학회 (Korea Information Processing Society)
권호 표지
DOI QR코드

DOI QR Code

Ensemble of Classifiers Constructed on Class-Oriented Attribute Reduction

  • Li, Min (School of Information Engineering, Nanchang Institute of Technology) ;
  • Deng, Shaobo (School of Information Engineering, Nanchang Institute of Technology) ;
  • Wang, Lei (School of Information Engineering, Nanchang Institute of Technology)
  • 투고 : 2018.05.21
  • 심사 : 2018.08.26
  • 발행 : 2020.04.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

Many heuristic attribute reduction algorithms have been proposed to find a single reduct that functions as the entire set of original attributes without loss of classification capability; however, the proposed reducts are not always perfect for these multiclass datasets. In this study, based on a probabilistic rough set model, we propose the class-oriented attribute reduction (COAR) algorithm, which separately finds a reduct for each target class. Thus, there is a strong dependence between a reduct and its target class. Consequently, we propose a type of ensemble constructed on a group of classifiers based on class-oriented reducts with a customized weighted majority voting strategy. We evaluated the performance of our proposed algorithm based on five real multiclass datasets. Experimental results confirm the superiority of the proposed method in terms of four general evaluation metrics.

키워드

참고문헌

  1. Z. Pawlak, "Rough sets," International Journal of Computer & Information Sciences, vol. 11, no. 5, pp. 341-356, 1982. https://doi.org/10.1007/BF01001956
  2. R. Jensen and Q. Shen, "New approaches to fuzzy-rough feature selection," IEEE Transactions on fuzzy Systems, vol. 17, no. 4, pp. 824-838, 2009. https://doi.org/10.1109/TFUZZ.2008.924209
  3. Z. Pawlak, Rough Sets: Theoretical Aspects of Reasoning about Data. Dordrecht: Kluwer Academic Publishers, 1991
  4. M. Kryszkiewicz, "Certain, generalized decision, and membership distribution reducts versus functional dependencies in incomplete systems," in Rough Sets and Intelligent Systems Paradigms. Heidelberg: Springer, 2007, pp. 162-174.
  5. M. Li, S. Deng, S. Feng, and J. Fan, "Fast assignment reduction in inconsistent incomplete decision systems," Journal of Systems Engineering and Electronics, vo. 25, no. 1, pp. 83-94, 2014. https://doi.org/10.1109/JSEE.2014.00010
  6. W. X. Zhang, J. S. Mi, and W. Z. Wu, "Approaches to knowledge reductions in inconsistent systems," International Journal of Intelligent Systems, vol. 18, no. 9, pp. 989-1000, 2003. https://doi.org/10.1002/int.10128
  7. M. Li, C. Shang, S. Feng, and J. Fan, "Quick attribute reduction in inconsistent decision tables," Information Sciences, vol. 254, pp. 155-180, 2014. https://doi.org/10.1016/j.ins.2013.08.038
  8. M. Inuiguchi, Y. Yoshioka, and Y. Kusunoki, "Variable-precision dominance-based rough set approach and attribute reduction," International Journal of Approximate Reasoning, vol. 50, no. 8, pp. 1199-1214, 2009. https://doi.org/10.1016/j.ijar.2009.02.003
  9. J. Y. Wang and J. Zhou, "Research of reduct features in the variable precision rough set model," Neurocomputing, vol. 72, no. 10-12, pp. 2643-2648, 2009. https://doi.org/10.1016/j.neucom.2008.09.015
  10. R. R. Yager, J. Kacprzyk, and M. Fedrizzi, Advances in the Dempster-Shafer Theory of Evidence. New York, NY: John Wiley & Sons Inc., 1994.
  11. D. Ye and Z. Chen, "A new type of attribute reduction for inconsistent decision tables and its computation," International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, vol. 18, no. 2, pp. 209-222, 2010. https://doi.org/10.1142/S0218488510006490
  12. X. Jia, W. Liao, Z. Tang, and L. Shang, "Minimum cost attribute reduction in decision-theoretic rough set models," Information Sciences, vol. 219, pp. 151-167, 2013. https://doi.org/10.1016/j.ins.2012.07.010
  13. J. Li, H. Zhao, and W. Zhu, "Fast randomized algorithm with restart strategy for minimal test cost feature selection," International Journal of Machine Learning and Cybernetics, vol. 6, no. 3, pp. 435-442, 2015. https://doi.org/10.1007/s13042-014-0262-0
  14. Q. Hu, Z. Xie, and D. Yu, "Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation," Pattern Recognition, vol. 40, no. 12, pp. 3509-3521, 2007. https://doi.org/10.1016/j.patcog.2007.03.017
  15. D. Q. Miao and G. R. Hu, "A heuristic algorithm for reduction of knowledge," Journal of Computer Research and Development, vol. 36, no. 6, pp. 681-684, 1999.
  16. G. Y. Wang, H. Yu, and D. C. Yang, "Decision table reduction based on conditional information entropy," Chinese Journal of Computers, vol. 25, no. 7, pp. 759-766, 2002. https://doi.org/10.3321/j.issn:0254-4164.2002.07.013
  17. Z. H. Zhou, Ensemble Methods: Foundations and Algorithms. Boca Raton, FL: Taylor & Francis, 2012.
  18. L. L. Minku, A. P. White, and X. Yao, "The impact of diversity on online ensemble learning in the presence of concept drift," IEEE Transactions on Knowledge and Data Engineering, vol. 22, no. 5, pp. 730-742, 2010. https://doi.org/10.1109/TKDE.2009.156
  19. R. Jensen and Q. Shen, "Fuzzy-rough attribute reduction with application to web categorization," Fuzzy Sets and Systems, vol. 141, no. 3, pp. 469-485, 2004. https://doi.org/10.1016/S0165-0114(03)00021-6
  20. Y. Qian, J. Liang, W. Pedrycz, and C. Dang, "Positive approximation: an accelerator for attribute reduction in rough set theory," Artificial Intelligence, vol. 174, no. 9-10, pp. 597-618, 2010. https://doi.org/10.1016/j.artint.2010.04.018
  21. M. Li, S. Deng, L. Wang, S. Feng, and J. Fan, "Hierarchical clustering algorithm for categorical data using a probabilistic rough set model," Knowledge-Based Systems, vol. 65, pp. 60-71, 2014. https://doi.org/10.1016/j.knosys.2014.04.008
  22. J. Ross Quinlan, C4.5: Programs for Machine Learning. San Mateo, CA: Morgan Kaufmann Publishers, 2014.
  23. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, UK: Cambridge University Press, 2000.
  24. V. Garcia, J. S. Sanchez, and R. A. Mollineda, "On the effectiveness of preprocessing methods when dealing with different levels of class imbalance," Knowledge-Based Systems, vol. 25, no. 1, pp. 13-21, 2012. https://doi.org/10.1016/j.knosys.2011.06.013