International Journal of Quality Innovation

Korean Society for Quality Management (한국품질경영학회)
권호 표지

Neural and MTS Algorithms for Feature Selection

  • Su, Chao-Ton (Department of Industrial Engineering and Management National Chiao Tung University) ;
  • Li, Te-Sheng (Department of Industrial Engineering and Management Minghsin Institute of Technology)
  • Published : 2002.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

The relationships among multi-dimensional data (such as medical examination data) with ambiguity and variation are difficult to explore. The traditional approach to building a data classification system requires the formulation of rules by which the input data can be analyzed. The formulation of such rules is very difficult with large sets of input data. This paper first describes two classification approaches using back-propagation (BP) neural network and Mahalanobis distance (MD) classifier, and then proposes two classification approaches for multi-dimensional feature selection. The first one proposed is a feature selection procedure from the trained back-propagation (BP) neural network. The basic idea of this procedure is to compare the multiplication weights between input and hidden layer and hidden and output layer. In order to simplify the structure, only the multiplication weights of large absolute values are used. The second approach is Mahalanobis-Taguchi system (MTS) originally suggested by Dr. Taguchi. The MTS performs Taguchi's fractional factorial design based on the Mahalanobis distance as a performance metric. We combine the automatic thresholding with MD: it can deal with a reduced model, which is the focus of this paper In this work, two case studies will be used as examples to compare and discuss the complete and reduced models employing BP neural network and MD classifier. The implementation results show that proposed approaches are effective and powerful for the classification.

Keywords

References

  1. Andrews, R. and Diederich, J., 1996.Rules and Networks. Proceedings of Rule Extraction Trained Artificial Neural Networks Workshop, AISB
  2. Andrews, R., Diederich, J. and Tickle, A B., 1995. Survey and critque of techniques for extracting rules from trained artificial neural networks. Knowledge-Based System 8, 373-389 https://doi.org/10.1016/0950-7051(96)81920-4
  3. Antony, J., 2000. Multi response optimization in industrial experiments using Taguchi's quality loss function and principal component analysis. Quality Reliability Engineering. International 16, 3-8 https://doi.org/10.1002/(SICI)1099-1638(200001/02)16:1<3::AID-QRE276>3.0.CO;2-W
  4. Brown, C. W. and Lo, S. C., 1998.Chemical information based on neural network processing of Near IR Spectra.Analytic Chemistry 70, 2983-2990 https://doi.org/10.1021/ac980078m
  5. Giacinto, G., Roli, F. and Bruzzone, L., 2000. Combination of neural and statistical algorithms for supervised classification of remote-sensing images. Pattern recognition letters 21, 385-397 https://doi.org/10.1016/S0167-8655(00)00006-4
  6. Guo, R. and Pandit, S. M., 1998.Automatic threshold selection based on histogram lodes and a discriminant criterion. Machine vision and applications 10, 331-338 https://doi.org/10.1007/s001380050083
  7. Kato, N., Suzuki, M., Omachi, S., Aso, H. and Nemoto, Y., 1999. A handwritten character recognition system using directional element feature and asymmetric Mahalanobis distance. IEEE Transaction on Pattem Analysis and Machine Intelligence. 21, 258-263 https://doi.org/10.1109/34.754617
  8. Kwak, N. K. and Lee, C., 1997. A neural network application to classification of health status of HIV/AIDS patients.Journal of Medical System 21. 87-97 https://doi.org/10.1023/A:1022890223449
  9. Otsu, N., 1979. A threshold selection method from gray level histograms. IEEE Transaction on Systems Man and Cybernetics. SMC 9, 62-66
  10. Pfurtscheller, G., Kalcher, J. and Nerper, C., 1996. Online EEG classification during externally paced hand movements using a neural network-based classifier. Electroncephalogr. Clinical Neruophsiology 99, 416-425 https://doi.org/10.1016/S0013-4694(96)95689-8
  11. Sarle, W. S., 2000. How to measure importance of inputs?. SAS Institute Inc., Cary, NC, USA. ftp://ftp.sas.com./put/neural/importance.html.
  12. Sette, S., Boullart, L., Langenhove, L. V. and Kiekens, P., 1997. Optimizing the fiber-to-yarn production process with a combined neural network/genetic algorithm approach. Textile Research Journal 67, 84-92
  13. Shah, N. K. and Gemperline, P. J., 1990. Combination of the Mahalanobis distance and residual variance pattern recognition techniques for classification of Near-Infrared reflectance spectra. Analytic Chemistry 62, 465-470 https://doi.org/10.1021/ac00204a009
  14. Sutter, J. M. and Jurs, P. C., 1997 Neural network classification and quantification of organic vapors based on fluorescence data from a fiber optic sensor array. Analytic Chemistry 69, 856-862 https://doi.org/10.1021/ac960982j
  15. Taguchi, Genichi, 1998. Mathematics for Quality Engineering. Journal of Quality Engineering Forum 6, 5-10
  16. Tsukimoto, H., 2000. Extraction Rules from Trained Neural Networks. IEEE Transactions on Neural Networks 11, 377-389 https://doi.org/10.1109/72.839008
  17. Younis, K. S., Rogers, T. K. and DeSimio, M. P., 1996. Vector quantization based on dynamic adjustment of Mahalanobis distance. Aerospace and Electronics Conference Proceedings of IEEE of 1996 1.2, 858-862