• Title/Summary/Keyword: SVM classification Algorithm

Search Result 278, Processing Time 0.025 seconds

A Novel Image Classification Method for Content-based Image Retrieval via a Hybrid Genetic Algorithm and Support Vector Machine Approach

  • Seo, Kwang-Kyu
    • Journal of the Semiconductor & Display Technology
    • /
    • v.10 no.3
    • /
    • pp.75-81
    • /
    • 2011
  • This paper presents a novel method for image classification based on a hybrid genetic algorithm (GA) and support vector machine (SVM) approach which can significantly improve the classification performance for content-based image retrieval (CBIR). Though SVM has been widely applied to CBIR, it has some problems such as the kernel parameters setting and feature subset selection of SVM which impact the classification accuracy in the learning process. This study aims at simultaneously optimizing the parameters of SVM and feature subset without degrading the classification accuracy of SVM using GA for CBIR. Using the hybrid GA and SVM model, we can classify more images in the database effectively. Experiments were carried out on a large-size database of images and experiment results show that the classification accuracy of conventional SVM may be improved significantly by using the proposed model. We also found that the proposed model outperformed all the other models such as neural network and typical SVM models.

On the Performance of Cuckoo Search and Bat Algorithms Based Instance Selection Techniques for SVM Speed Optimization with Application to e-Fraud Detection

  • AKINYELU, Andronicus Ayobami;ADEWUMI, Aderemi Oluyinka
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.3
    • /
    • pp.1348-1375
    • /
    • 2018
  • Support Vector Machine (SVM) is a well-known machine learning classification algorithm, which has been widely applied to many data mining problems, with good accuracy. However, SVM classification speed decreases with increase in dataset size. Some applications, like video surveillance and intrusion detection, requires a classifier to be trained very quickly, and on large datasets. Hence, this paper introduces two filter-based instance selection techniques for optimizing SVM training speed. Fast classification is often achieved at the expense of classification accuracy, and some applications, such as phishing and spam email classifiers, are very sensitive to slight drop in classification accuracy. Hence, this paper also introduces two wrapper-based instance selection techniques for improving SVM predictive accuracy and training speed. The wrapper and filter based techniques are inspired by Cuckoo Search Algorithm and Bat Algorithm. The proposed techniques are validated on three popular e-fraud types: credit card fraud, spam email and phishing email. In addition, the proposed techniques are validated on 20 other datasets provided by UCI data repository. Moreover, statistical analysis is performed and experimental results reveals that the filter-based and wrapper-based techniques significantly improved SVM classification speed. Also, results reveal that the wrapper-based techniques improved SVM predictive accuracy in most cases.

The Efficiency of Boosting on SVM

  • Seok, Kyung-Ha;Ryu, Tae-Wook
    • Journal of the Korean Data and Information Science Society
    • /
    • v.13 no.2
    • /
    • pp.55-64
    • /
    • 2002
  • In this paper, we introduce SVM(support vector machine) developed to solve the problem of generalization of neural networks. We also introduce boosting algorithm which is a general method to improve accuracy of some given learning algorithm. We propose a new algorithm combining SVM and boosting to solve classification problem. Through the experiment with real and simulated data sets, we can obtain better performance of the proposed algorithm.

  • PDF

Predicting Defect-Prone Software Module Using GA-SVM (GA-SVM을 이용한 결함 경향이 있는 소프트웨어 모듈 예측)

  • Kim, Young-Ok;Kwon, Ki-Tae
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.2 no.1
    • /
    • pp.1-6
    • /
    • 2013
  • For predicting defect-prone module in software, SVM classifier showed good performance in a previous research. But there are disadvantages that SVM parameter should be chosen differently for every kernel, and algorithm should be performed iteratively for predict results of changed parameter. Therefore, we find these parameters using Genetic Algorithm and compare with result of classification by Backpropagation Algorithm. As a result, the performance of GA-SVM model is better.

Rhythm Classification of ECG Signal by Rule and SVM Based Algorithm (규칙 및 SVM 기반 알고리즘에 의한 심전도 신호의 리듬 분류)

  • Kim, Sung-Oan;Kim, Dae-Hwan
    • Journal of the Korea Society of Computer and Information
    • /
    • v.18 no.9
    • /
    • pp.43-51
    • /
    • 2013
  • Classification result by comprehensive analysis of rhythm section and heartbeat unit makes a reliable diagnosis of heart disease possible. In this paper, based on feature-points of ECG signals, rhythm analysis for constant section and heartbeat unit is conducted using rule-based classification and SVM-based classification respectively. Rhythm types are classified using a rule base deduced from clinical materials for features of rhythm section in rule-based classification, and monotonic rhythm or major abnormality heartbeats are classified using multiple SVMs trained previously for features of heartbeat unit in SVM-based classification. Experimental results for the MIT-BIH arrhythmia database show classification ratios of 68.52% by rule-based method alone and 87.04% by fusion method of rule-based and SVM-based for 11 rhythm types. The proposed fusion method is improved by about 19% through misclassification improvement for monotonic and arrangement rhythms by SVM-based method.

A Study on Image Classification using Hybrid Method (하이브리드 기법을 이용한 영상 식별 연구)

  • Park, Sang-Sung;Jung, Gwi-Im;Jang, Dong-Sik
    • Journal of the Korea Society of Computer and Information
    • /
    • v.11 no.6 s.44
    • /
    • pp.79-86
    • /
    • 2006
  • Classification technology is essential for fast retrieval in large multi-media database. This paper proposes a combining GA(Genetic Algorithm) and SVM(Support Vector Machine) model to fast retrieval. We used color and texture as feature vectors. We improved the retrieval accuracy by using proposed model which retrieves an optimal feature vector set in extracted feature vector sets. The first performance test was executed for the performance of color, texture and the feature vector combined with color and texture. The second performance test, was executed for performance of SVM and proposed algorithm. The results of the experiment, using the feature vector combined color and texture showed a good Performance than a single feature vector and the proposed algorithm using hybrid method also showed a good performance than SVM algorithm.

  • PDF

A Comparative Study on Suitable SVM Kernel Function of Land Cover Classification Using KOMPSAT-2 Imagery (KOMPSAT-2 영상의 토지피복분류에 적합한 SVM 커널 함수 비교 연구)

  • Kang, Nam Yi;Go, Sin Young;Cho, Gi Sung
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.21 no.2
    • /
    • pp.19-25
    • /
    • 2013
  • Recently, the high-resolution satellite images is used the land cover and status data for the natural resources or environment management very helpful. The SVM algorithm of image processing has been used in various field. However, classification accuracy by SVM algorithm can be changed by various kernel functions and parameters. In this paper, the typical kernel function of the SVM algorithm was applied to the KOMPSAT-2 image and than the result of land cover performed the accuracy analysis using the checkpoint. Also, we carried out the analysis for selected the SVM kernel function from the land cover of the target region. As a result, the polynomial kernel function is demonstrated about the highest overall accuracy of classification. And that we know that the polynomial kernel and RBF kernel function is the best kernel function about each classification category accuracy.

The Classification Algorithm of Users' Emotion Using Brain-Wave (뇌파를 활용한 사용자의 감정 분류 알고리즘)

  • Lee, Hyun-Ju;Shin, Dong-Il;Shin, Dong-Kyoo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.39C no.2
    • /
    • pp.122-129
    • /
    • 2014
  • In this study, emotion-classification gathered from users was performed, classification-experiments were then conducted using SVM(Support Vector Machine) and K-means algorithm. Total 15 numbers of channels; CP6, Cz, FC2, T7. PO4, AF3, CP1, CP2, C3, F3, FC6, C4, Oz, T8 and F8 among 32 members of the channels measured were adapted in Brain signals which indicated obvious the classification of emotions in previous researches. To extract emotion, watching DVD and IAPS(International Affective Picture System) which is a way to stimulate with photos were applied and SAM(Self-Assessment Manikin) was used in emotion-classification to users' emotional conditions. The collected users' Brain-wave signals gathered had been pre-processing using FIR filter and artifacts(eye-blink) were then deleted by ICA(independence component Analysis) using. The data pre-processing were conveyed into frequency analysis for feature extraction through FFT. At last, the experiment was conducted suing classification algorithm; Although, K-means extracted 70% of results, SVM showed better accuracy which extracted 71.85% of results. Then, the results of previous researches adapted SVM were comparatively analyzed.

Voice Classification Algorithm for Sasang Constitution Using Support Vector Machine (SVM을 이용한 음성 사상체질 분류 알고리즘)

  • Kang, Jae-Hwan;Do, Jun-Hyeong;Kim, Jong-Yeol
    • Journal of Sasang Constitutional Medicine
    • /
    • v.22 no.1
    • /
    • pp.17-25
    • /
    • 2010
  • 1. Objectives: Voice diagnosis has been used to classify individuals into the Sasang constitution in SCM(Sasang Constitution Medicine) and to recognize his/her health condition in TKM(Traditional Korean Medicine). In this paper, we purposed a new speech classification algorithm for Sasang constitution. 2. Methods: This algorithm is based on the SVM(Support Vector Machine) technique, which is a classification method to classify two distinct groups by finding voluntary nonlinear boundary in vector space. It showed high performance in classification with a few numbers of trained data set. We designed for this algorithm using 3 SVM classifiers to classify into 4 groups, which are composed of 3 constitutional groups and additional indecision group. 3. Results: For the optimal performance, we found that 32.2% of the voice data were classified into three constitutional groups and 79.8% out of them were grouped correctly. 4. Conclusions: This new classification method including indecision group appears efficient compared to the standard classification algorithm which classifies only into 3 constitutional groups. We find that more thorough investigation on the voice features is required to improve the classification efficiency into Sasang constitution.

Fine-tuning SVM for Enhancing Speech/Music Classification (SVM의 미세조정을 통한 음성/음악 분류 성능향상)

  • Lim, Chung-Soo;Song, Ji-Hyun;Chang, Joon-Hyuk
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.2
    • /
    • pp.141-148
    • /
    • 2011
  • Support vector machines have been extensively studied and utilized in pattern recognition area for years. One of interesting applications of this technique is music/speech classification for a standardized codec such as 3GPP2 selectable mode vocoder. In this paper, we propose a novel approach that improves the speech/music classification of support vector machines. While conventional support vector machine optimization techniques apply during training phase, the proposed technique can be adopted in classification phase. In this regard, the proposed approach can be developed and employed in parallel with conventional optimizations, resulting in synergistic boost in classification performance. We first analyze the impact of kernel width parameter on the classifications made by support vector machines. From this analysis, we observe that we can fine-tune outputs of support vector machines with the kernel width parameter. To make the most of this capability, we identify strong correlation among neighboring input frames, and use this correlation information as a guide to adjusting kernel width parameter. According to the experimental results, the proposed algorithm is found to have potential for improving the performance of support vector machines.