Journal of IKEEE (전기전자학회논문지)

Institute of Korean Electrical and Electronics Engineers (한국전기전자학회)
권호 표지
DOI QR코드

DOI QR Code

FPGA Design of SVM Classifier for Real Time Image Processing

실시간 영상처리를 위한 SVM 분류기의 FPGA 구현

  • Na, Won-Seob (Dept. of Electronics and Communications Engineering, Kwangwoon University) ;
  • Han, Sung-Woo (Dept. of Electronics and Communications Engineering, Kwangwoon University) ;
  • Jeong, Yong-Jin (Dept. of Electronics and Communications Engineering, Kwangwoon University)
  • Received : 2016.08.23
  • Accepted : 2016.09.26
  • Published : 2016.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

SVM is a machine learning method used for image processing. It is well known for its high classification performance. We have to perform multiple MAC operations in order to use SVM for image classification. However, if the resolution of the target image or the number of classification cases increases, the execution time of SVM also increases, which makes it difficult to be performed in real-time applications. In this paper, we propose an hardware architecture which enables real-time applications using SVM classification. We used parallel architecture to simultaneously calculate MAC operations, and also designed the system for several feature extractors for compatibility. RBF kernel was used for hardware implemenation, and the exponent calculation formular included in the kernel was modified to enable fixed point modelling. Experimental results for the system, when implemented in Xilinx ZC-706 evaluation board, show that it can process 60.46 fps for $1360{\times}800$ resolution at 100MHz clock frequency.

영상처리에 쓰이는 기계학습 방법 중 하나인 SVM은 일반화 능력이 뛰어나 객체를 분류하는 성능이 뛰어나다. SVM을 이용하여 객체를 분류하기 위해서는 여러 번의 MAC 연산을 반복해서 수행해야 한다. 하지만 영상의 해상도가 늘어남에 따라 분류를 해야 하는 개체가 늘어나게 되면 연산 시간이 증가하게 되어 실시간 처리를 요하는 고속 시스템에 사용하기 어렵다. 본 논문에서는 실시간 처리를 요하는 고속 시스템에서도 사용이 가능한 SVM 분류기 하드웨어 구조를 제안한다. 실시간 처리를 하는데 제한 요소가 되는 반복 연산은 병렬처리를 통하여 동시에 계산할 수 있게 하였고 다양한 종류의 특징점 추출기와도 호환이 가능하도록 설계하였다. 하드웨어 구현에 사용한 커널은 RBF 커널이며 커널 사용으로 생기는 지수 연산은 식을 변형하여 고정소수점 연산이 가능하도록 하였다. 제안한 하드웨어의 성능을 확인하기 위해 Xilinx ZC706 보드에 구현하였고 $1360{\times}800$ 해상도 이미지에 대한 수행 시간은 동작 주파수 100 MHz에서 약 60.46 fps로 실시간 처리가 가능함을 확인했다.

Keywords

References

  1. K. Grauman and T. Darrell, "The pyramid match kernel Discriminative classification with sets of image features," Proceedings of IEEE International Conference on Computer Vision, 2005
  2. Y. H. Kang, Y. B. Park, "Design of Automatic Document Classifier for IT documents based on SVM" j.inst.Korean.electr.electron.eng, Vol. 8, No. 2 186-194, 2004
  3. M. Qasaimeh, A. Sagahyroon, and T. Shanableh, "FPGA-Based Parallel Hardware Architecture for Real-Time Image Classification", Computational Imaging, IEEE Transactions, Vol. 1, No. 1 56-70, 2015 https://doi.org/10.1109/TCI.2015.2424077
  4. Marta Ruiz-Llata, Guillermo Guarnizo and Mar Yebenes-Calvino, "FPGA Implementation of a Support Vector Machine for Classification and Regression," IJCNN, 2010
  5. Xipeng Pan, Huihua Yang, Lingqiao Li, Zhenbing Liu, Le Hou , "FPGA Implementation of SVM Decision Function Based on Hardware-friendly Kernel," ICCIS, 2013
  6. Bryan Catanzaro, ,"Fast Support Vector Machine Training and Classification on Graphics Processors," IMAGING, Vol. 1, No. 1, March 2015
  7. Christos Kyrkou, Theocharis Theocharides, "A Parallel Hardware Architecture for Real-Time Object Detection with Support Vector Machines," IEEE TRANSACTIONS ON COMPUTERS, Vol. 61, No. 6, 2012
  8. Chih-Wei Hsu, Chih-Chung Chang, and Chih-Jen Lin, "A Practical Guide to Support Vector Classification," Master thesis, Department of Computer Science National Taiwan University, 2003
  9. C. Chang and C. Lin, "LIBSVM : A Library for Support Vector Machine," ACM Transactions on Intelligent Systems and Technology, Vol 2, No.3, 1-27, 2011
  10. B. E. Boser, I. Guyon, and V. Vapnik, "A training algorithm for optimal margin classiers," Proceedings of the Fifth Annual Workshop on Computational Learning Theory, 144-152, 1992
  11. C. Cortes and V. Vapnik, "Support-Vector Network," Machine Learning, Vol. 20, No. 3 273-297, 1995 https://doi.org/10.1007/BF00994018
  12. Il- Seok Oh , Pattern Recognition , Kyobomoongo , 2008
  13. Trevor Hastie, Robert Tibshirani, Jerome Friedman, The Elements of Statistical Learning - Data Mining, Inference, and Prediction, 2008
  14. Tomasz Kryjak, Mateusz Komorkiewicz, Marek Gorgon, "FPGA IMPLEMENTATION OF REAL-TIME HEAD-SHOULDER DETECTION USING LOCAL BINARY PATTERNS, SVM AND FOREGROUND OBJECT DETECTION", Design and Architectures for Signal and Image Processing (DASIP) Conference, Karlsruhe, Germany, 2012

Cited by

  1. Implementation of High Speed Image Data Transfer using XDMA vol.25, pp.7, 2016, https://doi.org/10.9708/jksci.2020.25.07.001