• Title/Summary/Keyword: spiking neural network

Search Result 27, Processing Time 0.023 seconds

Model Optimization for Supporting Spiking Neural Networks on FPGA Hardware (FPGA상에서 스파이킹 뉴럴 네트워크 지원을 위한 모델 최적화)

  • Kim, Seoyeon;Yun, Young-Sun;Hong, Jiman;Kim, Bongjae;Lee, Keon Myung;Jung, Jinman
    • Smart Media Journal
    • /
    • v.11 no.2
    • /
    • pp.70-76
    • /
    • 2022
  • IoT application development using a cloud server causes problems such as data transmission and reception delay, network traffic, and cost for real-time processing support in network connected hardware. To solve this problem, edge cloud-based platforms can use neuromorphic hardware to enable fast data transfer. In this paper, we propose a model optimization method for supporting spiking neural networks on FPGA hardware. We focused on auto-adjusting network model parameters optimized for neuromorphic hardware. The proposed method performs optimization to show higher performance based on user requirements for accuracy. As a result of performance analysis, it satisfies all requirements of accuracy and showed higher performance in terms of expected execution time, unlike the naive method supported by the existing open source framework.

Performance Analysis of Speech Recognition Model based on Neuromorphic Architecture of Speech Data Preprocessing Technique (음성 데이터 전처리 기법에 따른 뉴로모픽 아키텍처 기반 음성 인식 모델의 성능 분석)

  • Cho, Jinsung;Kim, Bongjae
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.22 no.3
    • /
    • pp.69-74
    • /
    • 2022
  • SNN (Spiking Neural Network) operating in neuromorphic architecture was created by mimicking human neural networks. Neuromorphic computing based on neuromorphic architecture requires relatively lower power than typical deep learning techniques based on GPUs. For this reason, research to support various artificial intelligence models using neuromorphic architecture is actively taking place. This paper conducted a performance analysis of the speech recognition model based on neuromorphic architecture according to the speech data preprocessing technique. As a result of the experiment, it showed up to 84% of speech recognition accuracy performance when preprocessing speech data using the Fourier transform. Therefore, it was confirmed that the speech recognition service based on the neuromorphic architecture can be effectively utilized.

The Parameter Learning Method for Similar Image Rating Using Pulse Coupled Neural Network

  • Matsushima, Hiroki;Kurokawa, Hiroaki
    • Journal of Multimedia Information System
    • /
    • v.3 no.4
    • /
    • pp.155-160
    • /
    • 2016
  • The Pulse Coupled Neural Network (PCNN) is a kind of neural network models that consists of spiking neurons and local connections. The PCNN was originally proposed as a model that can reproduce the synchronous phenomena of the neurons in the cat visual cortex. Recently, the PCNN has been applied to the various image processing applications, e.g., image segmentation, edge detection, pattern recognition, and so on. The method for the image matching using the PCNN had been proposed as one of the valuable applications of the PCNN. In this method, the Genetic Algorithm is applied to the PCNN parameter learning for the image matching. In this study, we propose the method of the similar image rating using the PCNN. In our method, the Genetic Algorithm based method is applied to the parameter learning of the PCNN. We show the performance of our method by simulations. From the simulation results, we evaluate the efficiency and the general versatility of our parameter learning method.

Mixed-mode SNN crossbar array with embedded dummy switch and mid-node pre-charge scheme

  • Kwang-Il Oh;Hyuk Kim;Taewook Kang;Sung-Eun Kim;Jae-Jin Lee;Byung-Do Yang
    • ETRI Journal
    • /
    • v.46 no.5
    • /
    • pp.865-877
    • /
    • 2024
  • This paper presents a membrane computation error-minimized mixed-mode spiking neural network (SNN) crossbar array. Our approach involves implementing an embedded dummy switch scheme and a mid-node pre-charge scheme to construct a high-precision current-mode synapse. We effectively suppressed charge sharing between membrane capacitors and the parasitic capacitance of synapses that results in membrane computation error. A 400 × 20 SNN crossbar prototype chip is fabricated via a 28-nm FDSOI CMOS process, and 20 MNIST patterns with their sizes reduced to 20 × 20 pixels are successfully recognized under 411 ㎼ of power consumed. Moreover, the peak-to-peak deviation of the normalized output spike count measured from the 21 fabricated SNN prototype chips is within 16.5% from the ideal value, including sample-wise random variations.

QoS-Aware Optimal SNN Model Parameter Generation Method in Neuromorphic Environment (뉴로모픽 환경에서 QoS를 고려한 최적의 SNN 모델 파라미터 생성 기법)

  • Seoyeon Kim;Bongjae Kim;Jinman Jung
    • Smart Media Journal
    • /
    • v.12 no.4
    • /
    • pp.19-26
    • /
    • 2023
  • IoT edge services utilizing neuromorphic hardware architectures are suitable for autonomous IoT applications as they perform intelligent processing on the device itself. However, spiking neural networks applied to neuromorphic hardware are difficult for IoT developers to comprehend due to their complex structures and various hyper-parameters. In this paper, we propose a method for generating spiking neural network (SNN) models that satisfy user performance requirements while considering the constraints of neuromorphic hardware. Our proposed method utilizes previously trained models from pre-processed data to find optimal SNN model parameters from profiling data. Comparing our method to a naive search method, both methods satisfy user requirements, but our proposed method shows better performance in terms of runtime. Additionally, even if the constraints of new hardware are not clearly known, the proposed method can provide high scalability by utilizing the profiled data of the hardware.

Trends in Ultra Low Power Intelligent Edge Semiconductor Technology (초저전력 엣지 지능형반도체 기술 동향)

  • Oh, K.I.;Kim, S.E.;Bae, Y.H.;Park, S.M.;Lee, J.J.;Kang, S.W.
    • Electronics and Telecommunications Trends
    • /
    • v.33 no.6
    • /
    • pp.24-33
    • /
    • 2018
  • In the age of IoT, in which everything is connected to a network, there have been increases in the amount of data traffic, latency, and the risk of personal privacy breaches that conventional cloud computing technology cannot cope with. The idea of edge computing has emerged as a solution to these issues, and furthermore, the concept of ultra-low power edge intelligent semiconductors in which the IoT device itself performs intelligent decisions and processes data has been established. The key elements of this function are an intelligent semiconductor based on artificial intelligence, connectivity for the efficient connection of neurons and synapses, and a large-scale spiking neural network simulation framework for the performance prediction of a neural network. This paper covers the current trends in ultra-low power edge intelligent semiconductors including issues regarding their technology and application.

Electrophysiological and Morphological Classification of Inhibitory Interneurons in Layer II/III of the Rat Visual Cortex

  • Rhie, Duck-Joo;Kang, Ho-Young;Ryu, Gyeong-Ryul;Kim, Myung-Jun;Yoon, Shin-Hee;Hahn, Sang-June;Min, Do-Sik;Jo, Yang-Hyeok;Kim, Myung-Suk
    • The Korean Journal of Physiology and Pharmacology
    • /
    • v.7 no.6
    • /
    • pp.317-323
    • /
    • 2003
  • Interneuron diversity is one of the key factors to hinder understanding the mechanism of cortical neural network functions even with their important roles. We characterized inhibitory interneurons in layer II/III of the rat primary visual cortex, using patch-clamp recording and confocal reconstruction, and classified inhibitory interneurons into fast spiking (FS), late spiking (LS), burst spiking (BS), and regular spiking non-pyramidal (RSNP) neurons according to their electrophysiological characteristics. Global parameters to identify inhibitory interneurons were resting membrane potential (>-70 mV) and action potential (AP) width (<0.9 msec at half amplitude). FS could be differentiated from LS, based on smaller amplitude of the AP (<∼50 mV) and shorter peak-to-trough time (P-T time) of the afterhyperpolarization (<4 msec). In addition to the shorter AP width, RSNP had the higher input resistance (>200 $M{Omega}$) and the shorter P-T time (<20 msec) than those of regular spiking pyramidal neurons. Confocal reconstruction of recorded cells revealed characteristic morphology of each subtype of inhibitory interneurons. Thus, our results provide at least four subtypes of inhibitory interneurons in layer II/III of the rat primary visual cortex and a classification scheme of inhibitory interneurons.

Discrimination of neutrons and gamma-rays in plastic scintillator based on spiking cortical model

  • Bing-Qi Liu;Hao-Ran Liu;Lan Chang;Yu-Xin Cheng;Zhuo Zuo;Peng Li
    • Nuclear Engineering and Technology
    • /
    • v.55 no.9
    • /
    • pp.3359-3366
    • /
    • 2023
  • In this study, a spiking cortical model (SCM) based n-g discrimination method is proposed. The SCM-based algorithm is compared with three other methods, namely: (i) the pulse-coupled neural network (PCNN), (ii) the charge comparison, and (iii) the zero-crossing. The objective evaluation criteria used for the comparison are the FoM-value and the time consumption of discrimination. Experimental results demonstrated that our proposed method outperforms the other methods significantly with the highest FoM-value. Specifically, the proposed method exhibits a 34.81% improvement compared with the PCNN, a 50.29% improvement compared with the charge comparison, and a 110.02% improvement compared with the zero-crossing. Additionally, the proposed method features the second-fastest discrimination time, where it is 75.67% faster than the PCNN, 70.65% faster than the charge comparison and 38.4% slower than the zero-crossing. Our study also discusses the role and change pattern of each parameter of the SCM to guide the selection process. It concludes that the SCM's outstanding ability to recognize the dynamic information in the pulse signal, improved accuracy when compared to the PCNN, and better computational complexity enables the SCM to exhibit excellent n-γ discrimination performance while consuming less time.

Implementation of Autonomous IoT Integrated Development Environment based on AI Component Abstract Model (AI 컴포넌트 추상화 모델 기반 자율형 IoT 통합개발환경 구현)

  • Kim, Seoyeon;Yun, Young-Sun;Eun, Seong-Bae;Cha, Sin;Jung, Jinman
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.21 no.5
    • /
    • pp.71-77
    • /
    • 2021
  • Recently, there is a demand for efficient program development of an IoT application support frameworks considering heterogeneous hardware characteristics. In addition, the scope of hardware support is expanding with the development of neuromorphic architecture that mimics the human brain to learn on their own and enables autonomous computing. However, most existing IoT IDE(Integrated Development Environment), it is difficult to support AI(Artificial Intelligence) or to support services combined with various hardware such as neuromorphic architectures. In this paper, we design an AI component abstract model that supports the second-generation ANN(Artificial Neural Network) and the third-generation SNN(Spiking Neural Network), and implemented an autonomous IoT IDE based on the proposed model. IoT developers can automatically create AI components through the proposed technique without knowledge of AI and SNN. The proposed technique is flexible in code conversion according to runtime, so development productivity is high. Through experimentation of the proposed method, it was confirmed that the conversion delay time due to the VCL(Virtual Component Layer) may occur, but the difference is not significant.

Comparison of Artificial Neural Networks for Low-Power ECG-Classification System

  • Rana, Amrita;Kim, Kyung Ki
    • Journal of Sensor Science and Technology
    • /
    • v.29 no.1
    • /
    • pp.19-26
    • /
    • 2020
  • Electrocardiogram (ECG) classification has become an essential task of modern day wearable devices, and can be used to detect cardiovascular diseases. State-of-the-art Artificial Intelligence (AI)-based ECG classifiers have been designed using various artificial neural networks (ANNs). Despite their high accuracy, ANNs require significant computational resources and power. Herein, three different ANNs have been compared: multilayer perceptron (MLP), convolutional neural network (CNN), and spiking neural network (SNN) only for the ECG classification. The ANN model has been developed in Python and Theano, trained on a central processing unit (CPU) platform, and deployed on a PYNQ-Z2 FPGA board to validate the model using a Jupyter notebook. Meanwhile, the hardware accelerator is designed with Overlay, which is a hardware library on PYNQ. For classification, the MIT-BIH dataset obtained from the Physionet library is used. The resulting ANN system can accurately classify four ECG types: normal, atrial premature contraction, left bundle branch block, and premature ventricular contraction. The performance of the ECG classifier models is evaluated based on accuracy and power. Among the three AI algorithms, the SNN requires the lowest power consumption of 0.226 W on-chip, followed by MLP (1.677 W), and CNN (2.266 W). However, the highest accuracy is achieved by the CNN (95%), followed by MLP (76%) and SNN (90%).