• 제목/요약/키워드: Neural Network Quantization

검색결과 115건 처리시간 0.021초

R-D 최적화와 신경 회로망을 이용한 JPEG 양자화 테이블 설계 방법 (JPEG quantization table design using R-D optimization and neural network)

  • 가충희;이종범;정구민
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2006년도 심포지엄 논문집 정보 및 제어부문
    • /
    • pp.9-11
    • /
    • 2006
  • This paper presents JPEG quantization table design using RD optimization and neural network. Using R-D optimization, quantization table with good performance can be obtained. However, it is time-consuming and difficult to adopt to embedded systems. In this paper, a new quantization table design method is proposed using R-D optimization and neural network. Neural network learns the quantization table obtained from R-D optimization and produces a quantization table for the Images. The proposed system is applied to Yale face data. From the simulation results, it has been shown that the proposed codec has better performance than JPEG.

  • PDF

임베디드 시스템에서의 객체 분류를 위한 인공 신경망 경량화 연구 (Neural Network Model Compression Algorithms for Image Classification in Embedded Systems)

  • 신희중;오현동
    • 로봇학회논문지
    • /
    • 제17권2호
    • /
    • pp.133-141
    • /
    • 2022
  • This paper introduces model compression algorithms which make a deep neural network smaller and faster for embedded systems. The model compression algorithms can be largely categorized into pruning, quantization and knowledge distillation. In this study, gradual pruning, quantization aware training, and knowledge distillation which learns the activation boundary in the hidden layer of the teacher neural network are integrated. As a large deep neural network is compressed and accelerated by these algorithms, embedded computing boards can run the deep neural network much faster with less memory usage while preserving the reasonable accuracy. To evaluate the performance of the compressed neural networks, we evaluate the size, latency and accuracy of the deep neural network, DenseNet201, for image classification with CIFAR-10 dataset on the NVIDIA Jetson Xavier.

신경 회로망을 이용한 음성 신호의 벡터 양자화 (Speech Signal Vector Quantization Using Neural Network)

  • 백승복;김상희
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 1999년도 추계종합학술대회 논문집
    • /
    • pp.1015-1018
    • /
    • 1999
  • This paper describes a vector quantization for speech signal coding using neural networks. We processed speech signal using LPC method that extracts speech signal feature, and speech signal feature is quantized using competitive neural network kohonen self-organization feature map.

  • PDF

신경회로망과 벡터양자화에 의한 사후확률과 확률 밀도함수 추정 및 검증 (Verification and estimation of a posterior probability and probability density function using vector quantization and neural network)

  • 고희석;김현덕;이광석
    • 대한전기학회논문지
    • /
    • 제45권2호
    • /
    • pp.325-328
    • /
    • 1996
  • In this paper, we proposed an estimation method of a posterior probability and PDF(Probability density function) using a feed forward neural network and code books of VQ(vector quantization). In this study, We estimates a posterior probability and probability density function, which compose a new parameter with well-known Mel cepstrum and verificate the performance for the five vowels taking from syllables by NN(neural network) and PNN(probabilistic neural network). In case of new parameter, showed the best result by probabilistic neural network and recognition rates are average 83.02%.

  • PDF

비대칭 퍼지 학습률을 이용한 퍼지 신경회로망 모델 (Fuzzy Neural Network Model Using Asymmetric Fuzzy Learning Rates)

  • 김용수
    • 한국지능시스템학회논문지
    • /
    • 제15권7호
    • /
    • pp.800-804
    • /
    • 2005
  • 본 논문에서는 LVQ(Learning )rector Quantization)을 퍼지화한 새로운 퍼지 학습 법칙을 제안하였다. 퍼지 학습 법칙 3은 기존의 학습률 대신에 퍼지 학습률을 사용하였는데, 기존의 LVQ와는 달리 비대칭인 학습률을 사용하였다. 기존의 LVQ에서는 분류가 맞거나 틀렸을 때 같은 학습률을 사용하고 부호만 달랐으나, 새로운 퍼지 학습 법칙에서는 분류가 맞거나 틀렸을 때 부호가 다를 뿐만 아니라 학습률도 다르다. 이 새로운 퍼지 학습 법칙을 무감독 신경회로망인 improved IAFC (Integrated Adaptive Fuzzy Clustering) 신경회로망에 적용하여 감독 신경회로망으로 변형하였다. Improved IAFC 신경회로망은 유연성이 있으면서도 안정성이 있다. 제안한 supervised IAFC 신경회로망 3의 성능과 오류 역전파 신경회로망의 성능을 비교하기 위하여 iris 데이터를 사용하였는데, supervised IAFC 신경회로망 3가 오류 역전파 신경회로망보다 성능이 우수하였다.

신격회로망 적응 VQ를 이용한 심장 조영상 부호화 (Cardio-Angiographic Sequence Coding Using Neural Network Adaptive Vector Quantization)

  • 주창희;최종수
    • 대한전기학회논문지
    • /
    • 제40권4호
    • /
    • pp.374-381
    • /
    • 1991
  • As a diagnostic image of hospitl, the utilization of digital image is steadily increasing. Image coding is indispensable for storing and compressing an enormous amount of diagnostic images economically and effectively. In this paper adaptive two stage vector quantization based on Kohonen's neural network for the compression of cardioangiography among typical angiography of radiographic image sequences is presented and the performance of the coding scheme is compare and gone over. In an attempt to exploit the known characteristics of changes in cardioangiography, relatively large blocks of image are quantized in the first stage and in the next stage the bloks subdivided by the threshold of quantization error are vector quantized employing the neural network of frequency sensitive competitive learning. The scheme is employed because the change produced in cardioangiography is due to such two types of motion as a heart itself and body motion, and a contrast dye material injected. Computer simulation shows that the good reproduction of images can be obtained at a bit rate of 0.78 bits/pixel.

  • PDF

CNN 모델의 최적 양자화를 위한 웹 서비스 플랫폼 (Web Service Platform for Optimal Quantization of CNN Models)

  • 노재원;임채민;조상영
    • 반도체디스플레이기술학회지
    • /
    • 제20권4호
    • /
    • pp.151-156
    • /
    • 2021
  • Low-end IoT devices do not have enough computation and memory resources for DNN learning and inference. Integer quantization of real-type neural network models can reduce model size, hardware computational burden, and power consumption. This paper describes the design and implementation of a web-based quantization platform for CNN deep learning accelerator chips. In the web service platform, we implemented visualization of the model through a convenient UI, analysis of each step of inference, and detailed editing of the model. Additionally, a data augmentation function and a management function of files that store models and inference intermediate results are provided. The implemented functions were verified using three YOLO models.

자기 분열 및 구조화 신경회로망 (A Self Creating and Organizing Neural Network)

  • 최두일;박상희
    • 대한전기학회논문지
    • /
    • 제41권5호
    • /
    • pp.533-540
    • /
    • 1992
  • The Self Creating and Organizing (SCO) is a new architecture and one of the unsupervized learning algorithm for the artificial neural network. SCO begins with only one output node which has a sufficiently wide response range, and the response ranges of all the nodes decrease automatically whether adapting the weights of existing node or creating a new node. It is compared to the Kohonen's Self Organizing Feature Map (SOFM). The results show that SCONN has lots of advantages over other competitive learning architecture.

  • PDF

신경망을 이용한 벡터 양자화의 코드북 설계 (A Codebook Design for Vector Quantization Using a Neural Network)

  • 주상현;원치선;신재호
    • 한국통신학회논문지
    • /
    • 제19권2호
    • /
    • pp.276-283
    • /
    • 1994
  • 백터양자와를 위한 신경망을 사용은 그것의 적응적 설계 특성으로 더 좋은 코드북을 설계할 수 있을 것으로 기대되며, 또한 설계된 코드북의 코드워드는 자동정렬되어 실시간 탐색을 가능케 한다. 신경망의 이러한 장점을 살리기 위하여 본 논문에서는 KSFM(Kohonen`s Self-organizing Feature Map)을 수정하고, K-means 알고리즘을 결함한 새로운 코드북 설계 할고리즘을 제안한다. 실험결과로 부터 제안된 알고리즘의 성능향상과 실시간 처리를 위한 코드북의 부분탐색 가능성을 확인하였다.

  • PDF

Intelligent Switching Control of Pneumatic Cylinders by Learning Vector Quantization Neural Network

  • Ahn KyoungKwan;Lee ByungRyong
    • Journal of Mechanical Science and Technology
    • /
    • 제19권2호
    • /
    • pp.529-539
    • /
    • 2005
  • The development of a fast, accurate, and inexpensive position-controlled pneumatic actuator that may be applied to various practical positioning applications with various external loads is described in this paper. A novel modified pulse-width modulation (MPWM) valve pulsing algorithm allows on/off solenoid valves to be used in place of costly servo valves. A comparison between the system response of the standard PWM technique and that of the modified PWM technique shows that the performance of the proposed technique was significantly increased. A state-feedback controller with position, velocity and acceleration feedback was successfully implemented as a continuous controller. A switching algorithm for control parameters using a learning vector quantization neural network (LVQNN) has newly proposed, which classifies the external load of the pneumatic actuator. The effectiveness of this proposed control algorithm with smooth switching control has been demonstrated through experiments with various external loads.