• Electronics and Telecommunications Trends
• /
• v.38 no.5
• /
• pp.12-22
• /
• 2023

The development of neural networks is evolving towards the adoption of transformer structures with attention modules. Hence, active research focused on extending the concept of lightweight neural network algorithms and hardware acceleration is being conducted for the transition from conventional convolutional neural networks to transformer-based networks. We present a survey of state-of-the-art research on lightweight neural network algorithms and hardware architectures to reduce memory usage and accelerate both inference and training. To describe the corresponding trends, we review recent studies on token pruning, quantization, and architecture tuning for the vision transformer. In addition, we present a hardware architecture that incorporates lightweight algorithms into artificial intelligence processors to accelerate processing.

• Journal of Mechanical Science and Technology
• /
• v.20 no.4
• /
• pp.447-454
• /
• 2006

Hydraulic actuators are important in modern industry due to high power, fast response, and high stiffness. In recent years, hybrid actuation system, which combines electric and hydraulic technology in a compact unit, can be adapted to a wide variety of force, speed and torque requirements. Moreover, the hybrid actuation system has dealt with the energy consumption and noise problem existed in the conventional hydraulic system. Therefore, hybrid actuator has a wide range of application fields such as plastic injection-molding and metal forming technology, where force or pressure control is the most important technology. In this paper, the solution for force control of hybrid system is presented. However, some limitations still exist such as deterioration of the performance of transient response due to the variable environment stiffness. Therefore, intelligent switching control using Learning Vector Quantization Neural Network (LVQNN) is newly proposed in this paper in order to overcome these limitations. Experiments are carried out to evaluate the effectiveness of the proposed algorithm with large variation of stiffness of external environment. In addition, it is understood that the new system has energy saving effect even though it has almost the same response as that of valve controlled system.

• 제어로봇시스템학회:학술대회논문집
• /
• 2005.06a
• /
• pp.290-295
• /
• 2005

Hydraulic actuators are important in modern industry due to high power, fast response, and high stiffness. In recent years, hybrid actuation system, which combines electric and hydraulic technology in a compact unit, can be adapted to a wide variety of force, speed and torque requirements. Moreover, the hybrid actuation system has dealt with the energy consumption and noise problem existed in the conventional hydraulic system. Therefore, hybrid actuator has a wide range of application fields such as plastic injection-molding and metal forming technology, where force or pressure control is the most important technology. In this paper, the solution for force control of hybrid system is presented. However, some limitations still exist such as deterioration of the performance of transient response due to the variable environment stiffness. Therefore, intelligent switching control using Learning Vector Quantization Neural Network (LVQNN) is newly proposed in this paper in order to overcome these limitations. Experiments are carried out to evaluate the effectiveness of the proposed algorithm with large variation of stiffness of external environment. In addition, it is understood that the new system has energy saving effect even though it has almost the same response as that of valve controlled system.

• Journal of the Korean Society for Precision Engineering
• /
• v.26 no.4
• /
• pp.82-90
• /
• 2009

Pneumatic cylinder is one of the low cost actuation sources which have been applied in industrial and prosthetic application since it has a high power/weight ratio, a high-tension force and a long durability However, the control problems of pneumatic systems, oscillatory motion and compliance, have prevented their widespread use in advanced robotics. To overcome these shortcomings, a number of newer pneumatic actuators have been developed such as McKibben Muscle, Rubber Actuator and Pneumatic Artificial Muscle (PAM) Manipulators. In this paper, one solution for position control of a robot arm, which is driven by two pneumatic artificial muscles, is presented. However, some limitations still exist, such as a deterioration of the performance of transient response due to the changes in the external load of the robot arm. To overcome this problem, a switching algorithm of the control parameter using a learning vector quantization neural network (LVQNN) is proposed in this paper. This estimates the external load of the pneumatic artificial muscle manipulator. The effectiveness of the proposed control algorithm is demonstrated through experiments with different external working loads.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.33B no.1
• /
• pp.161-169
• /
• 1996

This paper presents a new search region prediction method using vector quantization for the motion estimation. We find motion vectors using the full search BMA from two successive frame images first. Then the motion vectors are used for training a codebook. The trained codebook is the predicted search region. We used the unsupervised neural network for VQ encoding and codebook design. A major advantage of formulating VQ as neural networks is that the large number of adaptive training algorithm that are used for neural networks can be applied to VQ. The proposed method reduces the computation and reduce the bits required to represent the motion vectors because of the smaller search points. The computer simulation results show the increased PSNR as compared with the other block matching algorithms.

• Journal of KIISE:Software and Applications
• /
• v.26 no.12
• /
• pp.1383-1392
• /
• 1999

이미 학습된 다층퍼셉트론 신경망을 디지털 VLSI 기술을 사용하여 하드웨어로 구현할 경우 신경망의 가중치 및 뉴런 출력들을 양자화해야 하는 문제가 발생한다. 이러한 신경망 변수들의 양자화는 결과적으로 주어진 입력에 대한 신경망의 최종 출력에서의 왜곡을 초래한다. 본 논문에서는 먼저 이러한 양자화로 인한 신경망 출력에서의 왜곡을 통계적으로 분석하였다. 분석 결과에 의하면 입력패턴 각 성분의 제곱들의 합과 가중치의 크기들이 양자화 영향에 주로 기여하는 것으로 나타났다. 이러한 분석 결과를 이용하여 양자화를 위한 정밀도가 주어졌을 때, 양자화 영향이 최소화된 다층퍼셉트론 신경망을 설계하는 방법을 제시하였다. 그리고 제안된 방법에 의해 얻은 신경망과 오류역전파 학습방법에 의하여 얻은 신경망의 성능을 비교함으로써 제안된 방법의 효율성을 입증하였다. 실험결과는 낮은 양자화 정밀도에서도 제안된 방법이 더 좋은 성능을 보였다.Abstract When we implement a multilayer perceptron with the digital VLSI technology, we generally have to quantize the weights and the neuron outputs. These quantizations eventually cause distortion in the output of the network for a given input. In this paper first we made a statistical analysis about the effect caused by the quantization on the output of the network. The analysis revealed that the sum of the squared input components and the sizes of the weights are the major factors which contribute to the quantization effect. We present a design method for an MLP which minimizes the quantization effect when the precision of the quantization is given. In order to show the effectiveness of the proposed method, we developed a network by our method and compared it with the one developed by the regular backpropagation. We could confirm that the network developed by our method performs better even with a low precision of the quantization.

• Asia pacific journal of information systems
• /
• v.5 no.1
• /
• pp.36-51
• /
• 1995

본 논문에서는 비구조적인 의사결정문제를 효과적으로 해결하기 위하여 감독학습 인공신경망 모형과 비감독학습 인공신경망 모형을 결합한 하이브리드 인공신경망 모형인 HYNEN(HYbrid NEural Network) 모형을 제안한다. HYNEN모형은 주어진 자료를 클러스터화 하는 CNN(Clustering Neural Network)과 최종적인 출력을 제공하는 ONN(Output Neural Network)의 2단계로 구성되어 있다. 먼저 CNN에서는 주어진 자료로부터 적정한 퍼지규칙을 찾기 위하여 클러스터를 구성한다. 그리고 이러한 클러스터를 지식베이스로하여 ONN에서 최종적인 의사결정을 한다. CNN에서는 SOFM(Self Organizing Feature Map)과 LVQ(Learning Vector Quantization)를 클러스터를 만든 후 역전파학습 인공신경망 모형으로 이를 학습한다. ONN에서는 역전파학습 인공신경망 모형을 이용하여 각 클러스터의 내용을 학습한다. 제안된 HYNEN 모형을 우리나라 기업의 도산자료에 적용하여 그 결과를 다변량 판별분석법(MDA:Multivariate Discriminant Analysis)과 ACLS(Analog Concept Learning System) 퍼지 ARTMAP 그리고 기존의 역전파학습 인공신경망에 의한 실험결과와 비교하였다.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.30 no.4C
• /
• pp.185-190
• /
• 2005

In IS-95 and IMT-2000 systems using variable code rates and constraint lengths, this paper limits code rate 1/2 and constraint length 3 and realizes forward real-time decoder using Sliding-Window with decoding length 6 and PVSL(Prototype Vector Selecting Logic), LVQ(Learning Vector Quantization) in Neural Network. In comparison condition to theoretically constrained AWGN channel environment at $S/(N_{0}/2)=1$ I verified the superiority of forward real-time decoder through hard-decision and soft-decision comparison between Viterbi decoder and forward real-time decoder such as BER and Secure Communication and H/W Structure.

• Journal of Drive and Control
• /
• v.5 no.2
• /
• pp.24-31
• /
• 2008

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2006.05a
• /
• pp.109-112
• /
• 2006

본 논문은 클래스들의 대표값들과 입력 벡터와의 거리를 사용한 새로운 퍼지 학습법칙을 제안한다. 이 새로운 퍼지 학습을 supervised IAFC(Integrated Adaptive Fuzzy Clustering) 신경회로망에 적용하였다. 이 새로운 신경회로망은 안정성을 유지하면서도 유연성을 가지고 있다. iris 데이터를 사용하여 테스트한 결과 supervised IAFC 신경회로망 4는 오류 역전파 신경회로망과 LVQ 알고리즘보다 성능이 우수하였다.