• 제목/요약/키워드: Neural Network-based

검색결과 5,631건 처리시간 0.039초

Transformer를 활용한 인공신경망의 경량화 알고리즘 및 하드웨어 가속 기술 동향 (Trends in Lightweight Neural Network Algorithms and Hardware Acceleration Technologies for Transformer-based Deep Neural Networks)

  • 김혜지;여준기
    • 전자통신동향분석
    • /
    • 제38권5호
    • /
    • pp.12-22
    • /
    • 2023
  • The development of neural networks is evolving towards the adoption of transformer structures with attention modules. Hence, active research focused on extending the concept of lightweight neural network algorithms and hardware acceleration is being conducted for the transition from conventional convolutional neural networks to transformer-based networks. We present a survey of state-of-the-art research on lightweight neural network algorithms and hardware architectures to reduce memory usage and accelerate both inference and training. To describe the corresponding trends, we review recent studies on token pruning, quantization, and architecture tuning for the vision transformer. In addition, we present a hardware architecture that incorporates lightweight algorithms into artificial intelligence processors to accelerate processing.

Prediction of the price for stock index futures using integrated artificial intelligence techniques with categorical preprocessing

  • Kim, Kyoung-jae;Han, Ingoo
    • 한국경영과학회:학술대회논문집
    • /
    • 한국경영과학회 1997년도 추계학술대회발표논문집; 홍익대학교, 서울; 1 Nov. 1997
    • /
    • pp.105-108
    • /
    • 1997
  • Previous studies in stock market predictions using artificial intelligence techniques such as artificial neural networks and case-based reasoning, have focused mainly on spot market prediction. Korea launched trading in index futures market (KOSPI 200) on May 3, 1996, then more people became attracted to this market. Thus, this research intends to predict the daily up/down fluctuant direction of the price for KOSPI 200 index futures to meet this recent surge of interest. The forecasting methodologies employed in this research are the integration of genetic algorithm and artificial neural network (GAANN) and the integration of genetic algorithm and case-based reasoning (GACBR). Genetic algorithm was mainly used to select relevant input variables. This study adopts the categorical data preprocessing based on expert's knowledge as well as traditional data preprocessing. The experimental results of each forecasting method with each data preprocessing method are compared and statistically tested. Artificial neural network and case-based reasoning methods with best performance are integrated. Out-of-the Model Integration and In-Model Integration are presented as the integration methodology. The research outcomes are as follows; First, genetic algorithms are useful and effective method to select input variables for Al techniques. Second, the results of the experiment with categorical data preprocessing significantly outperform that with traditional data preprocessing in forecasting up/down fluctuant direction of index futures price. Third, the integration of genetic algorithm and case-based reasoning (GACBR) outperforms the integration of genetic algorithm and artificial neural network (GAANN). Forth, the integration of genetic algorithm, case-based reasoning and artificial neural network (GAANN-GACBR, GACBRNN and GANNCBR) provide worse results than GACBR.

  • PDF

Neural Networks Based Identification and Control of a Large Flexible Antenna

  • Sasaki, Minoru;Murase, Takuya;Ukita, Nobuharu
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2004년도 ICCAS
    • /
    • pp.1711-1716
    • /
    • 2004
  • This paper presents identification and control of a 10-m antenna via accelerometers and angle encoder data. Artificial Neural Networks can be used effectively for the identification and control of nonlinear dynamical system such as a large flexible antenna. Some identification results are shown and compared with the results of conventional prediction error method. And we use a neural network inverse model for control the large flexible antenna. In the neural network inverse model, a neural network is trained, using supervised learning, to develop an inverse model of the antenna. The network input is the process output, and the network output is the corresponding process input. The control results show the validation of the ANN approach for identification and control of the 10-m flexible antenna.

  • PDF

진화하는 셀룰라 오토마타 신경망의 하드웨어 구현에 관한 연구 (A Study on Implementation of Evolving Cellular Automata Neural System)

  • 반창봉;곽상영;이동욱;심귀보
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 2001년도 추계학술대회 학술발표 논문집
    • /
    • pp.255-258
    • /
    • 2001
  • This paper is implementation of cellular automata neural network system which is a living creatures' brain using evolving hardware concept. Cellular automata neural network system is based on the development and the evolution, in other words, it is modeled on the ontogeny and phylogeny of natural living things. The proposed system developes each cell's state in neural network by CA. And it regards code of CA rule as individual of genetic algorithm, and evolved by genetic algorithm. In this paper we implement this system using evolving hardware concept Evolving hardware is reconfigurable hardware whose configuration is under the control of an evolutionary algorithm. We design genetic algorithm process for evolutionary algorithm and cells in cellular automata neural network for the construction of reconfigurable system. The effectiveness of the proposed system is verified by applying it to time-series prediction.

  • PDF

자율주행 이동로봇의 실시간 퍼지신경망 제어 (Real-Time Fuzzy Neural Network Control for Real-Time Autonomous Cruise of Mobile Robot)

  • 정동연;김종수;한성현
    • 한국정밀공학회지
    • /
    • 제20권7호
    • /
    • pp.155-162
    • /
    • 2003
  • We propose a new technique far real-tine controller design of a autonomous cruise mobile robot with three drive wheels. The proposed control scheme uses a Caussian function as a unit function in the fuzzy neural network. and a back propagation algorithm to train the fuzzy neural network controller in the framework of the specialized learning architecture. It is proposed a learning controller consisting of two neural network-fuzzy based on independent reasoning and a connection net with fixed weights to simply the neural networks-foray. The control performance of the proposed controller is illustrated by performing the computer simulation for trajectory tracking of the speed and azimuth of a autonomous cruise mobile robot driven by three independent wheels.

퍼지신경망을 이용한 자율주행 이동로봇의 실시간 제어 (Real-Time Control for Autonomous Cruise of Mobile Robot Using Fuzzy Neural Network)

  • 정동연;이우송;한성현
    • 한국정밀공학회:학술대회논문집
    • /
    • 한국정밀공학회 2003년도 춘계학술대회 논문집
    • /
    • pp.1697-1700
    • /
    • 2003
  • We propose a new technique for real-time controller design of a autonomous cruise mobile robot with three drive wheels. The proposed control scheme uses a Gaussian function as a unit function in the fuzzy neural network, and a back propagation algorithm to train the fuzzy neural network controller in the framework of the specialized learning architecture. It is proposed a learning controller consisting of two neural network-fuzzy based on independent reasoning and a connection net with fixed weights to simply the neural networks-fuzzy. The control performance of the proposed controller is illustrated by performing the computer simulation for trajectory tracking of the speed and azimuth of a autonomous cruise mobile robot driven by three independent wheels.

  • PDF

이동로봇의 자율주행을 위한 실시간 퍼지신경망 제어 (Real-Time Fuzzy Neural Network Control for Real-Time Autonomous Cruise of Mobile Robot)

  • 정동연;김종수;한성현
    • 한국공작기계학회:학술대회논문집
    • /
    • 한국공작기계학회 2003년도 춘계학술대회 논문집
    • /
    • pp.312-318
    • /
    • 2003
  • We propose a new technique for the cruise control system design of a mobile robot with three drive wheel. The proposed control scheme uses a Gaussian function as a unit function in the fuzzy neural network and back propagation algorithm to train the fuzzy neural network controller in the framework of the specialized teaming architecture. It is proposed a learning controller consisting of too neural network-fuzzy based on independent reasoning and a connection net with fixed weights to simply the neural networks-fuzzy. The performance of the proposed controller is shown by performing the computer simulation for trajectory tracking of the speed and azimuth of a mobile robot driven by three independent wheels.

  • PDF

신경회로망을 이용한 조합 논리회로의 테스트 생성 (Test Generation for Combinational Logic Circuits Using Neural Networks)

  • 김영우;임인칠
    • 전자공학회논문지A
    • /
    • 제30A권9호
    • /
    • pp.71-79
    • /
    • 1993
  • This paper proposes a new test pattern generation methodology for combinational logic circuits using neural networks based on a modular structure. The CUT (Circuit Under Test) is described in our gate level hardware description language. By conferring neural database, the CUT is compiled to an ATPG (Automatic Test Pattern Generation) neural network. Each logic gate in CUT is represented as a discrete Hopfield network. Such a neual network is called a gate module in this paper. All the gate modules for a CUT form an ATPG neural network by connecting each module through message passing paths by which the states of modules are transferred to their adjacent modules. A fault is injected by setting the activation values of some neurons at given values and by invalidating connections between some gate modules. A test pattern for an injected fault is obtained when all gate modules in the ATPG neural network are stabilized through evolution and mutual interactions. The proposed methodology is efficient for test generation, known to be NP-complete, through its massive paralelism. Some results on combinational logic circuits confirm the feasibility of the proposed methodology.

  • PDF

퍼지-신경망 제어기법을 이용한 Mobile Robot의 지능제어 (Intelligent Control of Mobile robot Using Fuzzy Neural Network Control Method)

  • 정동연;김용태;한성현
    • 한국공작기계학회:학술대회논문집
    • /
    • 한국공작기계학회 2002년도 추계학술대회 논문집
    • /
    • pp.235-240
    • /
    • 2002
  • This paper presents a new approach to the design of cruise control system of a mobile robot with two drive wheel. The proposed control scheme uses a Gaussian function as a unit function in the fuzzy neural network, and back propagation algorithm to train the fuzzy neural network controller in the framework of the specialized learning architecture. It is proposed a learning controller consisting of two neural network-fuzzy based on independent reasoning and a connection net with fixed weights to simply the neural networks-fuzzy. The performance of the proposed controller is shown by performing the computer simulation for trajectory tracking of the speed and azimuth of a mobile robot driven by two independent wheels.

  • PDF

퍼지-신경회로망 제어기법에 의한 궤도차량의 지능제어 (An Intelligent Control of TRack Vehicle Using Fuzzy-Neural Network Control Method)

  • 신행봉;김용태;조길수;한성현
    • 한국공작기계학회:학술대회논문집
    • /
    • 한국공작기계학회 1999년도 춘계학술대회 논문집
    • /
    • pp.210-215
    • /
    • 1999
  • In this paper, a new approach to the dynamic control technique for track vehicle system using fuzzy-neural network control technique is proposed. The proposed control scheme uses a Gaussian function as a unit function in the neural network-fuzzy, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learning architecture. It is proposed a learning controller consisting of two neural network-fuzzy based on independent reasoning and a connection net with fixed weights to simply the neural networks-fuzzy. The performance of the proposed controller is shown by simulation for trajectory tracking of the speed and azimuth of a track vehicle.

  • PDF