• 제목/요약/키워드: Memory-Based Learning

검색결과 556건 처리시간 0.034초

유아 언어학습에 대한 하이퍼망 메모리 기반 모델 (Hypernetwork Memory-Based Model for Infant's Language Learning)

  • 이지훈;이은석;장병탁
    • 한국정보과학회논문지:컴퓨팅의 실제 및 레터
    • /
    • 제15권12호
    • /
    • pp.983-987
    • /
    • 2009
  • 유아들의 언어습득에 있어서 중요한 점 하나는 학습자에 대한 언어환경의 노출이다. 유아가 접하는 언어환경은 부모와 같은 인간뿐만 아니라 각종 미디어와 같은 인공적 환경도 포함되며, 유아는 이러한 방대한 언어환경을 탐색하면서 언어를 학습한다. 본 연구는 대용량의 언어 데이터 노출이 영향을 미치는 유아언어학습을 유연하고 적절하게 모사하는 인지적 기제에 따른 기계학습 방식을 제안한다. 유아의 초기 언어학습은 문장수준의 학습과 생성 같은 행동들이 수반되는데, 이는 언어 코퍼스에 대한 노출만으로 모사가 가능하다. 모사의 핵심은 언어 하이퍼망 구조를 가진 기억기반 학습모델이다. 언어 하이퍼망은 언어구성 요소들 간의 상위차원 관계 표상을 가능케 함으로써 새로운 데이터 스트림에 대해 유사구조의 적용과 이용을 도모하여 발달적이고 점진적인 학습을 모사한다. 본 연구에서는 11 개의 유아용 비디오로부터 추출한 문장 32744개를 언어 하이퍼망을 통한 점진적 학습을 수행하여 문장을 생성해 유아의 점진적, 발달적 학습을 모사하였다.

Considering Read and Write Characteristics of Page Access Separately for Efficient Memory Management

  • Hyokyung Bahn
    • International journal of advanced smart convergence
    • /
    • 제12권1호
    • /
    • pp.70-75
    • /
    • 2023
  • With the recent proliferation of memory-intensive workloads such as deep learning, analyzing memory access characteristics for efficient memory management is becoming increasingly important. Since read and write operations in memory access have different characteristics, an efficient memory management policy should take into accountthe characteristics of thesetwo operationsseparately. Although some previous studies have considered the different characteristics of reads and writes, they require a modified hardware architecture supporting read bits and write bits. Unlike previous approaches, we propose a software-based management policy under the existing memory architecture for considering read/write characteristics. The proposed policy logically partitions memory space into the read/write area and the write area by making use of reference bits and dirty bits provided in modern paging systems. Simulation experiments with memory access traces show that our approach performs better than the CLOCK algorithm by 23% on average, and the effect is similar to the previous policy with hardware support.

Solving Continuous Action/State Problem in Q-Learning Using Extended Rule Based Fuzzy Inference System

  • Kim, Min-Soeng;Lee, Ju-Jang
    • Transactions on Control, Automation and Systems Engineering
    • /
    • 제3권3호
    • /
    • pp.170-175
    • /
    • 2001
  • Q-learning is a kind of reinforcement learning where the agent solves the given task based on rewards received from the environment. Most research done in the field of Q-learning has focused on discrete domains, although the environment with which the agent must interact is generally continuous. Thus we need to devise some methods that enable Q-learning to be applicable to the continuous problem domain. In this paper, an extended fuzzy rule is proposed so that it can incorporate Q-learning. The interpolation technique, which is widely used in memory-based learning, is adopted to represent the appropriate Q value for current state and action pair in each extended fuzzy rule. The resulting structure based on the fuzzy inference system has the capability of solving the continuous state about the environment. The effectiveness of the proposed structure is shown through simulation on the cart-pole system.

  • PDF

퍼지 이론을 이용한 학습오인 진단 시스템 설계 및 구현 (A Design and Implementation of Diagnosis System of Learning Misconception by Using Fuzzy Theory)

  • 이현노;라상숙;최영식
    • 디지털융복합연구
    • /
    • 제4권2호
    • /
    • pp.143-151
    • /
    • 2006
  • The purpose of this paper is to make a design and implementation of a diagnosis system of learning misconception of students who learn 'be' verb in the English language by using fuzzy theory. In this system, a fuzzy cognitive map exposes the fact that students' perception and misunderstanding about 'the English' language have an intertwined relationship, and diagnoses causes of misconceptions of students by using fuzzy memory associative memory. It suggests that since most existing systems of rule based expert system have had several limitations, this system will be applied to diagnose learners' misconception of learning in varieties of education areas.

  • PDF

퍼지 이론을 이용한 영어학습 진단 시스템 설계 및 구현 (A Design and Implementation of Diagnosis System of Learning Misconception by Using Fuzzy Theory)

  • 이현노;라상숙;최영식
    • 한국디지털정책학회:학술대회논문집
    • /
    • 한국디지털정책학회 2006년도 춘계학술대회
    • /
    • pp.451-459
    • /
    • 2006
  • The purpose of this paper is to make a design and implementation of a diagnosis system of learning misconception of students who learn 'be' verb in the English language by using fuzzy theory. In this system, a fuzzy cognitive map exposes the fact that students' perception and misunderstanding about 'the English' language have an intertwined relationship, and diagnoses causes of misconceptions of students by using fuzzy memory associative memory. It suggests that since most existing systems of rule based expert system have had several limitations, this system will be applied to diagnose learners' misconception of learning in varieties of education areas.

  • PDF

A hybrid deep learning model for predicting the residual displacement spectra under near-fault ground motions

  • Mingkang Wei;Chenghao Song;Xiaobin Hu
    • Earthquakes and Structures
    • /
    • 제25권1호
    • /
    • pp.15-26
    • /
    • 2023
  • It is of great importance to assess the residual displacement demand in the performance-based seismic design. In this paper, a hybrid deep learning model for predicting the residual displacement spectra under near-fault (NF) ground motions is proposed by combining the long short-term memory network (LSTM) and back-propagation (BP) network. The model is featured by its capacity of predicting the residual displacement spectrum under a given NF ground motion while considering the effects of structural parameters. To construct this model, 315 natural and artificial NF ground motions were employed to compute the residual displacement spectra through elastoplastic time history analysis considering different structural parameters. Based on the resulted dataset with a total of 9,450 samples, the proposed model was finally trained and tested. The results show that the proposed model has a satisfactory accuracy as well as a high efficiency in predicting residual displacement spectra under given NF ground motions while considering the impacts of structural parameters.

Optimize rainfall prediction utilize multivariate time series, seasonal adjustment and Stacked Long short term memory

  • Nguyen, Thi Huong;Kwon, Yoon Jeong;Yoo, Je-Ho;Kwon, Hyun-Han
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2021년도 학술발표회
    • /
    • pp.373-373
    • /
    • 2021
  • Rainfall forecasting is an important issue that is applied in many areas, such as agriculture, flood warning, and water resources management. In this context, this study proposed a statistical and machine learning-based forecasting model for monthly rainfall. The Bayesian Gaussian process was chosen to optimize the hyperparameters of the Stacked Long Short-term memory (SLSTM) model. The proposed SLSTM model was applied for predicting monthly precipitation of Seoul station, South Korea. Data were retrieved from the Korea Meteorological Administration (KMA) in the period between 1960 and 2019. Four schemes were examined in this study: (i) prediction with only rainfall; (ii) with deseasonalized rainfall; (iii) with rainfall and minimum temperature; (iv) with deseasonalized rainfall and minimum temperature. The error of predicted rainfall based on the root mean squared error (RMSE), 16-17 mm, is relatively small compared with the average monthly rainfall at Seoul station is 117mm. The results showed scheme (iv) gives the best prediction result. Therefore, this approach is more straightforward than the hydrological and hydraulic models, which request much more input data. The result indicated that a deep learning network could be applied successfully in the hydrology field. Overall, the proposed method is promising, given a good solution for rainfall prediction.

  • PDF

DG-based SPO tuple recognition using self-attention M-Bi-LSTM

  • Jung, Joon-young
    • ETRI Journal
    • /
    • 제44권3호
    • /
    • pp.438-449
    • /
    • 2022
  • This study proposes a dependency grammar-based self-attention multilayered bidirectional long short-term memory (DG-M-Bi-LSTM) model for subject-predicate-object (SPO) tuple recognition from natural language (NL) sentences. To add recent knowledge to the knowledge base autonomously, it is essential to extract knowledge from numerous NL data. Therefore, this study proposes a high-accuracy SPO tuple recognition model that requires a small amount of learning data to extract knowledge from NL sentences. The accuracy of SPO tuple recognition using DG-M-Bi-LSTM is compared with that using NL-based self-attention multilayered bidirectional LSTM, DG-based bidirectional encoder representations from transformers (BERT), and NL-based BERT to evaluate its effectiveness. The DG-M-Bi-LSTM model achieves the best results in terms of recognition accuracy for extracting SPO tuples from NL sentences even if it has fewer deep neural network (DNN) parameters than BERT. In particular, its accuracy is better than that of BERT when the learning data are limited. Additionally, its pretrained DNN parameters can be applied to other domains because it learns the structural relations in NL sentences.

에너지 인터넷을 위한 GRU기반 전력사용량 예측 (Prediction of Power Consumptions Based on Gated Recurrent Unit for Internet of Energy)

  • 이동구;선영규;심이삭;황유민;김수환;김진영
    • 전기전자학회논문지
    • /
    • 제23권1호
    • /
    • pp.120-126
    • /
    • 2019
  • 최근 에너지 인터넷에서 지능형 원격검침 인프라를 이용하여 확보된 대량의 전력사용데이터를 기반으로 효과적인 전력수요 예측을 위해 다양한 기계학습기법에 관한 연구가 활발히 진행되고 있다. 본 연구에서는 전력량 데이터와 같은 시계열 데이터에 대해 효율적으로 패턴인식을 수행하는 인공지능 네트워크인 Gated Recurrent Unit(GRU)을 기반으로 딥 러닝 모델을 제안하고, 실제 가정의 전력사용량 데이터를 토대로 예측 성능을 분석한다. 제안한 학습 모델의 예측 성능과 기존의 Long Short Term Memory (LSTM) 인공지능 네트워크 기반의 전력량 예측 성능을 비교하며, 성능평가 지표로써 Mean Squared Error (MSE), Mean Absolute Error (MAE), Forecast Skill Score, Normalized Root Mean Squared Error (RMSE), Normalized Mean Bias Error (NMBE)를 이용한다. 실험 결과에서 GRU기반의 제안한 시계열 데이터 예측 모델의 전력량 수요 예측 성능이 개선되는 것을 확인한다.

장단기 메모리 기반 노인 낙상감지에 대한 연구 (Study of fall detection for the elderly based on long short-term memory(LSTM))

  • 정승수;유윤섭
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국정보통신학회 2021년도 춘계학술대회
    • /
    • pp.249-251
    • /
    • 2021
  • 본 논문에서는 노령층 인구가 도보시 일어날 수 있는 낙상상황을 텐서플로워를 이용하여 인지하기 위한 시스템에 대하여 소개한다. 낙상감지는 고령자의 몸에 착용한 가속센서 데이터에 대해서 텐서플로워를 이용하여 학습된 LSTM(long short-term memory)을 기반하여 낙상과 일상생활을 판별한다. 각각 7가지의 행동 패턴들에 대하여 학습을 실행하며, 4가지는 일상생활에서 일어나는 행동 패턴이고, 나머지 3가지는 낙상시의 패턴에 대하여 학습한다. 3축 가속도 센서의 가공하지 않은 데이터와 가공한 SVM(Sum Vector Magnitude)를 이용하여 LSTM에 적용해서 학습하였다. 이 두 가지 경우에 대해서 테스트한 결과 데이터를 혼합하여 학습하면 더 좋은 결과를 기대할 수 있을 것으로 예상된다.

  • PDF