• 제목/요약/키워드: experience-based learning algorithm

검색결과 65건 처리시간 0.02초

Nonlinear identification of Bouc-Wen hysteretic parameters using improved experience-based learning algorithm

  • Luo, Weili;Zheng, Tongyi;Tong, Huawei;Zhou, Yun;Lu, Zhongrong
    • Structural Engineering and Mechanics
    • /
    • 제76권1호
    • /
    • pp.101-114
    • /
    • 2020
  • In this paper, an improved experience-based learning algorithm (EBL), termed as IEBL, is proposed to solve the nonlinear hysteretic parameter identification problem with Bouc-Wen model. A quasi-opposition-based learning mechanism and new updating equations are introduced to improve both the exploration and exploitation abilities of the algorithm. Numerical studies on a single-degree-of-freedom system without/with viscous damping are conducted to investigate the efficiency and robustness of the proposed algorithm. A laboratory test of seven lead-filled steel tube dampers is presented and their hysteretic parameters are also successfully identified with normalized mean square error values less than 2.97%. Both numerical and laboratory results confirm that, in comparison with EBL, CMFOA, SSA, and Jaya, the IEBL is superior in nonlinear hysteretic parameter identification in terms of convergence and accuracy even under measurement noise.

Vibration-based delamination detection of composites using modal data and experience-based learning algorithm

  • Luo, Weili;Wang, Hui;Li, Yadong;Liang, Xing;Zheng, Tongyi
    • Steel and Composite Structures
    • /
    • 제42권5호
    • /
    • pp.685-697
    • /
    • 2022
  • In this paper, a vibration-based method using the change ratios of modal data and the experience-based learning algorithm is presented for quantifying the position, size, and interface layer of delamination in laminated composites. Three types of objective functions are examined and compared, including the ones using frequency changes only, mode shape changes only, and their combination. A fine three-dimensional FE model with constraint equations is utilized to extract modal data. A series of numerical experiments is carried out on an eight-layer quasi-isotropic symmetric (0/-45/45/90)s composited beam for investigating the influence of the objective function, the number of modal data, the noise level, and the optimization algorithms. Numerical results confirm that the frequency-and-mode-shape-changes-based technique yields excellent results in all the three delamination variables of the composites and the addition of mode shape information greatly improves the accuracy of interface layer prediction. Moreover, the EBL outperforms the other three state-of-the-art optimization algorithms for vibration-based delamination detection of composites. A laboratory test on six CFRP beams validates the frequency-and-mode-shape-changes-based technique and confirms again its superiority for delamination detection of composites.

Deep Reinforcement Learning based Tourism Experience Path Finding

  • Kyung-Hee Park;Juntae Kim
    • Journal of Platform Technology
    • /
    • 제11권6호
    • /
    • pp.21-27
    • /
    • 2023
  • In this paper, we introduce a reinforcement learning-based algorithm for personalized tourist path recommendations. The algorithm employs a reinforcement learning agent to explore tourist regions and identify optimal paths that are expected to enhance tourism experiences. The concept of tourism experience is defined through points of interest (POI) located along tourist paths within the tourist area. These metrics are quantified through aggregated evaluation scores derived from reviews submitted by past visitors. In the experimental setup, the foundational learning model used to find tour paths is the Deep Q-Network (DQN). Despite the limited availability of historical tourist behavior data, the agent adeptly learns travel paths by incorporating preference scores of tourist POIs and spatial information of the travel area.

  • PDF

A3C 기반의 강화학습을 사용한 DASH 시스템 (A DASH System Using the A3C-based Deep Reinforcement Learning)

  • 최민제;임경식
    • 대한임베디드공학회논문지
    • /
    • 제17권5호
    • /
    • pp.297-307
    • /
    • 2022
  • The simple procedural segment selection algorithm commonly used in Dynamic Adaptive Streaming over HTTP (DASH) reveals severe weakness to provide high-quality streaming services in the integrated mobile networks of various wired and wireless links. A major issue could be how to properly cope with dynamically changing underlying network conditions. The key to meet it should be to make the segment selection algorithm much more adaptive to fluctuation of network traffics. This paper presents a system architecture that replaces the existing procedural segment selection algorithm with a deep reinforcement learning algorithm based on the Asynchronous Advantage Actor-Critic (A3C). The distributed A3C-based deep learning server is designed and implemented to allow multiple clients in different network conditions to stream videos simultaneously, collect learning data quickly, and learn asynchronously, resulting in greatly improved learning speed as the number of video clients increases. The performance analysis shows that the proposed algorithm outperforms both the conventional DASH algorithm and the Deep Q-Network algorithm in terms of the user's quality of experience and the speed of deep learning.

Adaptive Learning Path Recommendation based on Graph Theory and an Improved Immune Algorithm

  • BIAN, Cun-Ling;WANG, De-Liang;LIU, Shi-Yu;LU, Wei-Gang;DONG, Jun-Yu
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제13권5호
    • /
    • pp.2277-2298
    • /
    • 2019
  • Adaptive learning in e-learning has garnered researchers' interest. In it, learning resources could be recommended automatically to achieve a personalized learning experience. There are various ways to realize it. One of the realistic ways is adaptive learning path recommendation, in which learning resources are provided according to learners' requirements. This paper summarizes existing works and proposes an innovative approach. Firstly, a learner-centred concept map is created using graph theory based on the features of the learners and concepts. Then, the approach generates a linear concept sequence from the concept map using the proposed traversal algorithm. Finally, Learning Objects (LOs), which are the smallest concrete units that make up a learning path, are organized based on the concept sequences. In order to realize this step, we model it as a multi-objective combinatorial optimization problem, and an improved immune algorithm (IIA) is proposed to solve it. In the experimental stage, a series of simulated experiments are conducted on nine datasets with different levels of complexity. The results show that the proposed algorithm increases the computational efficiency and effectiveness. Moreover, an empirical study is carried out to validate the proposed approach from a pedagogical view. Compared with a self-selection based approach and the other evolutionary algorithm based approaches, the proposed approach produces better outcomes in terms of learners' homework, final exam grades and satisfaction.

초등 정보 영재의 알고리즘 학습을 위한 퍼즐의 교육적 활용 (Educational Application of Puzzles for Algorithm Learning of Informatics Gifted Elementary School Students)

  • 최정원;이영준
    • 한국컴퓨터정보학회논문지
    • /
    • 제20권5호
    • /
    • pp.151-159
    • /
    • 2015
  • 알고리즘은 문제를 효과적이고 효율적으로 해결하기 위해 필요한 문제 해결 과정을 설계하는 기법을 다루기 때문에 컴퓨터 과학을 배우는 사람이라면 반드시 학습해야 하는 영역이다. 알고리즘 교육은 학습자들이 알고리즘을 설계하는 기법을 익히는 것 뿐 아니라 학습한 알고리즘 기법을 문제를 해결하는 데 적절히 활용할 수 있는 능력을 함께 익힐 때 효과적이다. 특히 사회적으로 커다란 영향을 미칠 가능성을 가진 정보 영재 학생들을 대상으로 하는 교육 활성화에 대한 인식이 확산되기 시작하면서 이들을 어떻게 가르칠 것인가에 대한 관심이 고조되고 있다. 따라서 본 연구에서는 정보 영재 학습자들이 알고리즘 설계 기법을 보다 쉽게 학습하고 문제를 해결하는 데 활용하는 방법을 익힐 수 있도록 하기 위하여 퍼즐을 도입하였다. 연구 결과 퍼즐 기반의 알고리즘 학습이 전통적인 알고리즘 학습 방법에 비해 학습자들에게 긍정적인 영향을 준 것을 확인할 수 있었다. 이러한 결과는 학습자들이 퍼즐 기반 알고리즘 학습을 통해 알고리즘 설계 기법을 적용하는 다양한 문제 해결 경험을 함으로써 흥미와 학습의 전이가 향상된 것이라 해석할 수 있다.

자기학습 규칙베이스 조립알고리즘 (A self-learning rule-based assembly algorithm)

  • 박용길;조형석
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1992년도 한국자동제어학술회의논문집(국내학술편); KOEX, Seoul; 19-21 Oct. 1992
    • /
    • pp.1072-1077
    • /
    • 1992
  • In ths paper a new active assembly algorithm for chamferless precision parts mating, is considered. The successful assembly task requires an extremely high position accuracy and a good knowledge of mating parts. However, conventional assembly mehtod alone makes it difficult to achieve satisfactory assembly performance because of the complexity and the uncertainties of the process and its environments such as imperfect knowledge of the parts being assembled as well as the limitation of the devices performing the assebled as well as the limitation of the devices performing the assembly. To cope with these problems, a self-learning rule-based assembly algorithm is proposed by intergaring fuzzy set theory and neural network. In this algortihm, fuzzy set theory copes with the complexity and the uncertainties of the assembly process, while neural network enhances the assembly schemen so as to learn fuzzy rules form experience and adapt to changes in environment of uncertainty and imprecision. The performance of the proposed assembly algorithm is evaluated through a series of experiments. The results show that the self-learning fuzzy assembly scheme can be effecitively applied to chamferless precision parts mating.

  • PDF

E-learning system to improve the endoscopic diagnosis of early gastric cancer

  • Kenshi Yao;Takashi Yao;Noriya Uedo;Hisashi Doyama;Hideki Ishikawa;Satoshi Nimura;Yuichi Takahashi
    • Clinical Endoscopy
    • /
    • 제57권3호
    • /
    • pp.283-292
    • /
    • 2024
  • We developed three e-learning systems for endoscopists to acquire the necessary skills to improve the diagnosis of early gastric cancer (EGC) and demonstrated their usefulness using randomized controlled trials. The subjects of the three e-learning systems were "detection", "characterization", and "preoperative assessment". The contents of each e-learning system included "technique", "knowledge", and "obtaining experience". All e-learning systems proved useful for endoscopists to learn how to diagnose EGC. Lecture videos describing "the technique" and "the knowledge" can be beneficial. In addition, repeating 100 self-study cases allows learners to gain "experience" and improve their diagnostic skills further. Web-based e-learning systems have more advantages than other teaching methods because the number of participants is unlimited. Histopathological diagnosis is the gold standard for the diagnosis of gastric cancer. Therefore, we developed a comprehensive diagnostic algorithm to standardize the histopathological diagnosis of gastric cancer. Once we have successfully shown that this algorithm is helpful for the accurate histopathological diagnosis of cancer, we will complete a series of e-learning systems designed to assess EGC accurately.

심층 강화학습을 이용한 모바일 로봇의 맵 기반 장애물 회피 알고리즘 (Map-Based Obstacle Avoidance Algorithm for Mobile Robot Using Deep Reinforcement Learning)

  • 선우영민;이원창
    • 전기전자학회논문지
    • /
    • 제25권2호
    • /
    • pp.337-343
    • /
    • 2021
  • 심층 강화학습은 학습자가 가공되지 않은 고차원의 입력 데이터를 기반으로 최적의 행동을 선택할 수 있게 하는 인공지능 알고리즘이며, 이를 이용하여 장애물들이 존재하는 환경에서 모바일 로봇의 최적 이동 경로를 생성하는 연구가 많이 진행되었다. 본 논문에서는 복잡한 주변 환경의 이미지로부터 모바일 로봇의 이동 경로를 생성하기 위하여 우선 순위 경험 재사용(Prioritized Experience Replay)을 사용하는 Dueling Double DQN(D3QN) 알고리즘을 선택하였다. 가상의 환경은 로봇 시뮬레이터인 Webots를 사용하여 구현하였고, 시뮬레이션을 통해 모바일 로봇이 실시간으로 장애물의 위치를 파악하고 회피하여 목표 지점에 도달하는 것을 확인하였다.

Learner Perception of an Educational Recommender System based on Relative Importance of Learner Variables

  • Woorin HWANG;Hyo-Jeong SO
    • Educational Technology International
    • /
    • 제25권2호
    • /
    • pp.231-260
    • /
    • 2024
  • This study suggests that educational recommender systems should be explainable and extend beyond the commercially driven algorithms that primarily rely on user preferences and purchase behaviors. Instead, we propose a recommendation method that considers how and why people learn by employing the relative importance of various learner variables. To develop a recommendation algorithm, 100 adult participants used 4 to 6 foreign language learning mobile applications(apps), generating a dataset of 557 user perception reports. Using this data, we designed and developed a recommender system based on the importance weights of 14 learner variables, categorized into four groups: (a) demographic information, (b) motivational orientation for language learning (instrumental vs. integrative), (c) learning styles, and (d) learning experience. The results based on RandomForestRegressor model revealed that language learning motivation, learning styles (specifically information processing), and usage frequency were significantly more influential than general demographic factors in predicting learners' evaluation of the apps. Furthermore, learners' perception of the recommender system revealed that the recommender system was relevant and engaging, effectively meeting their needs and assisting them in selecting appropriate language learning apps. Overall, this study demonstrates the potential of educational recommender systems that consider learners' motivation, experience, and learning styles.