• Title/Summary/Keyword: Q learning

Search Result 426, Processing Time 0.027 seconds

Mobile Application for Real-Time Monitoring of Concentration Based on fNIRS (fNIRS 기반 실시간 집중력 모니터링 모바일 애플리케이션)

  • Kang, Sunhwa;Lee, Hyeonju;Na, Heewon;Dong, Suh-Yeon
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.2
    • /
    • pp.295-304
    • /
    • 2021
  • Learning assistance system that continuously measures user's concentration will be helpful to grasp the concentration pattern and adjust the learning method accordingly to improve the learning efficiency. Although a lot of various learning aids have been proposed, there have been few studies on the concentration monitoring system in real time. Therefore, in this study, we developed an Android-based mobile application that can measure concentration during study by using functional near-infrared spectroscopy, which is used to measure brain activity. First, the task accuracy was predicted at a maximum level of 93.75% from the prefrontal oxygenation characteristics measured while performing the visual Q&A task on 11 college students, and a concentration calculation formula based on a linear regression model was derived. Then, a survey on the usability of the mobile application was conducted, overall high satisfaction and positive opinions were obtained. From these findings, this application can be used as a customized learning aid application for users, and further, it can help educators improve the quality of classes based on the level of concentration of learners.

Work, Labor! What do you think about ? ; Using the Q-methodology (일, 노동, 당신은 어떻게 생각하십니까?: Q방법론을 활용하여)

  • Lee, Soon-Hee;Jung, Myoung-Ja;Lee, Doh-Hee
    • The Journal of the Korea Contents Association
    • /
    • v.20 no.12
    • /
    • pp.547-554
    • /
    • 2020
  • This study attempted to examine how we really think about our daily duties, work, and labor, and what it means. In particular, in this study, using the Q-methodology, one of the "qualitative studies," diagnosed and categorized general workers' thoughts about their work and labor. Accordingly, the following analysis results were derived. First, as a result of the analysis, three types were derived, and the types were named as follows based on the Q statement emphasized by each type. emphasizes statements such as 'blessing/happiness', 'rest', 'lover', and 'reward' for work, and labor was named 「Positive Type」. was named as 「Negative Type」 because statements such as 'painfulness', 'the beginning of the day', 'duty', and 'war' were emphasized. In , 'colleagues and friends' and 'learning' were positive, and 'beginning of the day', 'duty', and 'rest' were expressed as negative statements, so it was named as 「Positive Neutral Type」. 'Work' and 'labor', which are indispensable beings in our daily life, are blessings that must be done, happiness, and co-workers and friends, but the value of their existence is possible when appropriate 'resting' is assumed. In addition, Q methodology is expected to be confirmed as an empirical study in the future, as well as usefulness as a hypothesis abductive approach.

Recommendation System of University Major Subject based on Deep Reinforcement Learning (심층 강화학습 기반의 대학 전공과목 추천 시스템)

  • Ducsun Lim;Youn-A Min;Dongkyun Lim
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.23 no.4
    • /
    • pp.9-15
    • /
    • 2023
  • Existing simple statistics-based recommendation systems rely solely on students' course enrollment history data, making it difficult to identify classes that match students' preferences. To address this issue, this study proposes a personalized major subject recommendation system based on deep reinforcement learning (DRL). This system gauges the similarity between students based on structured data, such as the student's department, grade level, and course history. Based on this information, it recommends the most suitable major subjects by comprehensively considering information about each available major subject and evaluations of the student's courses. We confirmed that this DRL-based recommendation system provides useful insights for university students while selecting their major subjects, and our simulation results indicate that it outperforms conventional statistics-based recommendation systems by approximately 20%. In light of these results, we propose a new system that offers personalized subject recommendations by incorporating students' course evaluations. This system is expected to assist students significantly in finding major subjects that align with their preferences and academic goals.

Characteristics of Junior Ranger Activity Books of U.S. National Parks and Their Implications for Geomorphological Education in Korea (미국 국립공원 주니어레인저 워크북 특성 및 국내 지형교육에의 시사점)

  • Kim, Taeho
    • Journal of The Geomorphological Association of Korea
    • /
    • v.28 no.1
    • /
    • pp.101-114
    • /
    • 2021
  • Junior Ranger is a self-directed interpretation program for young visitors at national parks in the United States. The success of this program can be largely attributed to the role of an activity book which is given an applicant free of charge at a visitor center. This study aims to analyze the main characteristics of activity books for 14 national parks' Junior Ranger and to draw some implications for Korean geomorphological education. Although the activity books are varied in size, volume and printing, all of them offer diverse activities which are composed of different contents related to park resources in four fields and are performed in different ways such as Q&A, picture and word game, and creative activity. The time-consuming activities including attendance at a ranger-led program prevent the participant from making a superficial visit to be a junior ranger. The implications of the study are as follows: Firstly, the geomorphological education for children is needed to be strongly based on field experience learning and to be more carried out using a way of game rather than conventional Q&A, suggesting that it encourages students not to lose their interest for learning. Secondly, it is also necessary for the learning contents to be focused on various resources related to landform as well as landform itself. In addition, a creative activity such as writing verse or drawing feeling should be more applied to the geomorphological education in order to enhance their effects on affective domain beyond cognitive one. It is likely to be an alternative approach to understand landform by internalizing a sense of landform.

Trading Strategies Using Reinforcement Learning (강화학습을 이용한 트레이딩 전략)

  • Cho, Hyunmin;Shin, Hyun Joon
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.22 no.1
    • /
    • pp.123-130
    • /
    • 2021
  • With the recent developments in computer technology, there has been an increasing interest in the field of machine learning. This also has led to a significant increase in real business cases of machine learning theory in various sectors. In finance, it has been a major challenge to predict the future value of financial products. Since the 1980s, the finance industry has relied on technical and fundamental analysis for this prediction. For future value prediction models using machine learning, model design is of paramount importance to respond to market variables. Therefore, this paper quantitatively predicts the stock price movements of individual stocks listed on the KOSPI market using machine learning techniques; specifically, the reinforcement learning model. The DQN and A2C algorithms proposed by Google Deep Mind in 2013 are used for the reinforcement learning and they are applied to the stock trading strategies. In addition, through experiments, an input value to increase the cumulative profit is selected and its superiority is verified by comparison with comparative algorithms.

Comparison of the effectiveness of SW-based maker education in online environment: From the perspective of self-efficacy, learning motivation, and interest (비대면 온라인 환경에서 SW기반 메이커교육의 효과성 비교: 자기효능감, 학습동기, 흥미도의 관점에서)

  • Kim, Tae-ryeong;Han, Sun-gwan
    • Journal of The Korean Association of Information Education
    • /
    • v.25 no.3
    • /
    • pp.571-578
    • /
    • 2021
  • This study compares Online SW-based maker education in terms of self-efficacy, learning motivation, and interest after applying differently according to blended learning strategies. First, a SW maker program for blended learning was developed and applied as a live seminar-type class including real-time interactive and a support-providing class consisting of online content and Q&A. As a result of comparing the differences between students according to the two strategies divided into pre- and post- survey, in the self-efficacy part, there was a significant difference in the positive efficacy and the overall part, and in the learning motivation part, the live seminar form was significantly higher in the confidence part. In the interest part, the support-providing form showed a significantly higher average in the instrumental interest and nervous part. In order to maintain the effect of maker activities like existing face-to-face situations in Online learning, it is necessary to increase sharing time between students, an integrated learning environment, and sufficient provision of exploration time and learning materials.

Study for Feature Selection Based on Multi-Agent Reinforcement Learning (다중 에이전트 강화학습 기반 특징 선택에 대한 연구)

  • Kim, Miin-Woo;Bae, Jin-Hee;Wang, Bo-Hyun;Lim, Joon-Shik
    • Journal of Digital Convergence
    • /
    • v.19 no.12
    • /
    • pp.347-352
    • /
    • 2021
  • In this paper, we propose a method for finding feature subsets that are effective for classification in an input dataset by using a multi-agent reinforcement learning method. In the field of machine learning, it is crucial to find features suitable for classification. A dataset may have numerous features; while some features may be effective for classification or prediction, others may have little or rather negative effects on results. In machine learning problems, feature selection for increasing classification or prediction accuracy is a critical problem. To solve this problem, we proposed a feature selection method based on reinforced learning. Each feature has one agent, which determines whether the feature is selected. After obtaining corresponding rewards for each feature that is selected, but not by the agents, the Q-value of each agent is updated by comparing the rewards. The reward comparison of the two subsets helps agents determine whether their actions were right. These processes are performed as many times as the number of episodes, and finally, features are selected. As a result of applying this method to the Wisconsin Breast Cancer, Spambase, Musk, and Colon Cancer datasets, accuracy improvements of 0.0385, 0.0904, 0.1252 and 0.2055 were shown, respectively, and finally, classification accuracies of 0.9789, 0.9311, 0.9691 and 0.9474 were achieved, respectively. It was proved that our proposed method could properly select features that were effective for classification and increase classification accuracy.

Design of Web-based Edutech System for Improving Interaction in Online Class (온라인 수업의 상호작용 향상을 위한 웹 기반 에듀테크 시스템의 설계)

  • Jang, Ui-Young;Cho, Dae-Soo;Park, Seungmin
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2022.07a
    • /
    • pp.723-724
    • /
    • 2022
  • 지난 코로나 상황 동안 비대면 수업을 진행했고, 학생들은 빠르게 적응했다. 온라인 수업은 학습자가 이해될 때까지 반복 학습이 가능하고, 시간과 공간의 제약 없이 자기 주도적으로 학습할 수 있다는 장점이 있지만, 온라인상이라는 특징 때문에 교수자와 학습자 간 상호작용이 부족하다는 한계점이 존재한다. 하지만 이점은 차후에 비대면 수업의 지속적인 활용 및 확대를 제한하는 요인이 될 수 있다. 본 논문에서는 상호작용을 높일 수 있는 웹 기반 에듀테크 시스템을 제안한다. 온라인 수업의 강의 영상을 세부적인 내용을 나누는 Section을 통해 다른 학생들이 질문했던 Q&A 데이터를 모아서 생성된 Section-FAQ를 열람할 수 있고, 그 Q&A에 반응해서 상호작용이 가능하다. 또한 교수자에게 Q&A를 보낼 때 영상의 Section 정보와 강의시간 정보를 같이 전송하여 강의 영상을 확인하지 않고, 빠른 답변이 가능하도록 설계했다. 본 논문에서 제안하는 온라인 수업의 상호작용 향상을 위한 웹 기반 에듀테크 시스템을 통해 온라인상에서 교수자의 역할을 대신해주고 비대면 수업의 단점을 해소해주면서, 교수자과 학습자 간의 상호작용을 높여 수업의 이해도를 높이고 학습자들의 학업성취를 높일 수 있을 것이다.

  • PDF

SOM_Based Generalization for Multiagent Reinforcement Learning (다중 에이전트 강화학습을 위한 SOM 기반의 일반화)

  • Lim, Mun-Tack;Kim, In-Cheol
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2002.04a
    • /
    • pp.565-568
    • /
    • 2002
  • 본 논문에서는 에이전트간의 통신이 불가능한 다중 에이전트 환경에서 각 에이전트들이 독립적이면서 대표적인 강화학습법인 Q-학습을 전개함으로써 서로 효과적으로 협조할 수 있는 행동전략을 학습하려고 한다. 하지만 단일 에이전트 경우에 비해 보다 큰 상태-행동공간을 갖는 다중 에이전트환경에서는 강화학습을 통해 효과적으로 최적의 행동 전략에 도달하기 어렵다는 문제점이 있다. 이 문제에 대한 기존의 접근방법은 크게 모듈화 방법과 일반화 방법이 제안되었으나 모두 나름의 제한을 가지고 있다. 본 논문에서는 대표적인 다중 에이전트 학습 문제의 예로서 the Prey and Hunters Problem를 소개하고 이 문제영역을 통해 이와 같은 강화학습의 문제점을 살펴보고, 해결책으로 신경망 SOM 을 이용한 일반화 방법을 제안한다. 이 방법은 다층 퍼셉트론 신경망과 역전파 알고리즘을 이용한 기존의 일반화 방법과는 달리 군집화 기능을 제공하는 신경망 SOM 을 이용함으로써 명확한 다수의 훈련 예가 없어도 효과적으로 채 경험하지 못한 상태-행동들에 대한 Q 값을 예측하고 이용할 수 있다는 장점이 있다.

  • PDF

Automatic Processing of Predicative Nouns for Korean Semantic Recognition. (한국어 의미역 인식을 위한 서술성 명사의 자동처리 연구)

  • Lee, Sukeui;Im, Su-Jong
    • Korean Linguistics
    • /
    • v.80
    • /
    • pp.151-175
    • /
    • 2018
  • This paper proposed a method of semantic recognition to improve the extraction of correct answers of the Q&A system through machine learning. For this purpose, the semantic recognition method is described based on the distribution of predicative nouns. Predicative noun vocabularies and sentences were collected from Wikipedia documents. The predicative nouns are typed by analyzing the environment in which the predicative nouns appear in sentences. This paper proposes a semantic recognition method of predicative nouns to which rules can be applied. In Chapter 2, previous studies on predicative nouns were reviewed. Chapter 3 explains how predicative nouns are distributed. In this paper, every predicative nouns that can not be processed by rules are excluded, therefore, the predicative nouns noun forms combined with the case marker '의' were excluded. In Chapter 4, we extracted 728 sentences composed of 10,575 words from Wikipedia. A semantic analysis engine tool of ETRI was used and presented a predicative nouns noun that can be handled semantic recognition language.