• Title/Summary/Keyword: Comprehension task

Search Result 79, Processing Time 0.02 seconds

Korean Machine Reading Comprehension using Continual Learning (Continual Learning을 이용한 한국어 기계독해)

  • Shin, JoongMin;Cho, Sanghyun;Choi, Jaehoon;Kwon, Hyuk-Chul
    • Annual Conference on Human and Language Technology
    • /
    • 2021.10a
    • /
    • pp.609-611
    • /
    • 2021
  • 기계 독해는 주어진 지문 내에서 질문에 대한 답을 기계가 찾아 답하는 문제이다. 딥러닝에서는 여러 데이터셋을 학습시킬 때에 이전에 학습했던 데이터의 weight값이 점차 사라지고 사라진 데이터에 대해 테스트 하였을때 성능이 떨어진 결과를 보인다. 이를 과거에 학습시킨 데이터의 정보를 계속 가진 채로 새로운 데이터를 학습할 수 있는 Continual learning을 통해 해결할 수 있고, 본 논문에서는 이 방법을 MRC에 적용시켜 학습시킨 후 한국어 자연어처리 Task인 Korquad 1.0의 MRC dev set을 통해 성능을 측정하였다. 세 개의 데이터셋중에서 랜덤하게 5만개를 추출하여 10stage를 학습시킨 50K 모델에서 추가로 Continual Learning의 Learning without Forgetting를 사용하여 학습시킨 50K-LWF 모델이 F1 92.57, EM 80.14의 성능을 보였고, BERT 베이스라인 모델의 성능 F1 91.68, EM 79.92에 비교하였을 때 F1, EM 각 0.89, 0.22의 향상이 있었다.

  • PDF

KorQuAD 2.0: Korean QA Dataset for Web Document Machine Comprehension (KorQuAD 2.0: 웹문서 기계독해를 위한 한국어 질의응답 데이터셋)

  • Kim, Youngmin;Lim, Seungyoung;Lee, Hyunjeong;Park, Soyoon;Kim, Myungji
    • Annual Conference on Human and Language Technology
    • /
    • 2019.10a
    • /
    • pp.97-102
    • /
    • 2019
  • KorQuAD 2.0은 총 100,000+ 쌍으로 구성된 한국어 질의응답 데이터셋이다. 기존 질의응답 표준 데이터인 KorQuAD 1.0과의 차이점은 크게 세가지가 있는데 첫 번째는 주어지는 지문이 한두 문단이 아닌 위키백과 한 페이지 전체라는 점이다. 두 번째로 지문에 표와 리스트도 포함되어 있기 때문에 HTML tag로 구조화된 문서에 대한 이해가 필요하다. 마지막으로 답변이 단어 혹은 구의 단위뿐 아니라 문단, 표, 리스트 전체를 포괄하는 긴 영역이 될 수 있다. Baseline 모델로 구글이 오픈소스로 공개한 BERT Multilingual을 활용하여 실험한 결과 F1 스코어 46.0%의 성능을 확인하였다. 이는 사람의 F1 점수 85.7%에 비해 매우 낮은 점수로, 본 데이터가 도전적인 과제임을 알 수 있다. 본 데이터의 공개를 통해 평문에 국한되어 있던 질의응답의 대상을 다양한 길이와 형식을 가진 real world task로 확장하고자 한다.

  • PDF

The Effect of Cohesive Devices on Memory and Understanding of Scientific Text (응집장치가 과학텍스트의 기억과 이해에 미치는 효과)

  • 김세영;한광희;조숙환
    • Korean Journal of Cognitive Science
    • /
    • v.13 no.2
    • /
    • pp.1-13
    • /
    • 2002
  • This Paper is concerned with the impact of linguistic markers of coherence, such as causal connectives. repetitions. and anchoring devices. on the comprehension of a scientific text in Korean. A scientific text on the process of lightning formation was selected. and two versions of the text were constructed by varying the strength of coherence. Eighty-two undergraduate students took Part in the experiment in which they were instructed to fill in the blanks in each text in a recall and a recognition task and to respond to a set of question in a comprehension test. The results of this experiment revealed a selective effect of the cohesive markers. It was found that the different linguistic signals seem to Play a facilitating role in varying degrees in accordance with the type of tasks involved Moreover an analysis of topic continuity from the beginning paragraphs through the last revealed that the text was better understood in the paragraphs containing the main topic better than those without it. This finding seems to indicate that the off-line processing of scientific text is not influenced solely by the local bottom-up processing alone The effect of topic continuity seems to suggest that a global. top-down processing effect has an important role to play. overriding the impact of cohesive devices.

  • PDF

Needs Analysis Case Using Key Competencies of National Competency Standards (국가직무능력표준(NCS) 직업기초능력 기반의 직군별 요구역량 : 국내 대기업 A사를 중심으로)

  • Yoon, Duk-Won;Woo, Hye-Jung;Ghang, Bong-Jun;Kim, Yoon-Ho
    • The Journal of the Korea Contents Association
    • /
    • v.16 no.12
    • /
    • pp.383-398
    • /
    • 2016
  • The objective of this research is to depict examples of how a company could derive the skillset areas with the highest priority when analyzing the skill set requirements of human resources, based on the skillset requirements that are unique to each work site. For this purpose, a survey was conducted for each of the job categories for new employee in A company. The analysis results showed that in 32 out of the 34 areas, the gaps between the current levels and the expected levels were statistically significant. For employees of company A, the following 7 areas were determined to be the key job competencies with the highest priority: document creation skills, diagram creation skills, thinking skills, problem solving skills, time management skills, technology comprehension ability, and task comprehension skills. The required job competencies with the highest priority were found to be different for each job category. As a result of this research, the priority rankings of skillset requirements for each job category in company A could be determined, along with the implications for HRD/HRM and other companies.

Reengineering of TACT Process Management Analyzed on Task Information (업무정보 분석을 통한 TACT공정관리 프로세스 재설계)

  • Kim, Ok-Kyue;Park, Jun-Mo;Kim, Beop-Su
    • Korean Journal of Construction Engineering and Management
    • /
    • v.13 no.5
    • /
    • pp.113-124
    • /
    • 2012
  • TACT process reengineering is applied to the finish work of apartment buildings and extra tall buildings to conduct efficient process control in Korea. Non-systemized information on the performances, however, causes difficulties in building a database for such records and it takes long time to find the relevant information. In order to solve such problems, scientific and quantitative understanding on the construction information and data is required to perform TACT process reengineering satisfactorily and also proper management plan should be provided for the working level staff to understand the required information and data more easily. In this regard, this paper reorganizes the TACT process reengineering based on the general process control and classifies the items of required information to redesign. Redesigned process was verified by specialists making use of work-information matrix. As a result, paper contributed to increasing comprehension level of the working level people and when the persons in charge are transferred to other duty, it makes them understand all the working procedure faster, which enables the departments involved to carry out their cooperation and adjustment more efficiently.

Hybrid Learning for Vision-and-Language Navigation Agents (시각-언어 이동 에이전트를 위한 복합 학습)

  • Oh, Suntaek;Kim, Incheol
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.9 no.9
    • /
    • pp.281-290
    • /
    • 2020
  • The Vision-and-Language Navigation(VLN) task is a complex intelligence problem that requires both visual and language comprehension skills. In this paper, we propose a new learning model for visual-language navigation agents. The model adopts a hybrid learning that combines imitation learning based on demo data and reinforcement learning based on action reward. Therefore, this model can meet both problems of imitation learning that can be biased to the demo data and reinforcement learning with relatively low data efficiency. In addition, the proposed model uses a novel path-based reward function designed to solve the problem of existing goal-based reward functions. In this paper, we demonstrate the high performance of the proposed model through various experiments using both Matterport3D simulation environment and R2R benchmark dataset.

Development of Language Rehabilitation Program Using the Smart Device-based Application (스마트 기기 기반 언어재활 프로그램 개발)

  • Hwang, Yu Mi;Park, Kinam;Jung, Young Hee;Pyun, Sung-Bom
    • Journal of Digital Convergence
    • /
    • v.17 no.10
    • /
    • pp.321-327
    • /
    • 2019
  • The purpose of this study is to develop a smart device-based Language Rehabilitation Program (LRP) to improve communication ability for the patients with language disability. The content of the LRP includes a variety of semantic categories and grammatical elements and consists of 17 semantic categories, 29 tasks and 3780 items to improve comprehension/production ability at word level, semantic category level, sentence level and discourse level. We developed LRP as a Windows-base management program and an Android-base language rehabilitation application. LRP was developed into an application for smart devices, providing real-time delivery of training contents, measurement and database of training task results, and patient progress and monitoring. A follow-up study will be conducted on the verification of the language rehabilitation effect using LRP by patients with language disability.

Effective Teaching-Learning Activities in Flipped, Direct, Cooperative, and Distance Learning Model (거꾸로 수업, 직접교수법, 협동학습, 실시간 화상수업을 조합한 수업에서의 효과적인 교수학습활동)

  • Kil, Yangsook
    • The Journal of the Convergence on Culture Technology
    • /
    • v.8 no.1
    • /
    • pp.121-129
    • /
    • 2022
  • This study explored effective teaching-learning activities under the hybrid teaching model combining flipped learning, direct instruction, cooperative learning and distance learning. Subjects were 99 college students enrolled in 2 teacher preparation courses. Students evaluated effectiveness of 22 teaching-learning activities according to Likert scale at the end of the semester. As a result, all 22 teaching learning activities were considered effective more or less. They facilitated motivation, comprehension, participation, thinking, and led to mastery of the task. ② Activities scored low were 'questioning and answering at the beginning of online class', 'open book test'. ③ Hybrid teaching model was favored over traditional instruction. Open ended responses were consistent with the ones in the questionnaire. This research supports the notion that key teaching models to be combined for successful flipped learning in college setting are direct instruction and cooperative learning. Furthermore, effective and ineffective teaching strategies for flipped learning were found.

The Effects of Gender Cue and Antecedent Case on the Immediacy of Pronominal Resolution (대명사의 성별단서와 선행어 격이 참조해결의 즉각성에 미치는 효과)

  • JaehoLee
    • Korean Journal of Cognitive Science
    • /
    • v.4 no.1
    • /
    • pp.51-86
    • /
    • 1993
  • The purpose of this study was to investigate on-line comprehension processing in pronoun resolution. The two important constraints investigated in this study were the gender cue of pronoun and the antecedent case. Using antecedent probe recognition task. Experiment 1 investigated the effects of gender cues and antecedent cases on probe recognition time. There were on signigicant effects of employed variable. This result suggest the possibilty of immediate antecedent assignment depending on the degree of syntactic constraints satisfaction. In Experiment 2. using antecedent probe recognition task. the primed activation level differences between antecedents and non-antecedents over time-course intervals from 0 to 250msec were measured. The effect of gender cues was obtained over 0-250msec time-course condition. This indicates that the gender cues can determine the assignment of proper antecedent for a pronoun. In Experiment 3, subect-case pronouns were used only:Unambiguous gender cues were given and the time-course intervals of 250 and 750msec were employed. A signigicant interaction effect of antecedent cases with probe conditions was obtained. All the results of this research suggest that gender cues are powerful constraints for pronoun resolution.

A Stidy on the Real Management of Experimental-practice and Spot-practice at Department of Food and Nutrition of Junior College in Korea (전문대학 식품영양과의 실험실습 및 현장실습 운영실태에 관한 연구)

  • Yun, Seong-Sik;So, Myeong-Hwan;Nam, Gung-Seok
    • The Korean Journal of Food And Nutrition
    • /
    • v.2 no.1
    • /
    • pp.61-72
    • /
    • 1989
  • This study was conducted to gather the baseline data on realities of experimental-practice and opinions toward spot-practice, and to examine how to cope with the problems raised at the Department of Food and Nutrition of Junior Technical College in Korea. Questionnaires were gathered from 42 chairmans of the Department of Food and Nutrition and 140 Present dieticians worked in Seoul, Bucheon am Seongnam area. The results are as follows, First, as a whole, each college had 2~3 experimental laboratory (Lab), in which Cooking Science Lab. Chemistry Lab and Microbiology Lab were occurred at higher frequency as Lab's name. Second, the numbers per experimental-practice class were more than 40 at most colleges. 85% of Present dieticians have answered to feel too much numbers per the class during their college days, whereas professors' opinions toward the numbers per class were suitable at 20~30 persons per class. Third, professors' opinion toward the adquate ratio of the theory subject classes to experimental subject classes was suitable at 60 : 40. Dieticians answered to take the theory subject classes partly or mostly on behalf of the experimental-practice classes. Fourth, the main reasons which inhibited normal experimental-practice class were the class for emphasis on examination, the shortage of experiment budget, the excess of class members, the shortage of experimental Lab Also, this results showed same propensity to present dieticians' opinion toward the same question above. Fifth, among the experimenta1-practice subjects established at the Department of Food and Nutrition, Diet Therapy Lab was highest frequency class emphasized on theory followed by Nutrition Counselling Lab, Food Processing and Storage Lab, Food Hygiene Lab and Food Microbiology Lab in that order. Here, Basic Chemistry Lab, Biochemistry Lab, Food Microbiology Lab were pointed as subjects far from the present task of dieticians. Sixth, Department of Food and Nutrition, as a whole, has conferred with spot-practice arrangement About 50% (all who want to join spot-practice) of second year students took part in spot-practice. In the other way, all colleges except for 2 colleges didn't give the credit for the spot-practice system. Seventh, according to the on analysis on spot-practice places, manufacturing company was at highest frequcney followed by hospitals, elementary school having group feeding system in that order. Especially, 16.7% (5 colleges) of the total colleges sent the students to the research institute related to food industry for spot-practice experience. Eighth, Professors' opinions toward the spot-practice time and period were preferable on summer vacation of second year and for 1~2 weeks, respectively. On the contrary, 74 dieticians answered to the adquate period as for 4 weeks. Ninth, 86 dieticians of the total 140 answered to complete the spot-practice during their college days, which helps the present task of them. Lacks of spot-practice program, Lacks of comprehension of upper personals and lacks of group feeding equipments ranks higher as difficulties in spot-practice management.

  • PDF