• Journal of Korea Society of Digital Industry and Information Management
• /
• v.19 no.2
• /
• pp.135-145
• /
• 2023

ChatGPT is an artificial intelligence-based conversation agent developed by OpenAI using natural language processing technology. In this study, an empirical study was conducted on incumbent teachers on the intention to use the newly emerged Chat GPT. First, we studied how accuracy, entertainment, system accessibility, perceived usefulness, and perceived ease of use affect ChatGPT's acceptance intention. In addition, we analyzed whether perceived usefulness and perceived ease of use differ in the intention to accept depending on the digital technology of teachers. As a result of the study, the suitability of the structural equation model was generally good. Accuracy and entertainment were found to have a significant effect on perceived usefulness, and system accessibility was found to have a significant effect on perceived ease of use. In the analysis of teachers' digital technology control effects, it was found that perceived usefulness and perceived ease of use had a control effect between acceptance intentions. It was found that the group with high digital skills of teachers was strongly intended to accept the service regardless of perceived usefulness and ease of use. In the group with low digital skills of teachers, it is thought that ChatGPT's service shows the acceptance intention only when the perceived usefulness and ease of use are high. Therefore, in the group with low digital technology, it is necessary to seek teaching activities such as the development of instructional models using ChatGPT.

• Journal of Medicine and Life Science
• /
• v.20 no.2
• /
• pp.53-59
• /
• 2023

This study explores the potential use of artificial intelligence (AI)-based services, specifically ChatGPT-3.5, in medical education. The application of this technology is acknowledged as a valuable tool for simulating authentic clinical scenarios and enhancing learners' diagnostic and communication skills. To construct a case, students received ChatGPT training using a clinical ethics casebook titled "Clinical Ethics Cases and Commentaries for Medical Students and Physicians." Subsequently, a role-play script was generated based on this training. The initial draft of the script was reviewed by two medical professors and was further optimized using ChatGPT-3.5. Consequently, a comprehensive role-play script, accurately reflecting real-world clinical situations, was successfully developed. This study demonstrates the potential for effectively integrating AI technology into medical education and provides a solution to overcome limitations in developing role-play scripts within conventional educational settings. However, the study acknowledges that AI cannot always generate flawless role-play scripts and recognizes the necessity of addressing these limitations and ethical concerns. The research explores both the potential and limitations of employing AI in the early stages of medical education, suggesting that future studies should focus on overcoming these limitations while further investigating the potential applications of AI in this field.

• Journal of dental hygiene science
• /
• v.24 no.1
• /
• pp.62-70
• /
• 2024

Background: This study aimed to evaluate ChatGPT's performance accuracy in responding to questions from the national dental hygienist examination. Moreover, through an analysis of ChatGPT's incorrect responses, this research intended to pinpoint the predominant types of errors. Methods: To evaluate ChatGPT-3.5's performance according to the type of national examination questions, the researchers classified 200 questions of the 49th National Dental Hygienist Examination into recall, interpretation, and solving type questions. The researchers strategically modified the questions to counteract potential misunderstandings from implied meanings or technical terminology in Korea. To assess ChatGPT-3.5's problem-solving capabilities in applying previously acquired knowledge, the questions were first converted to subjective type. If ChatGPT-3.5 generated an incorrect response, an original multiple-choice framework was provided again. Two hundred questions were input into ChatGPT-3.5 and the generated responses were analyzed. After using ChatGPT, the accuracy of each response was evaluated by researchers according to the types of questions, and the types of incorrect responses were categorized (logical, information, and statistical errors). Finally, hallucination was evaluated when ChatGPT provided misleading information by answering something that was not true as if it were true. Results: ChatGPT's responses to the national examination were 45.5% accurate. Accuracy by question type was 60.3% for recall and 13.0% for problem-solving type questions. The accuracy rate for the subjective solving questions was 13.0%, while the accuracy for the objective questions increased to 43.5%. The most common types of incorrect responses were logical errors 65.1% of all. Of the total 102 incorrectly answered questions, 100 were categorized as hallucinations. Conclusion: ChatGPT-3.5 was found to be limited in its ability to provide evidence-based correct responses to the Korean national dental hygiene examination. Therefore, dental hygienists in the education or clinical fields should be careful to use artificial intelligence-generated materials with a critical view.

• Knowledge Management Research
• /
• v.25 no.2
• /
• pp.19-47
• /
• 2024

Organizational ability to analyze and utilize data plays an important role in knowledge management and decision-making. This study aims to investigate the potential application of large language models in corporate data analysis. Focusing on the field of human resources, the research examines the data analysis capabilities of these models. Using the widely studied IBM HR dataset, the study reproduces machine learning-based employee turnover prediction analyses from previous research through ChatGPT and compares its predictive performance. Unlike past research methods that required advanced programming skills, ChatGPT-based machine learning data analysis, conducted through the analyst's natural language requests, offers the advantages of being much easier and faster. Moreover, its prediction accuracy was found to be competitive compared to previous studies. This suggests that large language models could serve as effective and practical alternatives in the field of corporate data analysis, which has traditionally demanded advanced programming capabilities. Furthermore, this approach is expected to contribute to the popularization of data analysis and the spread of data-driven decision-making (DDDM). The prompts used during the data analysis process and the program code generated by ChatGPT are also included in the appendix for verification, providing a foundation for future data analysis research using large language models.

• The Transactions of the Korea Information Processing Society
• /
• v.13 no.3
• /
• pp.148-155
• /
• 2024

Despite the increasing importance of irony and sarcasm detection in the field of natural language processing, research on the Korean language is relatively scarce compared to other languages. This study aims to experiment with various models for irony detection in Korean text. The study conducted irony detection experiments using KoBERT, a BERT-based model, and ChatGPT. For KoBERT, two methods of additional training on sentiment data were applied (Transfer Learning and MultiTask Learning). Additionally, for ChatGPT, the Few-Shot Learning technique was applied by increasing the number of example sentences entered as prompts. The results of the experiments showed that the Transfer Learning and MultiTask Learning models, which were trained with additional sentiment data, outperformed the baseline model without additional sentiment data. On the other hand, ChatGPT exhibited significantly lower performance compared to KoBERT, and increasing the number of example sentences did not lead to a noticeable improvement in performance. In conclusion, this study suggests that a model based on KoBERT is more suitable for irony detection than ChatGPT, and it highlights the potential contribution of additional training on sentiment data to improve irony detection performance.

• Journal of The Korean Association of Information Education
• /
• v.26 no.3
• /
• pp.197-207
• /
• 2022

In this paper, we develop a machine learning based block code generation and recommendation model for the purpose of reducing cognitive load of learners during coding education that learns the learner's block that has been made in the block programming environment using natural processing model and fine-tuning and then generates and recommends the selectable blocks for the next step. To develop the model, the training dataset was produced by pre-processing 50 block codes that were on the popular block programming language web site 'Entry'. Also, after dividing the pre-processed blocks into training dataset, verification dataset and test dataset, we developed a model that generates block codes based on LSTM, Seq2Seq, and GPT-2 model. In the results of the performance evaluation of the developed model, GPT-2 showed a higher performance than the LSTM and Seq2Seq model in the BLEU and ROUGE scores which measure sentence similarity. The data results generated through the GPT-2 model, show that the performance was relatively similar in the BLEU and ROUGE scores except for the case where the number of blocks was 1 or 17.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.34 no.2
• /
• pp.207-216
• /
• 2024

As big data was built due to the 4th Industrial Revolution, personalized services increased rapidly. As a result, the amount of personal information collected from online services has increased, and concerns about users' personal information leakage and privacy infringement have increased. Online service providers provide privacy policies to address concerns about privacy infringement of users, but privacy policies are often misused due to the long and complex problem that it is difficult for users to directly identify risk items. Therefore, there is a need for a method that can automatically check whether the privacy policy is safe. However, the safety verification technique of the conventional blacklist and machine learning-based privacy policy has a problem that is difficult to expand or has low accessibility. In this paper, to solve the problem, we propose a safety verification technique for the privacy policy using the GPT-3.5 API, which is a generative artificial intelligence. Classification work can be performed evenin a new environment, and it shows the possibility that the general public without expertise can easily inspect the privacy policy. In the experiment, how accurately the blacklist-based privacy policy and the GPT-based privacy policy classify safe and unsafe sentences and the time spent on classification was measured. According to the experimental results, the proposed technique showed 10.34% higher accuracy on average than the conventional blacklist-based sentence safety verification technique.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2023.05a
• /
• pp.430-431
• /
• 2023

본 논문에서는 GPT-4 기반의 채용공고별 AI 자소서 작성 가이드 개인화 서비스를 제안한다. 이 서비스는 지원자들에게 시간 절약과 효율적으로 작성된 글을 제공하며, 기업의 요구사항과 지원자의 역량을 최대한 반영한 경쟁력 있는 자기소개서를 작성할 수 있다. 본 연구는 기존의 템플릿 기반 글 작성 서비스의 한계를 극복하고, 인공지능 기반의 GPT-4 를 활용하여 개인화된 글 작성을 가능하게 한다. 시스템 구현을 통해 최적화된 프롬프트를 연구하며, 이 방법론은 자기소개서 외 다양한 분야의 글 작성에도 활용될 수 있다. 이 서비스의 활용으로 지원자들의 경쟁력이 높아지고, 기업들은 더 적합한 인재를 찾는 데 도움을 받을 수 있을 것으로 기대된다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2023.05a
• /
• pp.437-439
• /
• 2023

본 연구는 프로그래밍 협업 환경에서 생성형 AI인 ChatGPT-4를 활용한 코딩 프로세스를 제안한다. 일관성 있는 결과를 얻기 위해 프롬프트 생성, GPT 실행, 의사코드 변환, 코드 비교, 동일 코드 생성 여부 판단, 테스트 실행, 동일 결과 생성 여부 판단, 코드 검사 및 수정의 8단계를 거친다. 팀 프로젝트와 페어 프로그래밍 등의 다양한 협업 환경에 적용 가능한 이 프로세스를 통해 생성형 AI를 효과적으로 활용할 수 있음을 보여주었다는 점에서 그 의미가 있다. 본 연구는 생성형 AI를 활용한 협업 환경에서의 코딩이 본격적으로 이루어질 것으로 예상되는 이 시점에서, 인간-AI 협업 환경에서의 코딩 효율성 및 일관성을 높일 수 있을 것으로 기대한다. 이러한 연구는 인간과 AI가 함께 작업하는 미래를 위한 기초를 마련하는 데 중요한 역할을 할 것이다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2023.05a
• /
• pp.667-669
• /
• 2023

데이터의 균형은 객체 인식 분야에서 영향을 미치는 요인 중 하나이다. 본 논문에서는 폐기물 데이터 균형을 위해 Chat-GPT와 Diffusion model 기반 데이터 생성 모델을 제안한다. Chat-GPT를 사용하여 폐기물의 속성에 해당하는 단어를 생성하도록 질문하고, 생성된 단어는 인코더를 통해 벡터화시킨다. 이 중 폐기물과 관련 없는 단어를 삭제 후, 남은 단어들을 결합하는 전처리 과정을 거친다. 결합한 벡터는 디코더를 통해 텍스트 데이터로 변환 후, Stable Diffusion model에 입력되어 텍스트와 상응하는 폐기물 데이터를 생성한다. 이 데이터는 AI Hub의 공공 데이터를 활용하며, 객체 인식 모델인 YOLOv5로 학습해 F1-score와 mAP로 평가한다.