• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.23 no.1
• /
• pp.7-13
• /
• 2023

This study investigated the criteria for evaluating the impact of artificial intelligence services. The study classified AI evaluation targets into two areas: AI service and AI technology, and identified influence, sustainability, efficiency, effectiveness, and appropriateness as potential evaluation criteria. The time aspect of AI service evaluation was divided into pre-evaluation and post-evaluation, with pre-evaluation focused on reviewing items during development and design. The AI service area was classified into public, private, and mixed forms, and the impact assessment was classified as vertical or horizontal. The application of AI services was divided into normative and regulatory aspects, and the purpose of the evaluation could be impact or process evaluation. The subject and field of the AI service could also be used for classification purposes. The results of this study can be used to support the creation of AI service impact policies and countermeasures. However, further research is needed to develop specific indicators based on the criteria identified in this study to evaluate the impact of AI services.

• Proceedings of the Korean Society of Disaster Information Conference
• /
• 2022.10a
• /
• pp.337-338
• /
• 2022

시퀀스제어는 제조, 유통, 건설, 의료 산업분야의 기계, 전기, 전자, 자동화 등에 응용되어 널리 사용하고 있다. 4차산업의 발전으로 제어분야에 인공지능 융합 기술이 산업에 중요한 요소가 되어가고 있다. 특히 기존 시스템에 마이크로프로세서와 인공지능이 융합된 설비의 안전성과 혁신성을 평가하고 신뢰성 높은 장비개발이 요구되고 있어 교육목적의 장비를 개발하여 해당분야의 발전을 견인하고자 한다. 자체 개발한 일체형 인공지능 컨트롤러 모듈은 기존의 시퀀스 및 PLC제어 회로에 인공지능 능력을 융합한 장비이다. 본 장비의 성능평가항목으로 동작, 음성, 문자, 색상 등의 인식 능력과 회로의 안정성, 신뢰성을 평가하였다. 시퀀스 및 PLC 회로를 설계 후 융합된 일체형 인공지능 컨트롤러 모듈의 성능평가항목이 모두 만족하였고 회로의 안전성과 신뢰성에 문제가 없는 것으로 나타났다.

• Advanced Industrial SCIence
• /
• v.1 no.1
• /
• pp.28-34
• /
• 2022

Many studies have been conducted on software quality evaluation. Recently, as artificial intelligence-related software has been developed a lot, research on methods for evaluating artificial intelligence functions in existing software is being conducted. Software evaluation has been based on eight quality characteristics: functional suitability, reliability, usability, maintainability, performance efficiency, portability, compatibility, and security. Research on the part that needs to be confirmed through evaluation of the function of the intelligence part is in progress. This study intends to introduce the contents of the evaluation method in this part. We are going to propose a quality evaluation method for artificial intelligence software by presenting the existing software quality evaluation method and the part to be considered in the AI part.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.22 no.5
• /
• pp.147-157
• /
• 2022

The purpose of this study is to establish policy recommendations for the promotion of AI service impact assessment based on the definition of impact assessment and analysis of domestic and foreign AI service impact assessment cases. The direction of implementation was analyzed based on the case of impact evaluation promoted in various fields at home and abroad and the case of impact evaluation at home and abroad of artificial intelligence services. As a step-by-step implementation plan, in the first stage, quantitative indicators such as AI level survey-based economic effects are developed, and in the second stage, information culture such as safety and reliability and artificial intelligence ethics described in the Framework Act on Intelligence Information, social, economic, information protection, and people's daily lives are prepared. In the third stage, discussion on detailed metrics and methods will be expanded and impact assessment results will be evaluated. This study requires analysis through various participants such as policy designers, artificial intelligence service developers, and civic groups in the future.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2021.05a
• /
• pp.274-276
• /
• 2021

As artificial intelligence develops rapidly, we can experience it in our everyday life such as with medical, education, and game applications. Traditional SW services were programmed explicitly by the intention of the programmer, and we have conducted evaluation on it. However, due to the uncertianty of AI services, risk follows to the products. Therefore, UX evaluations need to be different from traditional UX evaluations. Therefore, in this paper we suggest a AI-UX framework that consideres the task delegability, UX evaluations metrics, and individual differences.

• Journal of IKEEE
• /
• v.27 no.3
• /
• pp.350-354
• /
• 2023

This paper describes ISO/IEC TR 24029-1, an international standard to evaluate the performance of artificial intelligence systems. ISO/IEC TR 24029-1 defines the performance measures of artificial intelligence systems in two categories, i.e. interpolation and classificiation. Performance measures in the interpolation categories mean how much the predicted values of the artificial intelligence system is close to the real values. Performance measures in the classification categories mean how much the predicted classes of the artificial intelligence system is equal to the real classes. Based on these performance measures, performance of artificial intelligence systems can be evaluated and performance of different artificial intelligence systems can be compared.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2022.07a
• /
• pp.401-402
• /
• 2022

본 연구에서는 중학생의 인공지능 리터러시와 인공지능 리터러시에 영향을 주는 요인(성별, 인공지능 관련 경험, 인공지능에 대한 관심)을 조사·분석하였다. 연구 결과, 중학생의 인공지능 리터러시는 여성보다 남성이 높았다. 모든 세부 요인에서 유의한 차이는 아니었지만, 인공지능 문제 해결과 관련된 세부 요인은 남성이 더 높은 것으로 나타났다. 인공지능 관련 경험은 인공지능 간접 경험, 직접 경험, 교육 경험이 있는 학생이 경험이 없는 학생보다 인공지능 리터러시가 높았다. 마지막으로 인공지능에 대한 관심이 높을수록 인공지능 리터러시가 높았다.

• Journal of the Korea Convergence Society
• /
• v.13 no.1
• /
• pp.109-118
• /
• 2022

The purpose of this study is to identify trends in the application of artificial intelligence by analyzing upper extremity movement assessment and artificial intelligence convergence research using a systematic literature review method. The research was conducted using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Among the 380 articles searched in three databases, 8 articles were finally selected according to the selection and exclusion criteria. For the evaluation of upper extremity movement, motion performance evaluation, FMA, and ARAT were used. For quantification, data were extracted using various tools, and upper extremity movement classification, recovery prognosis prediction, and evaluation tool score were predicted using artificial intelligence. This study is meaningful in that it systematically reviewed studies that objectively evaluated upper extremity movement using artificial intelligence and identified the direction in which artificial intelligence is being applied. Based on this, the introduction of artificial intelligence technology in the assessment of upper extremity movements is expected to help objectively identify the intervention effect and the patient's recovery.

• Communications of Mathematical Education
• /
• v.37 no.2
• /
• pp.159-181
• /
• 2023

The purpose of this study is to explore secondary mathematics teachers' perceptions on Artificial Intelligence (AI). For this purpose, we conducted three focus group interviews with 18 secondary in-service mathematics teachers and analyzed their perceptions on AI for math and math for AI. The secondary in-service mathematics teachers perceive that AI allows to implement different types of mathematics instruction but has limitations in exploring students' mathematical thinking and having emotional interactions with students. They also perceive that AI makes it easy to develop assessment items for teachers but teachers' interventions are needed for grading essay-type assessment items. Lastly, the secondary in-service mathematics teachers agree the rationale of adopting the subject ＜Artificial Intelligence Mathematics＞ and its needs for students, but they perceive that they are not well prepared yet to teach the subject and do not have sufficient resources for teaching the subject and assessing students' understanding about the subject. The findings provide implications and insights for developing individualized AI learning tools for students in the secondary level, providing AI assessment tools for teachers, and offering professional development programs for teachers to increase their understanding about the subject.

• Proceedings of the Korea Contents Association Conference
• /
• 2018.05a
• /
• pp.89-90
• /
• 2018

최근 4차 산업혁명의 핵심분야로 부상한 인공지능 기술에 미국, 중국, 일본, EU 등 주요국가와 국내 인공지능 기술수준을 보다 신뢰성 높은 전문가, 특허, 논문 등 다차원 평가를 통해 객관적인 기술수준 평가와 이를 바탕으로 인공지능 분야의 기술경쟁력 확보를 위한 연구개발(R&D) 투자전략 수립 및 사업 추진에 대한 기본방향 설정에 대한 기술경영 프레임워크를 제안한다.