• Title/Summary/Keyword: performance evaluation report

Search Result 213, Processing Time 0.028 seconds

Development of checklist questions to measure AI capabilities of elementary school students (초등학생의 AI 역량 측정을 위한 체크리스트 문항 개발)

  • Eun Chul Lee;YoungShin Pyun
    • Journal of Internet of Things and Convergence
    • /
    • v.10 no.3
    • /
    • pp.7-12
    • /
    • 2024
  • The development of artificial intelligence technology changes the social structure and educational environment, and the importance of artificial intelligence capabilities continues to increase. This study was conducted with the purpose of developing a checklist of questions to measure AI capabilities of elementary school students. To achieve the purpose of the study, a Delphi survey was used to analyze literature and develop questions. For literature analysis, two domestic studies, five international studies, and the Ministry of Education's curriculum report were collected through a search. The collected data was analyzed to construct core competency measurement elements. The core competency measurement elements consisted of understanding artificial intelligence (6 elements), artificial intelligence thinking (4 elements), artificial intelligence ethics (4 elements), and artificial intelligence social-emotion (3 elements). Considering the knowledge, skills, and attitudes of the constructed measurement elements, 19 questions were developed. The developed questions were verified through the first Delphi survey, and 7 questions were revised according to the revision opinions. The validity of 19 questions was verified through the second Delphi survey. The checklist items developed in this study are measured by teacher evaluation based on performance and behavioral observations rather than a self-report questionnaire. This has the implication that the measurement results of competency are raised to a reliable level.

Development of checklist questions to measure AI core competencies of middle school students (중학생의 AI 핵심역량 측정을 위한 체크리스트 문항 개발)

  • Eun Chul Lee;JungSoo Han
    • Journal of Internet of Things and Convergence
    • /
    • v.10 no.3
    • /
    • pp.49-55
    • /
    • 2024
  • This study was conducted with the purpose of developing a checklist of questions to measure middle school students' AI capabilities. To achieve the goal of the study, literature analysis and question development Delphi survey were used. For literature analysis, two domestic studies, five international studies, and the Ministry of Education's curriculum report were collected through a search. The collected data was analyzed to construct core competency measurement elements. The core competency measurement elements are understanding of artificial intelligence (5 elements), artificial intelligence thinking (5 elements), utilization of artificial intelligence (4 elements), artificial intelligence ethics (6 elements), and artificial intelligence social-emotion (6 elements). elements). Considering the knowledge, skills, and attitudes of the constructed measurement elements, 31 questions were developed. The developed questions were verified through the first Delphi survey, and 10 questions were revised according to the revision opinions. The validity of 31 questions was verified through the second Delphi survey. The checklist items developed in this study are measured by teacher evaluation based on performance and behavioral observations rather than a self-report questionnaire. This has the implication that the level of reliability of measurement results increases.

A PLS Path Modeling Approach on the Cause-and-Effect Relationships among BSC Critical Success Factors for IT Organizations (PLS 경로모형을 이용한 IT 조직의 BSC 성공요인간의 인과관계 분석)

  • Lee, Jung-Hoon;Shin, Taek-Soo;Lim, Jong-Ho
    • Asia pacific journal of information systems
    • /
    • v.17 no.4
    • /
    • pp.207-228
    • /
    • 2007
  • Measuring Information Technology(IT) organizations' activities have been limited to mainly measure financial indicators for a long time. However, according to the multifarious functions of Information System, a number of researches have been done for the new trends on measurement methodologies that come with financial measurement as well as new measurement methods. Especially, the researches on IT Balanced Scorecard(BSC), concept from BSC measuring IT activities have been done as well in recent years. BSC provides more advantages than only integration of non-financial measures in a performance measurement system. The core of BSC rests on the cause-and-effect relationships between measures to allow prediction of value chain performance measures to allow prediction of value chain performance measures, communication, and realization of the corporate strategy and incentive controlled actions. More recently, BSC proponents have focused on the need to tie measures together into a causal chain of performance, and to test the validity of these hypothesized effects to guide the development of strategy. Kaplan and Norton[2001] argue that one of the primary benefits of the balanced scorecard is its use in gauging the success of strategy. Norreklit[2000] insist that the cause-and-effect chain is central to the balanced scorecard. The cause-and-effect chain is also central to the IT BSC. However, prior researches on relationship between information system and enterprise strategies as well as connection between various IT performance measurement indicators are not so much studied. Ittner et al.[2003] report that 77% of all surveyed companies with an implemented BSC place no or only little interest on soundly modeled cause-and-effect relationships despite of the importance of cause-and-effect chains as an integral part of BSC. This shortcoming can be explained with one theoretical and one practical reason[Blumenberg and Hinz, 2006]. From a theoretical point of view, causalities within the BSC method and their application are only vaguely described by Kaplan and Norton. From a practical consideration, modeling corporate causalities is a complex task due to tedious data acquisition and following reliability maintenance. However, cause-and effect relationships are an essential part of BSCs because they differentiate performance measurement systems like BSCs from simple key performance indicator(KPI) lists. KPI lists present an ad-hoc collection of measures to managers but do not allow for a comprehensive view on corporate performance. Instead, performance measurement system like BSCs tries to model the relationships of the underlying value chain in cause-and-effect relationships. Therefore, to overcome the deficiencies of causal modeling in IT BSC, sound and robust causal modeling approaches are required in theory as well as in practice for offering a solution. The propose of this study is to suggest critical success factors(CSFs) and KPIs for measuring performance for IT organizations and empirically validate the casual relationships between those CSFs. For this purpose, we define four perspectives of BSC for IT organizations according to Van Grembergen's study[2000] as follows. The Future Orientation perspective represents the human and technology resources needed by IT to deliver its services. The Operational Excellence perspective represents the IT processes employed to develop and deliver the applications. The User Orientation perspective represents the user evaluation of IT. The Business Contribution perspective captures the business value of the IT investments. Each of these perspectives has to be translated into corresponding metrics and measures that assess the current situations. This study suggests 12 CSFs for IT BSC based on the previous IT BSC's studies and COBIT 4.1. These CSFs consist of 51 KPIs. We defines the cause-and-effect relationships among BSC CSFs for IT Organizations as follows. The Future Orientation perspective will have positive effects on the Operational Excellence perspective. Then the Operational Excellence perspective will have positive effects on the User Orientation perspective. Finally, the User Orientation perspective will have positive effects on the Business Contribution perspective. This research tests the validity of these hypothesized casual effects and the sub-hypothesized causal relationships. For the purpose, we used the Partial Least Squares approach to Structural Equation Modeling(or PLS Path Modeling) for analyzing multiple IT BSC CSFs. The PLS path modeling has special abilities that make it more appropriate than other techniques, such as multiple regression and LISREL, when analyzing small sample sizes. Recently the use of PLS path modeling has been gaining interests and use among IS researchers in recent years because of its ability to model latent constructs under conditions of nonormality and with small to medium sample sizes(Chin et al., 2003). The empirical results of our study using PLS path modeling show that the casual effects in IT BSC significantly exist partially in our hypotheses.

A Review of Acupuncture and Moxibustion for the Treatment of Parkinson's Disease (파킨슨병의 침구치료 동향에 대한 고찰)

  • Lee, Eun;Kang, Ki-Wan;Kim, Lak-Hyung;Kang, Sei-Young;Sun, Seung-Ho;Han, Chang-Ho;Jang, In-Soo
    • The Journal of Internal Korean Medicine
    • /
    • v.35 no.1
    • /
    • pp.12-23
    • /
    • 2014
  • Objectives : The purpose of this study was to report possibility of acupuncture or moxibustion for the treatment of Parkinson's disease (PD) by reviewing literature about its effectiveness. Methods : In this review, PubMed, SCOPUS, Science Direct and CINAHL of EBSCOhost were used to search medical journals, using keywords "Parkinson's disease and acupuncture" and "Parkinson's disease and moxibustion". The search range included randomized controlled trials (RCT) about Parkinson's disease combined with another disease and other treatments with acupuncture or moxibustion. Non-randomized controlled trial (nRCT), case study, animal experiment, human experiment, review, survey, essay, letter, and protocol for review were excluded. Results : From 311 studies, 111 were selected during the title and the screening. Finally, 16 RCTs (15 for acupuncture research and one for moxibustion) were included in this review, after scanning and matching the inclusion and exclusion criteria. The number of patients varied between 5 and 88. A total of 12 studies using electroacupuncture (EA) were classified into acupuncture studies. The body acupuncture studies numbered 4, scalp acupuncture 4, body and scarp acupuncture mixed studies 4, and bee venom, ear and abdomen acupuncture were each one study. In evaluation methods, total effective rate method was used in 9 studies, the Unified Parkinson's Disease Rating Scale (UPDRS) was used in 8, and the Webster score in 2. In addition, the Berg balance scale (BBS), 30 m walking time, steps to walk 30 m, PD motor function score, and Motor Performance Series by Schoppe (MLS) method were used for evaluation. In 15 of the 16 studies, the verum acupuncture group showed significant improvement compared with the control. In 9 studies using total effective rate method, the effective rate was reported as 80.0-97.3% in verum acupuncture groups and 52.6-86.4% in controls. Conclusions : Acupuncture may be a plausible alternative method to care for the long term symptoms and treat movement impairment of Parkinson's disease. However, to confirm this result, high quality studies including randomized, placebo-controlled double-blind trials are warranted.

An Evaluation of the Virtual Refraction Education (가상 굴절검사 교육에 대한 평가)

  • Yu, Dong-Sik;Son, Jeong-Sik;Chu, Byoung-Sun
    • Journal of Korean Ophthalmic Optics Society
    • /
    • v.13 no.2
    • /
    • pp.43-50
    • /
    • 2008
  • Purpose: The purpose of this study is to evaluate the effect of a VR (Virtual Refractor), which is a simulator for a PR (Practical Refraction), as an educational tool. Methods: Twenty four third year students enrolled in the department of visual optics volunteered for VR education. Each student attended a VR training course and practiced with the VR by themselves. One month later, each student tested three virtual subjects on the VR and one real subject on the PR and were given a performance score for each refraction. And the scores for the virtual and practical refractions were compared. In addition, a self-report questionnaire based on a five point Likert-scale was designed, consisting of domains such as spontaneous participation, contribution for the refraction, confirmity of the VR and PR, and necessity of the VR. Results: The Spearman's correlation coefficient between the testing score of the practical and virtual refractions indicated a significantly correlation (R=0.71, p<0.001). In the questionnaire, the mean score of the domains was 3.67${\pm}$0.96 and it indicated that students expressed that using the VR was beneficial. The correlation value among these domains was a high significant level, 0.91~0.68 (p<0.001). Conclusions: Although the VR required certain improvements in its concentration and systematic approaches for practical situations, it showed a high correlation between the VR and the PR and represented a positive evaluation in the PR.

  • PDF

A Study on the Altmetrics of the Papers of Library and Information Science Researchers Published in International Journals (국제 학술지에 발표된 문헌정보학 연구자 논문의 알트메트릭스에 관한 연구)

  • Jane Cho
    • Journal of Korean Library and Information Science Society
    • /
    • v.53 no.4
    • /
    • pp.143-162
    • /
    • 2022
  • Altmetrics is an alternative impact evaluation index that evaluates the social interest in the research performance of individuals or institutions in universities, research institutions, and research fund support institutions. This study empirically analyzed what kind of attention a papers of domestic library and information science researchers published in an international academic journal was receiving in the international community using Altmetric explorer. As a result of the analysis, 230 papers were tracked. The average Altmetric Attention Score (AAS) was 6.63, but there were 2 papers that received overwhelming attention (over 170 points) as they were mentioned in news report and Twitter. Second, there was a tendency for high AAS to appear in cases where a domestic researcher participated as a co-author and the main author belonged to an overseas institution, and in the case where the research funds were supported by foreign government agencies. In addition to the field of the library information science or information system, the papers classified as the field of public health service and education showed high AAS, and it was confirmed that these papers were published in the journals of various fields such as life science. Finally, it was confirmed that there was a weak correlation of r =0.25 between the AAS and the number of citations of the analyzed paper, but a strong correlation of r =0.68 between the number of Mendeley readers and the number of citations.

Evaluation of Hydrogeological Characteristics of Deep-Depth Rock Aquifer in Volcanic Rock Area (화산암 지역 고심도 암반대수층 수리지질특성 평가)

  • Hangbok Lee;Chan Park;Junhyung Choi;Dae-Sung Cheon;Eui-Seob Park
    • Tunnel and Underground Space
    • /
    • v.34 no.3
    • /
    • pp.231-247
    • /
    • 2024
  • In the field of high-level radioactive waste disposal targeting deep rock environments, hydraulic characteristic information serves as the most important key factor in selecting relevant disposal sites, detailed design of disposal facilities, derivation of optimal construction plans, and safety evaluation during operation. Since various rock types are mixed and distributed in a small area in Korea, it is important to conduct preliminary work to analyze the hydrogeological characteristics of rock aquifers for various rock types and compile the resulting data into a database. In this paper, we obtained hydraulic conductivity data, which is the most representative field hydraulic characteristic of a high-depth volcanic bedrock aquifer, and also analyzed and evaluated the field data. To acquire field data, we used a high-performance hydraulic testing system developed in-house and applied standardized test methods and investigation procedures. In the process of hydraulic characteristic data analysis, hydraulic conductivity values were obtained for each depth, and the pattern of groundwater flow through permeable rock joints located in the test section was also evaluated. It is expected that the series of data acquisition methods, procedures, and analysis results proposed in this report can be used to build a database of hydraulic characteristics data for high-depth rock aquifers in Korea. In addition, it is expected that it will play a role in improving technical know-how to be applied to research on hydraulic characteristic according to various bedrock types in the future.

A Developmental Research of Design Thinking-based Program for Optimal Learning Experience in University

  • Sung-Wan Kim
    • Journal of the Korea Society of Computer and Information
    • /
    • v.29 no.9
    • /
    • pp.287-297
    • /
    • 2024
  • The purpose of this study is to develop a design thinking-based program to enhance the core competencies of creative problem-solving, collaboration, and communication for college students and to verify its effectiveness. To this end, a design thinking-based program was developed according to the instructional systems design (ISD) model consisting of learning content analysis, class activity design, evaluation tool development, implementation, evaluation and revision. After applying to the target (88 college students), competencies in creative problem-solving, collaboration, and communication were tested to verify quantitative effectiveness and the collected data was analyzed by t-test. In order to verify the qualitative effectiveness, the reflective logs submitted by each group as a final project report were analyzed. The results of the t-test conducted to verify the change in students' means in the pre-post competency test, showed that there were statistically significant increase in creative problem solving skill (t=-4.955, p<.01), collaboration skill (t=-3.179, p<.01), and communication skills(t=- 4.293, p<.01). And the design thinking-based program enabled students to have optimal learning experiences. Especially, learners in the program positively appreciated the experience of sharing various ideas with other members, strengthening cognitive flexibility, and acquiring performance.

Structural Design and Performance Evaluation of a Mid-story Seismic Isolated High-Rise Building

  • Tamari, Masatoshi;Yoshihara, Tadashi;Miyashita, Masato;Ariyama, Nobuyuki;Nonoyama, Masataka
    • International Journal of High-Rise Buildings
    • /
    • v.6 no.3
    • /
    • pp.227-235
    • /
    • 2017
  • This paper describes some of the challenges for structural design of a mid-story seismic isolated high-rise building, which is located near Tokyo station, completed in 2015. The building is a mixed-use complex and encompasses three volumes: one substructure including basement and lower floors, and a pair of seismic isolated superstructures on the substructure. One is a 136.5m high Main Tower (office use), and the other is a 98.5 m high South Tower (hotel use). The seismic isolation systems are arranged in the $3^{rd}$ floor of the Main Tower and $5^{th}$ floor of the South Tower, so that we call this isolation system as the mid-story seismic isolation. The primary goal of the structural design of this building was to secure high seismic safety against the largest earthquake expected in Tokyo. We adopted optimal seismic isolation equipment simulated by dynamic analysis to minimize building damage. On the other hand, wind-induced vibration of a seismic isolated high-rise building tends to be excited. To reduce the vibration, the following strategies were adopted respectively. In the Main Tower with a large wind receiving area, we adopted a mechanism that locks oil dampers at the isolation level during strong wind. In the South Tower, two tuned mass dampers (TMDs) are installed at the top of the building to control the vibration. In addition, our paper will also report the building performance evaluated for wind and seismic observation after completion of the building. In 2016, an earthquake of seismic intensity 3 (JMA scale) occurred twice in Tokyo. The acceleration reduction rate of the seismic isolation level due to these earthquakes was approximately 30 to 60%. These are also verified by dynamic analysis using observed acceleration data. Also, in April 2016, a strong wind exceeding the speed of 25m/s occurred in Tokyo. On the basis of the record at the strong wind, we confirmed that the locking mechanism of oil damper worked as designed.

Performance Evaluation of Substitution Radiopharmaceutical according to Restriction of the Radiocolloids in Lymphoscintigraphy (Lymphoscintigraphy에 이용되는 방사성의약품의 사용제한으로 인한 대체 방사성의약품의 성능평가)

  • Seo, Young-Deok;Jeong, Jae-Hun;Moon, Jong-Woon;Yun, Sang-Hyeok;Kim, Yeong-Seok;Kang, Se-Hun;Won, Woo-Jae;Kim, Seok-Ki
    • The Korean Journal of Nuclear Medicine Technology
    • /
    • v.13 no.1
    • /
    • pp.25-29
    • /
    • 2009
  • Purpose: Several radioactive agents were used for lymphoscintigraphy in breast cancer. But recently, due to the change of local radiopharmaceutical licensing policy and discontinuation of supplies from manufacturer, we could not use many radiocolloids such as $^{99m}Tc$-Antimony Trisulfide Colloid, $^{99m}Tc$-Tin Colloid, $^{99m}Tc$-Human Serum Albumin. So it is necessary to use the substitution radiopharmaceutical. Therefore, this study aims to evaluate the performance of substitution radiopharmaceutical ($^{99m}Tc$-Phytate) including the existing radiocolloids and to set up of the appropriate protocol in lymphoscintigraphy. Materials and Methods: For each radiocolloids ($^{99m}Tc$-Antimony Trisulfide Colloid (ASC), $^{99m}Tc$-Tin Colloid (TC), $^{99m}Tc$-Human Serum Albumin (HSA), $^{99m}Tc$-Phytate) were performed the particle size by Zeta Sizer (Nano-ZS) and we compared the radiolabeling time, procedure and acquisition time for each of the radiocolloids (total 200 patients). For the last time, we made an analysis of image for each of the radiocolloids with our previous report (SJ Jang et al, Korean Nucl Med Mol imaging Vol.41, No.6, Dec 2007). Results: The particle size of each radiocolloids showed A.S.C (50 nm), T.C (310 nm), H.S.A (10.8 nm), $^{99m}Tc$-Phytate (499 nm). The labeling and acquisition time for each of the radiocolloids showed no substantial difference. But there is difference of the labeling time for the A.S.C. because the ASC procedure need to boiling process. There were no significant differences among those radiocolloids (p>0.005) in the identification rate (IR), false negative rate (FNR), and negative predictive value (NPV). Conclusions: $^{99m}Tc$-labeled radiocolloids showed equivalent results in lymphoscintigraphy. Therefore, in this exam of each radiocolloids could be applied appropriate protocol in lymphoscintigraphy.

  • PDF