• The Journal of the Korean dental association
• /
• v.57 no.8
• /
• pp.448-455
• /
• 2019

This study aims to apply the Generalizability Theory (G-theory) for estimation of reliability of evaluation scores between raters on Patient Dentist Interaction. Selecting a number of raters as multiple error sources, this study was analyzed the error sources caused by relative magnitude of error variances of interaction between the factors and proceeded with D-study based on the results of G-study for optimal determination of measurement condition. The estimated outcomes of variance component for accuracy among the Patient Dentist Interaction evaluation with G-theory showed that impact of error was the biggest influence factor in students. The second influence was the item effect, and the rater effect was relatively small. The Generalizability coefficients for case1 and case2 which were estimated through the D- study were calculated relatively low.

• The Journal of Fisheries Business Administration
• /
• v.42 no.3
• /
• pp.15-29
• /
• 2011

The Fish Stock Rebuilding Plan (FSRP) is evaluated as one of the most effective fisheries policies domestically and internationally. FSRP is a comprehensive fisheries policy, including target stock size, rebuilding period, application of management measures, and participation of fishermen. The performance outcomes of FSRPs have been partially evaluated for recommendation for stock rebuilding in Korea, while they are fully evaluated in other countries that have implemented FSRPs. The performance evaluation system for FSRP is very needed to enhance its effectiveness as one of fisheries policies. That is, the system where problems can be reconsidered, achieving targets can be evaluated, and the plan can be modified should be implemented. This study classified the performance evaluation of FSRP into the economic evaluation as a quantitative analysis and the policy evaluation as a qualitative analysis. In the economic evaluation, the sustainability of fishery resources, the stability of fishing business, the efficiency of fishery production, and efficient utilization of fishery resources can be considered. As analytical methods for the economic evaluation, the bioeconomic model, efficiency estimation model, the dynamic MEY model can be utilized. The qualitative evaluation is to assess the qualitative performances of FSRPs, including interviews and surveys with fishermen and fisheries experts. In the survey, many different items can be included by evaluation factors which are related to policies such as timeliness, transparency, effectiveness, etc. In addition, the study suggested the performance evaluation system and procedures for objective and efficient evaluation of FSRPs. In order to practically apply the developed performance evaluation model, the pilot project is needed. That is, from the application of pilot project, detailed research methods, effective procedures, and evaluation factors can be investigated.

• New & Renewable Energy
• /
• v.6 no.2
• /
• pp.33-39
• /
• 2010

The objective of this study is to present a basis for the evaluation on the renewable energy dissemination program in Korea applying the outcome evaluation, one of the five types of evaluation methods of EERE, DOE, and the effectiveness indicator, which is suggested by IEA, OECD. The outcome evaluation quantifies achievements of program outputs and outcomes against planned time frame. We analyze the correlation coefficients between cumulative expenditure on the renewable energy dissemination program and each renewable energy deployment and the unit installation cost of several dissemination programs for the outcome evaluation. Meanwhile, the effectiveness indicator is calculated by dividing the additional renewable energy deployment achieved in a given year by the remaining mid-term realizable potential to 2020 in each source of renewable energy. The results show that correlation coefficients between cumulative expenditure and each renewable energy deployment are significantly positive during the implementation period of each deployment program. And photovoltaic energy, bio energy, and wind power energy show high effectiveness indicator.

• Information Systems Review
• /
• v.6 no.1
• /
• pp.85-102
• /
• 2004

This article provides a practical organizational IT ROI evaluation methodology which had been developed by Samsung Group. In order to manage huge IT investment and ROI systematically, firms should establish a management system which can measure various types of IT expenditures, tangible and intangible outcomes of hundreds of KPIs, etc. An episode about the development process and some distinctive features of the methodology were summarized. Finally, we added a real evaluation case of one Samsung affiliate company.

• Asian Pacific Journal of Cancer Prevention
• /
• v.15 no.5
• /
• pp.2375-2378
• /
• 2014

Cancer, like any disease, is a pathologic biological process. Drugs are designed to interfere with the pathologic process and should therefore also be validated using a functional screening method directed at these processes. Screening for cancers at an appropriate time and also evaluating results is also very important. Volumetric measurement helps in better screening and evaluation of tumors. Volumetry is a process of quantification of the tumors by identification (pre-cancerous or target lesion) and measurement. Volumetric image analysis allows an accurate, precise, sensitive, and medically valuable assessment of tumor response. It also helps in identifying possible outcomes such disease progression (PD) or complete response as per Response Evaluation Criteria in Solid Tumors (RECIST).

• Journal of the Korean Society for Library and Information Science
• /
• v.43 no.2
• /
• pp.29-51
• /
• 2009

Recently, the policies and management of public libraries have been evaluated by the Ministry of Public Administration and Security, the Ministry of Culture, Sports and Tourism of the central government, and Gyeonggi Province in Korea. However, these evaluations do not meet the international trends where simple input-output measures are being overtaken by outcomes calculating broad socio-economic values. Taking these facts into consideration, the main goal of this paper is to analyze the limitations of the recent library evaluation cases and to suggest some desirable directions for the evaluation of the socio-economic values (i.e., impact and benefits) of public libraries.

• Korean Journal of Construction Engineering and Management
• /
• v.11 no.4
• /
• pp.80-88
• /
• 2010

Korean government has implemented various construction technology policies to attain competitiveness. However, there have not been interested in appropriate objectives and performance evaluation of the policy implementation. Previous evaluation included only inputs during implementation process not outputs or outcomes. Therefore, this paper performs performance evaluations on 3rd general plans for construction technology that had been implemented from 2003 to 2007 by government. This analyzes both quantitative and qualitative results. The results tell us that clear and appropriate objectives and evaluation methodology should be established for effective performance evaluation. This paper will provide the basis for establishing future construction policies or plans.

• Korean Medical Education Review
• /
• v.25 no.2
• /
• pp.126-131
• /
• 2023

The aim of this study was to systematically collect data for evaluating short- and long-term outcomes using Kirkpatrick's four-level evaluation model, Chonnam National Medical School has established plans for developing and managing a database of student and graduate cohorts. The Education Evaluation Committee, with assistance from the Medical Education Office, manages the development and maintenance of cohort data. Data collection began in the 2022 academic year with first- through fourth-year medical students and graduates of the year 2022. The collected data include sociodemographic characteristics, admission information, psychological test results, academic performance data, extracurricular activity data, scholarship records, national medical licensing exam results, and post-graduation career paths. The Education Evaluation Committee and the Medical Education Office analyze the annually updated student and graduate cohort data and report the results to the dean and relevant committees. These results are used for admissions processes, curriculum improvement, and the development of educational programs. Applicants interested in using the student and graduate cohort data to evaluate the curriculum or conduct academic research must undergo review by the Educational Evaluation Committee before being granted access to the data. It is expected that the collected data from student and graduate cohorts will provide a sound and scientific basis for evaluating short- and long-term achievements based on student, school, and other characteristics, thereby supporting medical education policies, innovation, and implementation.

• Asia pacific journal of information systems
• /
• v.18 no.3
• /
• pp.1-20
• /
• 2008

Based on the multi-attribute utility theory (MAUT), we present a survey method to measure consumer preferences. The multi-attribute utility theory has been used to make decisions in OR/MS field; however, we show that the method can be effectively used to estimate the demand for new services by measuring individual level utility function. Because conjoint method has been widely used to measure consumer preferences for new products and services, we compare the pros and cons of two consumer preference survey methods. Further, we illustrate how swing weighing method can be effectively used to elicit customer preferences especially for new telecommunications services, Multi-attribute utility theory is a compositional approach for modeling customer preference, in which researchers calculate overall service utility by summing up the evaluation results for each attribute. On the contrary, conjoint method is a decompositional approach, which requires holistic evaluations for profiles. Partworth for each attribute is derived or estimated based on the evaluation, and finally consumer preferences for each profile are calculated. However, if the profiles are quite new and unfamiliar to the survey respondents, they will find it very difficult to accurately evaluate the profiles. We believe that the multi-attribute utility theory-based survey method is more appropriate than the conjoint method, because respondents only need to assess attribute level preferences and not holistic assessment. We chose swing weighting method among many weight assessment methods in multi-attribute utility theory, because it is designed to perform in a simple and fast manner. As illustrated in Clemen and Reilly (2001), to assess swing weights, the first step is to create the worst possible outcome as a benchmark by setting the worst level on each of the attributes. Then, each of the succeeding rows "swings" one of the attributes from worst to best. Upon constructing the swing table, respondents rank order the outcomes (rows). The next step is to rate the outcomes in which the rating for the benchmark is set to be 0 and the rating for the best outcome to be 100, and the ratings for other outcomes are determined in the ranges between 0 and 100. In calculating weight for each attribute, ratings are normalized by the total sum of all ratings. To demonstrate the applicability of the approach, we elicited and analyzed individual-level customer preference for new telecommunication services-WiBro and HSDPA. We began with a randomly selected 800 interviewees, and reduced them to 432 because other remaining ones were related to the people who did not show strong intention for subscription to new telecommunications services. For each combination of content and handset, number of responses which favored WiBro and HSDPA were counted, respectively. It was assumed that interviewee favors a specific service when expected utility is greater than that of competing service(s). Then, the market share of each service was calculated by normalizing the total number of responses which preferred each service. Holistic evaluation of new and unfamiliar service is a tough challenge for survey respondents. We have developed a simple and easy method to assess individual level preference by estimating weight of each attribute. Swing method was applied for this purpose. We believe that estimating individual level preference will be quite flexibly used to predict market performance of new services in many different business environments.

• Journal of Korean Foot and Ankle Society
• /
• v.18 no.3
• /
• pp.108-114
• /
• 2014

Purpose: Ligament reattachment technique using a suture anchor appears to show satisfactory functional outcomes and mechanical stability compared with conventional bone tunnel technique. This study was prospectively conducted in order to evaluate functional outcomes of modified Brostrom procedures using the suture bridge technique for chronic ankle instability in athletes. Materials and Methods: Twenty eight athletes under 30 years of age were followed for more than two years after undergoing the modified Brostrom procedure using the suture bridge technique. Functional evaluation consisted of the foot and ankle outcome score (FAOS), foot and ankle ability measure (FAAM) score. Range of motion and time to return to exercise were evaluated using a periodic questionnaire. Talar tilt angle and anterior talar translation were measured through stress radiographs for evaluation of mechanical stability. Results: FAOS improved significantly from preoperative mean 59.4 points to 91.4 points (p<0.001). Daily living and sport activity scores of FAAM improved significantly from preoperative mean 50.5, 32.5 points to 94.8, 87.3 points, respectively (p<0.001). Talar tilt angle and anterior talar translation improved significantly from preoperative mean $16.8^{\circ}$, 13.5 mm to $4.2^{\circ}$, 4.1 mm at final follow-up (p<0.001). Times to return to exercise were as follows: mean 10.2 weeks in jogging, 15.4 weeks in spurt running, 13.1 weeks in jumping, 11.5 weeks in walking on uneven ground, 9.1 weeks in standing on one leg, 7.2 weeks in tip-toeing gait, 8.4 weeks in squatting, and 10.6 weeks in descending stairs. Conclusion: Modified Brostrom procedure using the suture bridge technique showed satisfactory functional outcomes for chronic ankle instability in athletes. Optimal indication and cost-effectiveness of the suture bridge technique will be studied in the future.