• Title/Summary/Keyword: Scoring Model

Search Result 274, Processing Time 0.026 seconds

A Study on the Features of Writing Rater in TOPIK Writing Assessment (한국어능력시험(TOPIK) 쓰기 평가의 채점 특성 연구)

  • Ahn, Su-hyun;Kim, Chung-sook
    • Journal of Korean language education
    • /
    • v.28 no.1
    • /
    • pp.173-196
    • /
    • 2017
  • Writing is a subjective and performative activity. Writing ability has multi-facets and compoundness. To understand the examinees's writing ability accurately and provide effective writing scores, raters first ought to have the competency regarding assessment. Therefore, this study is significant as a fundamental research about rater's characteristics on the TOPIK writing assessment. 150 scripts of the 47th TOPIK examinees were selected randomly, and were further rated independently by 20 raters. The many-facet Rasch model was used to generate individualized feedback reports on each rater's relative severity and consistency with respect to particular categories of the rating scale. This study was analyzed using the FACETS ver 3.71.4 program. Overfit and misfit raters showed many difficulties for noticing the difference between assessment factors and interpreting the criteria. Writing raters appear to have much confusion when interpreting the assessment criteria, and especially, overfit and misfit teachers interpret the criteria arbitrarily. The main reason of overfit and misfit is the confusion about assessment factors and criteria in finding basis for scoring. Therefore, there needs to be more training and research is needed for raters based on this type of writing assessment characteristics. This study is recognized significantly in that it collectively examined writing assessment characteristics of writing raters, and visually confirmed the assessment error aspects of writing assessment.

Suggestions for Improvement for KSL Screening Tests: From an Analysis of WIDA Tests (WIDA 평가 고찰을 통한 한국어(KSL) 교육과정 진단평가 개선 방안 탐색)

  • Lee, Inhye
    • Journal of Korean language education
    • /
    • v.29 no.1
    • /
    • pp.163-197
    • /
    • 2018
  • The present study suggests ways to improve the Korean proficiency screening test through an analysis of WIDA tests. A review of WIDA Screener, WIDA MODEL, and W-APT reveals that each of these three tests consists of four or five tests, corresponding to grade-level clusters. In addition, the WIDA screening tests assess both English for social communication and academic English, according to WIDA's five English Language Development (ELD) standards. Thematic folders of the ELD standards have different ranges of item difficulty, and the WIDA screening tests are adaptive tests. Lastly, the writing tests consist of performance-based tasks, and the rubric is holistic. As suggestions for improvement for Korean screening tests of the KSL curriculum, this study proposes (a) to devise items to assess academic Korean, so as to evaluate students' overall proficiency more accurately, (b) to utilize an adaptive method to screen students' proficiency more efficiently, and (c) to revise the writing tasks and rubric of the current KSL screening tests.

ESTABLISHMENT OF CONSTRUCTION INDUSTRY CREDIT GUARANTEE SYSTEM-BASED ON TAIWAN'S CONSTRUCTION INDUSTRY

  • Ting-Ya Hsieh;Tsung-Shi Liu
    • International conference on construction engineering and project management
    • /
    • 2011.02a
    • /
    • pp.399-406
    • /
    • 2011
  • Various construction bonds and warranties critically burden the general contractor. Also, sporadic or cumulative delays of progress payment by the owner can further trap the contractor in a financial quagmire. Facing the possibility of cash flow deficiency and callous response from the banks, most construction firms may become financially incapable of market competition, and attractive project tenders become a bidding game among few deep-pocket players. The downside of such market environment is that the depth of pocket, rather than that of professional competency dictates the choice of market winners. In Taiwan, this has been a potential crisis to the construction industry after the financial crisis which started out since 2008. To encounter this problem, this research will examine the means to better manage the construction industry. Essentially, a credit guarantee system (CGS) is the prime solution to strengthen a bank's confidence in any particular construction firm. Thus establishing a national platform which evaluates and rewards a construction firm's overall credibility is pivotal, and this third-party rated credit can help a bank to render a loan more wisely. Finally, this paper will propose the ideal operating schemes of construction-specific CGS in Taiwan and a credit scoring prototype model for construction industry, as reference for the government and banks, respectively.

  • PDF

A Study on Occupational Health Program and Development of Evaluating Criteria for Occupational Health (우리나라 산업보건관리(産業保健管理) 평가기준(評價基準)과 실태(實態)에 관(關)한 연구(硏究))

  • Lee, Y.S.;Moon, Y.H.;Kim, Y.K.;Chung, H.K.
    • Journal of Preventive Medicine and Public Health
    • /
    • v.11 no.1
    • /
    • pp.98-109
    • /
    • 1978
  • The study was carried out for 101 establishments in Kyong-In areas to evaluate the industrial health management status utilizing the scoring method by Webb's model during the period from 1 September to October 30, 1977. To compare the results, reevaluation was made with the 45 questions' model prepared by 6 Korean professionals who were specialized in industrial health fields. The results were as follows: 1. The mean rate of affirmative answers for 101 establishments was 51.6%. The mean weighted score rate of affirmative answers was 52.3%. 2. The mean rate of affirmative answers on components of the philosophy and facility resource for 101 establishments was higher than that of average rate. The mean rate of affirmative answers on components of the health evaluation and health management among the health service program was lower than that of average rate. 3. The mean rate of affirmative answers on components was highter among the establishments with more than 500 employees. The mean rate of affirmative answers of chemical establishment was lower than that of others. 4. The mean rate of affirmative answers on 45 questions' model for 101 establishments were 67.1%. The mean weighted score rate of affirmative answers was 70.0%. 5. In case of 45 questions' model, the mean rate of affirmative answers on components of philosophy and treatment was higher than that of average rate and the mean rate of affirmative answers on components of the facility resource and the health evaluation was lower than that of average rate. 6. The mean rate of affirmative answers of the 45 Questions' model was higher than that of Webb's model in size and class of 101 establishments. Author concluded that Webb's model must be suitable for evaluating higher conditions of occupational health management than is presently used in Korean establishments. According to the results, however, there were no significant differences between Webb's model and the 45 questions' model. So it could be used to evaluate Occupational Health Program. For this objective, in Korean occupational situations, further study also must be made comprehensively thereafter.

  • PDF

Effectiveness of golf skills to average score using records of PGA, LPGA, KPGA, KLPGA : Multi-group path analysis (프로골프 경기기록을 활용한 다중집단분석 : 경로분석 적용)

  • Kim, Sae Hyung;Cho, Jung Hwan
    • Journal of the Korean Data and Information Science Society
    • /
    • v.24 no.3
    • /
    • pp.543-555
    • /
    • 2013
  • This study is to analyze effectiveness of golf skills (driving distance, rating of fairway, green in regulation, sand save ratio, recovery ratio, putting average) to average score using records of PGA, LPGA, KPGA, KLPGA. Independent variables were driving distance, rating of fairway, green in regulation, sand save ratio or recovery ratio, putting average. Dependent variable was the scoring average in this study. To analyze these variables, multi-group (PGA vs LPGA, KPGA vs KLPGA, PGA vs KPGA, LPGA vs KLPGA) path analysis was used through AMOS 18.0 program and significance level was set at 0.05. As the result, the variables that show significant differences of path coefficient between PGA model and LPGA model were driving distance and green in regulation to average score. The variables that show significant differences of path coefficient between KPGA model and KLPGA model were driving distance, recovery ratio, and putting average to average score. The variables that show significant differences of path coefficient between PGA model and KPGA model were driving distance, recovery ratio, and putting average to average score. There was not significant difference of path coefficient between LPGA model and KLPGA model.

Count of platelet and mean platelet volume score: serologic prognostic factor in patients with oral squamous cell carcinoma

  • Park, Jae Woo;Kim, Chul-Hwan;Ha, Yong Chan;Kim, Moon Young;Park, Sung Min
    • Journal of the Korean Association of Oral and Maxillofacial Surgeons
    • /
    • v.43 no.5
    • /
    • pp.305-311
    • /
    • 2017
  • Objectives: TNM staging, especially for lymph node metastasis, is the scoring system most widely used among prognostic factors for cancer survival. Several biomarkers have been studied as serologic markers, but their specificity is low and clinical applications are difficult. This study aimed to establish a scoring system for patients with oral squamous cell carcinoma (OSCC) using platelet (PLT) and mean platelet volume (MPV) levels measured postoperatively and to evaluate their significance as prognostic factors. Materials and Methods: We studied 40 patients admitted to the Department of Oral and Maxillofacial Surgery of Dankook University Hospital who were diagnosed with primary OSCC histopathologically between May 2006 and May 2012. Clinical pathological information obtained from the medical records of each patient included age, sex, height, weight, tumor location, degree of differentiation, tumor diameter, lymph node metastasis, TNM stage, and other test values including white blood cell, MPV, PLT, C-reactive protein (CRP), and albumin obtained through a test conducted within 7 days before surgery. Count of platelet (COP)-MPV Score: Patients with both PLT and MPV values below the cut-off values were defined as score 0 (group A). Patients with at least one of the two higher than the cut-off value were defined as score 1 (group B). Results: Univariate analyses showed N-metastasis, COP-MPV (A vs B), PLT, platelet-lymphocyte ratio, and CRP were statistically significant prognostic factors. A multivariate Cox proportional hazards model showed N-metastasis (hazard ratio [HR] 6.227, P=0.016) and COP-MPV (A vs B) (HR 18.992, P=0.013) were independent prognostic factors with a significant effect on survival. Conclusion: COP-MPV score is a simple and cost-effective test method and is considered a more effective prognostic factor than other considered factors in predicting the prognosis of OSCC patients.

Domain Knowledge Incorporated Local Rule-based Explanation for ML-based Bankruptcy Prediction Model (머신러닝 기반 부도예측모형에서 로컬영역의 도메인 지식 통합 규칙 기반 설명 방법)

  • Soo Hyun Cho;Kyung-shik Shin
    • Information Systems Review
    • /
    • v.24 no.1
    • /
    • pp.105-123
    • /
    • 2022
  • Thanks to the remarkable success of Artificial Intelligence (A.I.) techniques, a new possibility for its application on the real-world problem has begun. One of the prominent applications is the bankruptcy prediction model as it is often used as a basic knowledge base for credit scoring models in the financial industry. As a result, there has been extensive research on how to improve the prediction accuracy of the model. However, despite its impressive performance, it is difficult to implement machine learning (ML)-based models due to its intrinsic trait of obscurity, especially when the field requires or values an explanation about the result obtained by the model. The financial domain is one of the areas where explanation matters to stakeholders such as domain experts and customers. In this paper, we propose a novel approach to incorporate financial domain knowledge into local rule generation to provide explanations for the bankruptcy prediction model at instance level. The result shows the proposed method successfully selects and classifies the extracted rules based on the feasibility and information they convey to the users.

GIS Technology for Groundwater Resources Management (지하수 자원 개발을 위한 GIS 응용 연구)

  • 김윤종;조민조;성익환;김남종;최영진;김규범
    • The Journal of Engineering Geology
    • /
    • v.3 no.2
    • /
    • pp.101-114
    • /
    • 1993
  • GIS technique was applied to identify the regional hydrologic units for groundwater exploitation and recharge analysis in a study area. The technique was very effective to identify the potential areas for groundwater exploitation, and for groundwater management & land use planning. GIS database of environmental resources was complied from a variety of sources and scales as the foundation for analysis, including digitizing and scanning of hardcopy maps. A DEM(Digital Elevation Model) was used to dassify slopes, and identify problematic drainage system. Quantitative analysis of environmental resources helps us to develop the scoring system of GIS model, which evaluates each resource in relation to the others and reflects the relative importance of each resource. ARC4NFO was used to construct digital database, and the cartographic simulation techniques were applied in order to create new maps.

  • PDF

Automatic Inter-Phoneme Similarity Calculation Method Using PAM Matrix Model (PAM 행렬 모델을 이용한 음소 간 유사도 자동 계산 기법)

  • Kim, Sung-Hwan;Cho, Hwan-Gue
    • The Journal of the Korea Contents Association
    • /
    • v.12 no.3
    • /
    • pp.34-43
    • /
    • 2012
  • Determining the similarity between two strings can be applied various area such as information retrieval, spell checker and spam filtering. Similarity calculation between Korean strings based on dynamic programming methods firstly requires a definition of the similarity between phonemes. However, existing methods have a limitation that they use manually set similarity scores. In this paper, we propose a method to automatically calculate inter-phoneme similarity from a given set of variant words using a PAM-like probabilistic model. Our proposed method first finds the pairs of similar words from a given word set, and derives derivation rules from text alignment results among the similar word pairs. Then, similarity scores are calculated from the frequencies of variations between different phonemes. As an experimental result, we show an improvement of 10.1%~14.1% and 8.1%~11.8% in terms of sensitivity compared with the simple match-mismatch scoring scheme and the manually set inter-phoneme similarity scheme, respectively, with a specificity of 77.2%~80.4%.

Assessment of quantitative structure-activity relationship of toxicity prediction models for Korean chemical substance control legislation

  • Kim, Kwang-Yon;Shin, Seong Eun;No, Kyoung Tai
    • Environmental Analysis Health and Toxicology
    • /
    • v.30 no.sup
    • /
    • pp.7.1-7.10
    • /
    • 2015
  • Objectives For successful adoption of legislation controlling registration and assessment of chemical substances, it is important to obtain sufficient toxicological experimental evidence and other related information. It is also essential to obtain a sufficient number of predicted risk and toxicity results. Particularly, methods used in predicting toxicities of chemical substances during acquisition of required data, ultimately become an economic method for future dealings with new substances. Although the need for such methods is gradually increasing, the-required information about reliability and applicability range has not been systematically provided. Methods There are various representative environmental and human toxicity models based on quantitative structure-activity relationships (QSAR). Here, we secured the 10 representative QSAR-based prediction models and its information that can make predictions about substances that are expected to be regulated. We used models that predict and confirm usability of the information expected to be collected and submitted according to the legislation. After collecting and evaluating each predictive model and relevant data, we prepared methods quantifying the scientific validity and reliability, which are essential conditions for using predictive models. Results We calculated predicted values for the models. Furthermore, we deduced and compared adequacies of the models using the Alternative non-testing method assessed for Registration, Evaluation, Authorization, and Restriction of Chemicals Substances scoring system, and deduced the applicability domains for each model. Additionally, we calculated and compared inclusion rates of substances expected to be regulated, to confirm the applicability. Conclusions We evaluated and compared the data, adequacy, and applicability of our selected QSAR-based toxicity prediction models, and included them in a database. Based on this data, we aimed to construct a system that can be used with predicted toxicity results. Furthermore, by presenting the suitability of individual predicted results, we aimed to provide a foundation that could be used in actual assessments and regulations.