• Title/Summary/Keyword: Factors of item difficulty

Search Result 42, Processing Time 0.03 seconds

Verification of the Usefulness of the Mock TOEIC Test using Corpus Indices : Focusing on the Analysis of Difficulty and Discrimination (코퍼스 지표를 활용한 모의 토익시험의 유용성 검증 : 난이도와 변별도 분석을 중심으로)

  • Lee, Yena
    • The Journal of the Korea Contents Association
    • /
    • v.21 no.10
    • /
    • pp.576-593
    • /
    • 2021
  • In this study, in order to investigate the factors that affect the percentage of correct answers and the degree of discrimination of the TOEIC test, a regression analysis was performed using corpus indicators that influence correct answer rate and the degree of discrimination for each part derived from the item analysis. The basic calculation word_length, consistency index LSA_overlap_adjacent_sentences, lexical diversity MTLD_VOCD, conjunction All_logical_causal_connectives_incidence, situational model casual_particles_causal_verbs_Ratio, syntactic complexity Left_embeddedness, and syntactic pattern density Infinitive_density were found to have negative effects. These factors that lower the correct answer rate can be utilized when setting learning goals. Vocabulary diversity index MTLD_VOCD, conjunction Additive_connectives_incidence, syntactic pattern density Infinitive_density, and lexical information person1_2_pronoun_incidence were found to have a positive effect. Factors influencing the increase in discrimination may provide important information for developing a learning program.

A Study on Difficulty Factors of Youth Startups for Activating Local Startups (지역창업 활성화를 위한 청년창업 애로 요인에 관한 연구)

  • Ahn, Tae-Uk;Kang, Tae-Won
    • Asia-Pacific Journal of Business Venturing and Entrepreneurship
    • /
    • v.15 no.2
    • /
    • pp.67-80
    • /
    • 2020
  • This study has been conducted at a time when Korean government continues to extend support for youth startups as part of its policy to create jobs and the focus moves from career and employment to youth startups with a growing interest in the field of youth startups. Against this background, this study aims to identify difficulty factors of youth startups in areas besides the Seoul Metropolitan Area, seek ways to overcome difficulty factors, and propose policy implications. To this end, this study set five criteria and 25 sub-criteria to evaluate the difficulties of youth startups by reviewing previous studies and conducting literature review, and performing brainstorming method. The empirical analysis of the evaluation criteria was performed, using the analytic hierarchy process (AHP) method, on youths aged 19 to 39 in Gunsan area. The analysis results showed that the largest difficulty factors facing local youths include business model establishment, business administration and management, and startup funding in the criteria. As for sub-criteria, the largest difficulty factors are market information acquisition, technology commercialization, project feasibility, technology development, and new market pioneering in descending order. Local youths have much difficulty about the process of turning a business item into a product and commercializing it. According to a comparative analysis by gender, men were a relatively high difficulty in commercializing business models than women. men were a relatively high difficulty in commercializing business models than women. On the other hand, women were higher than men in all factors (management management, entrepreneurship, improvement of entrepreneurship system, and improvement of entrepreneurship awareness) except for factors affecting business model. In addition, the factors of entrepreneurship were found to be relatively different among young people (college students, prospective entrepreneurs, entrepreneurs). In conclusion, it was suggested that in order to revitalize youth entrepreneurship in the region, it is necessary to actively resolve the difficulties of business model commercialization rather than entrepreneurship funds. In addition, it is necessary to strategically support customized entrepreneurship support and situational administrative services because gender and hierarchical difficulties are different than general solutions. This study presented practical priorities and derivation methods for the entrepreneurship difficulties faced by local youth, and suggested measures and improvements for vitalizing local youth entrepreneurship in the future.

Responsiveness Comparisons of Self-Report Versus Therapist-Scored Functional Capacity for Workers With Low Back Pain

  • Choi, Bongsam;Park, So-Yeon
    • Physical Therapy Korea
    • /
    • v.19 no.3
    • /
    • pp.91-97
    • /
    • 2012
  • The primary aim of this study was to compare responsiveness of self-report by worker and therapist-scored functional capacity instrument. Self-report and therapist-scored interval-level person measures and item difficulties were compared at admission and discharge. Therapist and worker ratings were collected on 230 clients from 27 rehabilitation sites using the newly developed Occupational Rehabilitation Data Base (ORDB) functional capacity instrument. ORDB comprises several subscales measuring relevant variables of "a return-to-work model" in work-related rehabilitation clinics. The functional capacity scale deals with 10 DOT job factors. The rating scale categories were 1-severely impaired, 2-moderately impaired, 3-mildly impaired, and 4-not impaired. Only data from clients with low back pain (n=98) with complete data (both admission and discharge scores) were used for the present study. Therapists and workers completed the functional capacity instrument at admission and discharge. Rasch analysis [1-parameter item response theory model (IRT)] was applied to calibrate item difficulty and person ability measure of therapist and workers ratings. Effect sizes for therapist and self-report ratings were slightly different, .69 and .30, respectively. Therapist and worker ratings were more consistent at discharge (r=.54) than at admission (r=.32). Workers have a tendency to be more severe in their ratings (show higher item difficulties) than therapists at admission and discharge. Therapists and workers report similar magnitudes of improvement following treatment program. These findings challenge the belief that injured workers may unreliable source for monitoring therapeutic outcomes. Self-report measures have the advantage of conserving therapist time for treatment (versus evaluation). While the therapist and self-report ratings are comparable at discharge, there is less consistency at admission. Comparable therapist-worker ratings may be achieved by controlling for rating severity using IRT methodologies.

Comparison of Cognitive Conflict on Peer Instruction by Middle School Science Gifted Students and Non-Gifted Students -Focusing on the level of difficulty in question- (중학교 과학영재와 일반학생의 Peer Instruction을 통한 인지갈등: 문항의 난이도에 따른 비교를 중심으로)

  • Ryoo, Eun-Hee;Kim, Jung-Bog;Lee, Jung-Sook
    • Journal of Gifted/Talented Education
    • /
    • v.22 no.1
    • /
    • pp.117-139
    • /
    • 2012
  • This study compared the cognitive conflict on peer instruction concerning the level of difficulty in question, between middle school science gifted students and non-gifted students. For the study, 35 the 7th grade science-gifted students in the organization affiliated with Science Education Institute for the Gifted in Seoul and Gyeong-gi province, and 14 the 8th grade science-gifted students, and 71 the 8th grade students. They performed peer instruction on propagation of straight light and composition of light and then, discussed three concept problems. After discussing the students took paper pencil test about changing levels of cognitive conflict. Regardless of the level of difficulty in question, the science-gifted students showed meaningful decreased figures on cognitive re-evaluation factors after peer-discussion. They trusted their peers, so during discussion, they explained their concepts. Furthermore discussion process enabled them to do reflective thinking. consequently, discord of students dropped, and total figures of cognitive conflict also declined. Science-gifted students have a tendency to worry lower than general students, though they felt anxiety as difficulty of the problems after peer-discussion. Through peer-discussion, science-gifted students presented statically decreased anxiety factors. By means of analyzed results of changing cognitive conflict of science-gifted students, developing and adapting strategies of cognitive conflict considering learner characteristics of science-gifted students is needed.

Comparison Analysis of a Cost Price for Dental Prosthetic Restoration (치과기공물 원가계산의 비교분석)

  • Park, Myoung-Ho;Lee, Sang-Rak
    • Journal of Technologic Dentistry
    • /
    • v.22 no.1
    • /
    • pp.153-178
    • /
    • 2000
  • Dental prosthetic restoration shows a big difference of cost per itemized unit depending on the size of dental labs, facility standard, manpower, and performance. Even the same dental labs have distinctive cost according to manufacturing performance, inflation, and the number of workers. However, in apite of such a change of circumstances, it appears to be quite stable in the relative cost per itemized unit unless the manufacturing trend of particular item changes dramatically. Therefore, if the relative number of cost per itemized unit, which is produced by costing, is indicated, we are able to utilize it effectively as a standard wage estimate. If the wage of dental prosthetic restoration is determined on the basis of cost, it is desirable that the relative value of cost and that of wage are identical. But, by means of comparative analysis, since the relative value of wage reveals mostly lower than that of cost depending on an item, it is considered that the wage is not reflecting the cost approproately. Due to the subdivision and the profession of medical technology, the new development of wage items for dental prosthetic restoration is required. This means that the need for the establishment of new wage items should be presented as the general concept of dental prothetic restroation changes and the level of pathologic technology increases. The current wage structure has differences in the degree of difficulty accroding to unit items and in the cost factors. Nevertheless, the differences are not reflected enough to the wage, so there is potential to lower the medical quality through the use of low-proce materials to avoid the increase of cost and the work process which skips a manufacturing step. The new items of dental prosthetic restoration also increases, but the development of proper numerical value system is not supported. Thus, the right proce is set mostly by applying to the wage of a similar item. Since most wages are established by an individual agreement between the dental clinic institute and the dental labs, the propriety of wage level lacks. Therefore, it is urgent to provide and promote the system of a fair work charge by a standard cost which can be applied to all medical institute.

  • PDF

What Pre-service Elementary School Teachers Focus on When Developing Assessment Items: Focusing on the Unit 'Weather and Our Lives' (초등 예비교사가 평가 문항 제작 시 주목하는 것은 무엇인가? : 날씨와 우리 생활 단원을 중심으로)

  • Sung-Man Lim;Seong-Un Kim
    • Journal of the Korean Society of Earth Science Education
    • /
    • v.17 no.2
    • /
    • pp.181-193
    • /
    • 2024
  • Summative assessment provides information on how well students have achieved learning objectives, making the development of high-quality assessment items essential for accurate evaluation. This is one of the competencies that teachers must possess. This study aims to analyze summative assessment items created by pre-service elementary teachers, examining their intentions and the difficulties encountered in the item development process. The study involved 45 second-year students enrolled in an elementary teacher training university. They were grouped into teams of three and tasked with developing ten items, documenting the purpose of each item, the answer key, and the challenges faced during item creation. The collected summative assessment items were analyzed using a two-dimensional purpose classification table that includes Klopfer's taxonomy of educational objectives. The intentions behind the summative assessments and the difficulties faced during item development were inductively organized and analyzed through qualitative data analysis. The results revealed that pre-service elementary teachers adequately reflected scientific content elements but did not evenly cover assessment domains. The most challenging aspect for them was adjusting the difficulty level. Although they considered most factors that should be taken into account during item development, these considerations were not reflected in the actual items. These findings suggest that knowledge and experience are crucial in developing summative assessment items, and systematic lectures are necessary for pre-service elementary teachers.

An Analysis of Content Validity of Behavioral Domain of Descriptive Tests and Factors that Affect Content Validity: Focus on the Fifth and Sixth Grade Science (초등학교 과학과 5, 6학년 서술형 평가문항의 행동영역 내용타당도 및 이에 영향을 미치는 요인 분석)

  • Choi, Jung-In;Paik, Seoung-Hye
    • Journal of The Korean Association For Science Education
    • /
    • v.36 no.1
    • /
    • pp.87-101
    • /
    • 2016
  • This study analyzes the content validity of descriptive tests developed for elementary schools, in order to acquire basic data to improve them. Various descriptive tests were collected and tested for differences in proportions between two-dimensional classification of educational objectives and the level of behavioral objectives. Results show that the descriptive tests developed by elementary school teachers mainly focused on "knowledge" and "understanding," and that content validity for behavioral levels to be low. Nine elementary school teachers were interviewed to understand the result. From the interviews, we found both internal and external factors that cause low content validity. The main internal factors were teachers' ability to make two-dimensional classification of educational objectives, the teachers' consideration of students' level, item level of difficulty, the ease of scoring, and path dependence. The main external factors were curriculum, parents, and administration. Based on the results, we suggested the factors related to elementary school teachers' PCK of descriptive tests.

Stressful Life Events, Physical Symptoms, and Anxiety in Adolescents (청소년의 스트레스 생활사건, 신체적증상과 불안에 관한 연구)

  • Yun, Kyu-Wol
    • Korean Journal of Psychosomatic Medicine
    • /
    • v.8 no.1
    • /
    • pp.20-30
    • /
    • 2000
  • Objective : This study was designed to investigate the frequencies and the relation of stressful life events and health problems and evaluate the influence of stressful life events on the physical symptoms and anxiety in adolescents. Method : Newcomb's 39-item life-event questionnaire and Newcomb's 19-item health problems questionnaire were administered to 475 adolescents. The frequencies of stressful life events and health problems which had actually occurred to them during the previous 12 months were investigated. Items of stressful life events were classified in 8 dimensional scaling factors(Family/parents, Accident/Illness, Sexuality, Autonomy, Deviance, Relocation, Distress, Items not in scales) and items of health problems were classified in 5 health problems(General, Heart and Lung, Nervous system, Anxiety, Psychosomatic symptoms) and the correlation between them was analyzed. Result : 1) The average number of events occurring during the past year for the 475 adolescents is 3(7.7%). The most frequent item of stressful life events was 'Thought about suicide' and dimensional factors of "Distress" and "Autonomy" were the most frequent life events in multidimensional sacling analysis. There were more factors of "Family/Illness" and " Autonomy" in male, while there was more factor of "Distress" in female. There were more factors of "School violence" and "Deviance" in younger students, while there were more factors of "Sexuality" and "Autonomy" in older students. 2) The most frequent item of health problem was 'excessive fatigue' and "anxiety" was most frequent health problem in multidimensional scaling analysis. There were more health problems in female than those in male. The higher grades the students became, the more health problems they have reported. 3) There was significant relationship between 7 factors of stressful life events except one factor of "Relocation" and 5 health problems. Conclusions : These findings suggest that as adolescents grow older, they are engaging in more controllable behaviors related to autonomy and sexuality and at the same time are experiencing increased difficulty with distressful or discomforting events, and their stressful life events are significantly related to decreased health and psychological functiong.

  • PDF

An Empirical Study on Pricing Model for Software Operation (소프트웨어 운영 대가산정 방식에 대한 실증적 연구)

  • Kim, Heungshik;Kim, Choong Nyoung;Seo, Yongwon
    • Journal of Information Technology Services
    • /
    • v.18 no.4
    • /
    • pp.67-82
    • /
    • 2019
  • The purpose of this study is to improve the calculation method of the software operation pricing proposed by the software business price calculation guide from 'input manpower method' to 'rate calculation method'. The software operation pricing of the input manpower method is not objectively calculated in the domestic IT outsourcing situation where the statistical data based on the activity based estimating is insufficient and it is decided by agreement between the owner and the client. In addition, there was no standard for adjusting the productivity according to the characteristics of the operation service. In order to improve this, an operational correction factor item that can affect the software operation productivity was selected based on foreign and domestic standards, and it was confirmed through the first questionnaire to IT operation managers. In order to determine the level of difficulty of the fixed operational correction factors, the operational correction factor using AHP technique was confirmed through a second questionnaire for pairwise comparison. The operational difficulty calculation table was developed with reference to COCOMO and ITIL standards. Finally, we propose a new pricing scheme that reflects the operating rate. Regression analysis was carried out by collecting the data of the domestic public institutions on the estimated cost and the actual cost calculated from the new rate method software operation pricing. The results of the regression analysis show that the estimated cost and the actual cost are related to each other. Mean magnitude of relative error(MMRE) and PRED[25] analysis were added for accuracy analysis. MMRE and PRED also showed satisfactory results, confirming the possibility of replacing the rate method software operation pricing.

The Working Conditions and Job Satisfaction of the School Cafeteria Employees according to their Employment Type in Chonbuk, South Korea (전북지역 학교급식소 조리종사원의 고용형태에 따른 근무환경 및 직업만족도 연구)

  • Rho, Jeong-Ok;Choi, Sun-A
    • Korean Journal of Human Ecology
    • /
    • v.19 no.4
    • /
    • pp.733-744
    • /
    • 2010
  • This study investigated the working conditions and job satisfaction of school cafeteria, according to their employment type in Chonbuk, South Korea. Self-administered questionnaires were collected from 401 elementary, middle, and high school cafeteria employees. The data showed significant differences between regular and irregular employees. These factors were: previous work experience (p<.001), type of school (p<.001), the style of foodservice at a school (p<.001), the type of foodservice system (p<.05), and the number of meals served each day (p<.001). The working conditions for regular and irregular employees were significantly different with regard to several factors: these were union membership (p<.01), how they were paid (p<.05), their total working hours (p<.01), and difficulty of using their holidays (p<.01). Approximately 80.5% of the subjects were dissatisfied with the working conditions after the introduction of countermeasures for irregular employees. Results indicated that the average employee job satisfaction level was 2.53, but that there were not significant difference in the level of job satisfaction when comparing regular and irregular employees. The item employees were most satisfied with was having responsibility over meals for young students (3.37). They were least satisfied with their salary (2.00). An interesting issue for future study would be to determine the factors that could improve job satisfaction whilst satisfying the employees' needs which in turn would improve the quality of foodservice.