• Title/Summary/Keyword: Outcomes Measurement

Search Result 307, Processing Time 0.026 seconds

The Evaluation Tool and Process for Effective Education Outcomes Measurement and Analysis of Computer Education

  • Kim, Young-Tak;Sim, Gab-Sig
    • Journal of the Korea Society of Computer and Information
    • /
    • v.21 no.9
    • /
    • pp.149-156
    • /
    • 2016
  • This paper is concerned with education courses operating practices for basic computer literacy training. In this study, we propose an example for students to effectively measure and evaluate the achievement of defined ability in the performance measurement and analysis, learning objectives and learning outcomes set in operation throughout the course. Through research and development use case presents the tools for teaching method and effective and objective measurement of the related subjects. And based on the results, we propose the possibility of utilizing NCS-based course operation and education certification. In this study, the measurement process is based on the association with the objective of the development and operation, and measurement tools, measuring tools for measuring learning outcomes associated with the curriculum design methods for the measurement and evaluation of the case of the operation of the course units of learning outcomes and the method proposed.

A Study on Building of Outcomes Evaluation System Using Data of a Public Library (공공도서관 데이터를 활용한 도서관 성과평가 시스템 구축 연구)

  • Han, Sang-woo;Park, Sung-jae
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.52 no.4
    • /
    • pp.163-178
    • /
    • 2018
  • The purpose of this study is to build outcomes evaluation system for measuring outcomes of programs provided by a public library. For the study, we constructed outcomes evaluation system(LibOutcomes system) that applied library outcome measurement framework based on the logic model and this system made librarians to measure outcome directly import data from the KOLAS and upload it. As a result, LibOutcomes system was useful for verifying outcomes as visual result. In addition, since the system was built a web-based system, it is possible to secure accessibility and ease of use. Finally, we suggested possibility to expand the system as a function of KOLAS in the future.

A Study on the Applicability of Concept Mapping in the Planning of Network Outcomes Measurement (네트워크 성과측정 기획을 위한 개념도 연구법(Concept Mapping) 적용가능성)

  • Kim, Ji-Young
    • Korean Journal of Social Welfare
    • /
    • v.59 no.3
    • /
    • pp.281-304
    • /
    • 2007
  • The purpose of this study is to verify the applicability of concept mapping in the process of planning of network outcomes in social welfare. Planning and evaluation of network outcomes involve many stakeholders. Recognizing the value and range of individuals' perspectives in the creation of a common framework is one of the biggest methodological challenges for planning of network outcomes. Concept mapping is a kind of methodology that creates a stakeholder-authored visual geography of ideas from a group. It uses both a quantitative and qualitative approach, including brainstorming, structuring the statement, specific analysis and data interpretation methods to produce maps that can then be used to guide planning and evaluation efforts on the issues that matter to the group. 13 network managers who work in the social welfare centers in Busan are core participants. The 50 statements on network outcomes from brainstorming session fell into six distinct clusters. After the interpretation session these clusters were rated according to the seven rating scales. This paper explores applicability of concept mapping in the process of planning of network outcomes in social welfare. Concept mapping helps stakeholders with different value and ideas about network outcomes to consensus on common conceptual framework. In addition, a multidimensional conceptualization of network outcomes was made. It will assist in designing future outcomes evaluation and guide the evaluators through a selection of key activities and outcomes.

  • PDF

A Study on Developing of Performance Evaluation Index and Method of Measurement for Information Security Outcomes applying BSC (균형성과표(BSC) 기반의 정보보호 성과 지표 개발 및 측정 방법에 관한 연구)

  • Jang, Sang Soo
    • Convergence Security Journal
    • /
    • v.14 no.4
    • /
    • pp.41-53
    • /
    • 2014
  • In order to achieve efficient and effective organizational information security objectives, for the level of information security to accurately evaluation and direction for improving that performance evaluation index and method of measurement for information security outcomes are needed. For information security activities of domestic companies to measure the performance or effectiveness, that standard method of measuring and the available evaluation Index are insufficient. company is difficult to investment for information security budget. Therefore, the purpose of this study was developing of performance evaluation index and method of measurement for information security outcomes applying BSC available in the company. The results of this study that companies can determine the level of information security itself. Analysis of the information security status and the strategy establishment of the information security investment can be applied.

Measurement of Public Research Outcomes: A Technology Valuation Method

  • Park, Jung-Min;Lim, Seong-Il;Seol, Sung-Soo
    • Asian Journal of Innovation and Policy
    • /
    • v.6 no.2
    • /
    • pp.206-224
    • /
    • 2017
  • This article proposes a logic model for assessing the performance of the outcome of public research as a technology valuation method. It consists of two parts and eight steps. The first part is a scoring system and the second part is a validation process of the performance index derived from scoring by valuation method. The scoring in the first part generally requires a focus group method to find out the value drivers and make an evaluation table. The reason why we call it the technology valuation method is that the first part is derived from the simple evaluation of technology value using checklists for value drive. The second part is the regular technology valuation process. The model is designed for the measurement of unquantifiable outcome. Is knowledge or scientific outcome comparable to the measured outcome? If possible, how big is the unquantifiable outcome? This model is based on financial valuation techniques with clear or acceptable market data. Therefore, it cannot work solely for unquantifiable outcomes without comparable measurable outcomes, unlike economic valuation.

An Exploratory Study on the Project Performance by PMO Capability (PMO 역량에 따른 프로젝트 성과에 관한 연구)

  • Bae, Jae-Kwon;Kim, Jin-Hwa;Kim, Sang-Yeoul
    • Asia pacific journal of information systems
    • /
    • v.18 no.1
    • /
    • pp.53-77
    • /
    • 2008
  • In recent years, although numbers of corporations are bringing in PMO, they seem to be indifferent to PMO performance measurement. This demonstrates that there are also other reasons beside performance measurement of information systems (IS) project being ambiguous by introducing PMO; the lack of acknowledging the concrete function of PMO, and the scarcity of empirical study about the effect of PMO on the project members and project performance. In this sense, this study is aimed at proposing a new research model in which project success factors (i.e., standardization, management advocacy, and staff expertise) affect PMO capability (i.e., knowledge management, resources management, and problem solving competency) positively, leading to project performance (i.e., task outcomes, psychological outcomes, and organizational outcomes) eventually. To empirically test the research model, data are surveyed from PMO department and IS department. To prove the validity of the proposed research model, PLS analysis is applied with valid 132 questionnaires. By employing PLS technique, the measurement reliability and validity of research variables are tested and the path analysis is conducted to do the hypothesis testing. The path analysis results can be organized into 7 ways in large scale. First, standardization of project success factors has a positive association with knowledge management, resources management, and problem solving competency of PMO capabilities. The findings of this result indicate that the multiple or single project management should satisfy standardization in order to operate an effective PMO. Second, management advocacy of project success factors has a positive association with knowledge management, resources management, and problem solving competency. Management advocacy refers to the willingness of management to provide the required resources and authority for project success. There is agreement among researchers regarding the importance of management advocacy for favorable PMO capability. Third, staff expertise of project success factors has a positive association with knowledge management, resources management, and problem solving competency. The findings of this result indicate that the formation of an exceptional consultant or members with a proficient knowledge for staff expertise of project member is the key factor to elevate the PMO capability. Past research suggests that experience and knowledge and the resultant familiarity with the problem faced can be an important determinant of PMO capability. A capable project with appropriate staff expertise means that it enjoys a diversity of abilities and experiences. Fourth, knowledge management competency of PMO capabilities has a positive impact on psychological outcomes but has no direct effect on task outcomes and organizational outcomes. In domestic case of S. Korea, PMO was finally introduced to many other corporations in 2005 though it started bringing in 2000. Therefore, it had neither a significant impact on the task outcomes nor organizational outcomes by lacking the contents and the infrastructure of the knowledge management because the knowledge consolidation and management period of PMO is comparatively shorter by terms than other foreign nations. Fifth, resources management competency of PMO capabilities has a positive association with task outcomes, psychological outcomes, and organizational outcomes. In addition, problem solving competency of PMO capabilities has a positive association with task outcomes, psychological outcomes, and organizational outcomes. Therefore, the findings of this results stress that PMO capabilities has a positive impact on project performance. Sixth, according to the path analysis of the hypothesis, which suggested in this research, problem solving competency is the PMO capability which is the key success factor for task, psychological, and organizational outcomes as an integrated performance model. Further, the analysis reveals that problem solving competency is an important factor for integrated performance model. The finding is in line with past IS research, which affirms that the work of IS projects is essentially a problem solving endeavor. Seventh, in the path analysis of the hypothesis in this research, the path of the management advocacy $\rightarrow$ problem solving competency $\rightarrow$ organizational outcomes appears to be the most important and strongest path. In brief, the finding of this study suggests that project success factors influence PMO capability positively, and project performance as well. From the results, it can be concluded that PMO helped great improve the project success rate and project performance. This study advances research on PMO capability in three important aspects. First, the findings of our study have implications for IS theory and future research. Our study contributes to IS theory by synthesizing concepts from PMO research and project management research with those in IS research. We proposed and tested PMO capability of IS projects and the findings of our investigation provided some preliminary answers to some of the questions raised. Secondly, this thesis does not only help depicting the concept of IT governance but also approaches empirically. It makes a gradual approach to the main content, step by step, in contrary of simple standard, scholastic way of thinking. Finally, we argued that this task-oriented(technical) view is not sufficient to adequately conceptualize IS project performance. Hence, we applied that the research on organization teams, which provides a flip viewpoint to that of project management research in that it gives more weight for psychological outcomes of organizational work groups, can be very helpful in reconceptualizing the IS project performance construct. The limitations of this study are also discussed to provide research directions for future research.

Core Safety Disposition as a Cause of Safety Consciousness (안전 의식의 결정 요인으로서 핵심 안전 성향)

  • Park, Young Seok;Jung, Ji Hee
    • Journal of the Korean Society of Safety
    • /
    • v.34 no.6
    • /
    • pp.58-64
    • /
    • 2019
  • Over the past decades there has been a growing body of researches that examines the psychological traits related to safety outcomes. After briefly reviewing the relationships between psychological dispositions and safety outcomes, we empirically examine the relationships with 2 samples of 1,102 participants. Fifteen psychological dispositions (big 5 personality, locus of control, cognitive failure, affection from job and relations, 4 achievement goal orientations, self-efficacy, fatigue, and depression) and four psychological outcomes (safe behavior, unsafe behavior, accidents, and injuries) are examined. After covariance structure modeling variances of safety outcomes are well explained by simple 4 dispositions of consciousness, mastery-approach goal orientation, self-efficacy, and depression. We name them 'core safety disposition', and name four psychological outcomes 'safety consciousness', and the relationships between those latent variables are stronger than between measurement variables. We propose core safety disposition as a cause of safety consciousness, and discuss implications for research and practices.

Framework for Course-Embedded Outcomes Assessment: A Case Study of Architecture & Building Engineering Program at KSNU (교과기반 학습성과 평가시스템 개발: 군산대학교 공학인 건축공학심화프로그램 사례 연구)

  • Pak, Sungsine
    • Journal of Engineering Education Research
    • /
    • v.23 no.1
    • /
    • pp.47-58
    • /
    • 2020
  • Kunsan National University obtained accreditation for its Architecture & Building Engineering Program from the Accreditation Board for Engineering Education in Korea (ABEEK) in 2004 and has offered an ABEEK-accredited degree pathway ever since. Then, in 2018, the university introduced the course-embedded outcomes assessment system as per ABEEK's KEC2015 accreditation criteria. One year into its implementation, the new system allows the measurement and assessment of 10 program outcomes covering 19 curricular modules and 1 non-curricular licensing examination. The system incorporates the four areas of specialization within architectural engineering as well as the three course categories of the math, science, and computer; liberal arts; and engineering core modules under the accreditation scheme. It also takes the students' academic years into account, especially for the mandatory modules offered to all students. Its rubric clarifies the performance criteria, performance level, assessment tools, objectives, and modules. The 2018 course-embedded outcomes assessment system is an ever-evolving structure with regular CQI: Continuous Quality Improvements along the circular process of system establishment → implementation → evaluation as per the virtuous cycle model required for an accredited engineering program.

Impact of Service Quality on Behavioural Intention to Use Fin Tech Payment Services: An Extension of SERVEQUAL Model

  • Vikas Sharma;Sanjay Taneja;Munish Gupta;KshitizJangir;Ercan Ozen
    • Asia pacific journal of information systems
    • /
    • v.33 no.4
    • /
    • pp.1093-1117
    • /
    • 2023
  • The study aims to determine the impact of quality outcomes on behavior intentions in Financial Technology (FinTech) payment services. The study is focused on the development and testing of the impact of the SERVQUAL model on the TAM, i.e., Technology Acceptance Model for the measurement of the behavioral intention of users to use fintech payment services. The sample entails 578 specific survey responses from northern India from October to December 2022. The respondents were users of FinTech. The PLS-SEM technique was employed to explain the implementation process. Consequently, it discovered a significant relationship between the SERVQUAL models and the impact on behavioral intentions identified by TAM. The study will provide insight into the factors that impact the quality outcomes and adoption of Fintech payment services to the providers. The paper demystifies FinTech payment services in the range of perception of service quality outcomes and provides essential theories. The TAM model reflects the customer's sense of satisfaction, usefulness, and attitude. In contrast, the SERVQUAL model demonstrates the user's assessment of service quality outcomes such as quality, trust, security, and service quality positively affects behavioral intention in FinTech payment services.

Estimating the AUC of the MROC curve in the presence of measurement errors

  • G, Siva;R, Vishnu Vardhan;Kamath, Asha
    • Communications for Statistical Applications and Methods
    • /
    • v.29 no.5
    • /
    • pp.533-545
    • /
    • 2022
  • Collection of data on several variables, especially in the field of medicine, results in the problem of measurement errors. The presence of such measurement errors may influence the outcomes or estimates of the parameter in the model. In classification scenario, the presence of measurement errors will affect the intrinsic cum summary measures of Receiver Operating Characteristic (ROC) curve. In the context of ROC curve, only a few researchers have attempted to study the problem of measurement errors in estimating the area under their respective ROC curves in the framework of univariate setup. In this paper, we work on the estimation of area under the multivariate ROC curve in the presence of measurement errors. The proposed work is supported with a real dataset and simulation studies. Results show that the proposed bias-corrected estimator helps in correcting the AUC with minimum bias and minimum mean square error.