• 한국경영과학회지
• /
• 제13권1호
• /
• pp.29-29
• /
• 1988

In the past decade, considerable effort has been devoted unsuccessfully to the development of information technology (IT) evaluation frameworks in the information systems area. Based on the literature review in this area and the decision analysis field, two competing evaluation frameworks are developed in this study: the direct evaluation framework and the indirect evaluation framework. A case study on Firm K shows that the latter is more practically efficient and theoretically appropriate but requires the adequate training for practitioners in order not to get confused the weight of an evaluation variable with the product of this weight and the score of the variable. Another finding is that Weill's conversion effectiveness is neither possible nor necessary to measure in the process of evaluating an IT although it is in theory an important concept.

• 국제학술발표논문집
• /
• The 4th International Conference on Construction Engineering and Project Management Organized by the University of New South Wales
• /
• pp.426-431
• /
• 2011

The quality of performance evaluation on engineering consultants that provide design-related technical services is difficult to be measured, and only a handful of papers discussed the quality during the design stage. Although design cost is relatively far less than construction cost for a project, the decisions made in the design phase have a significant impact on the final products of the project, especially for large public construction projects. Therefore, this research focuses on reviewing and then establishing a performance evaluation framework for the consulting firms that execute detailed design and provide technical services for the Taipei Rapid Transit Systems (TRTS). By interviewing experts, this study first established a set of indicators to evaluate these firms' performance. Then, those indicators were incorporated into the four aspects of balanced scorecard (BSC) to establish the architecture of the evaluation mechanism. The weight of each indicator was calculated by analytic hierarchy process (AHP) from a survey conducted among experts. The results showed that the top-three indicators were quantity take-off, functions conformity, and budgeting. The framework of performance evaluation established by this study can be applied to measure service performance during the design stage. It not only facilitates the monitoring of consulting firms, but also helps to reduce unnecessary change orders and disputes during the construction stage.

• 한국수학교육학회지시리즈A:수학교육
• /
• 제44권2호
• /
• pp.215-228
• /
• 2005

The purpose of this study is to development the scoring framework for teacher knowledge of fractions. This framework is qualified in the content-validity by professional educators' evaluation and in the reliability by correlation coefficient. 2 math educators judged that this framework is composed of appropriate scoring category, scoring criterion, and scoring level. After 2 teachers scored the tasks, correlation coefficient was calculated between evaluators. The coefficient is evaluated high in that it is more than 0.80.

• 디지털산업정보학회논문지
• /
• 제10권4호
• /
• pp.127-132
• /
• 2014

Some laws and regulations may require internet service providers to provide services based on the age of users. Age verification in the online environment should be used as a tool to provide service that is appropriate to child based on age. Using the minimum attribute information, processes on age verification provides the proper guidance to the internet services. However, there is a lack of a globally accepted trust framework for age verification process including evaluation factors for age verification information. In this paper the federation model of user attributes were described and evaluation factors for the age verification information were suggested. Also using the suggested evaluation factors, performance evaluation of federation model of user evaluation was performed. To meet the requirements of evaluation factors, framework of federation model should consider the unlinkability pseudonym support, eavesdropping protection and cloning protection.

• Educational Technology International
• /
• 제24권2호
• /
• pp.295-329
• /
• 2023

The recent development of metaverse-related technology has led to efforts to overcome the limitations of time and space in education by creating a virtual educational environment. To make use of this platform efficiently, applying learning analytics has been proposed as an optimal instructional and learning decision support approach to address these issues by identifying specific rules and patterns generated from learning data, and providing a systematic framework as a guideline to instructors. To achieve this, we employed an inductive, bottom-up approach for framework modeling. During the modeling process, based on the activity system model, we specifically derived the fundamental components of the learning analytics framework centered on learning activities and their contexts. We developed a prototype of the framework through deduplication, categorization, and proceduralization from the components, and refined the learning analytics framework into a 7-stage framework suitable for application in the metaverse through 3 steps of Delphi surveys. Lastly, through a framework model evaluation consisting of seven items, we validated the metaverse learning analytics framework, ensuring its validity.

• 대한안전경영과학회지
• /
• 제17권1호
• /
• pp.215-224
• /
• 2015

International organization and airport operator have issued a guidance manual with regard to the sustainability specialized in airport by adopting environment friendly rating system and developing a variety of sustainable practices. The structure of framework is essential to the development of practical and effective sustainability guideline of airport. Evaluation criteria and method for airport sustainability properly designed is necessary for the assurance of the level of sustainability. In this study, evaluation criteria and method proper to airport after structuring of framework for airport sustainability will be suggested by reviewing a variety of reference documents issued from foreign and domestic organization.

• 대한안전경영과학회지
• /
• 제16권4호
• /
• pp.343-349
• /
• 2014

Many systems using RFID/USN were and are being developed. Some systems are used in practice and some are not. Generally, the main reasons not being used are: The prices of chips are too high considering the effects. The application domain is not appropriate for RFID/USN. So, various skills for higher sensing precision have been introduced like using multiple sensors and avoiding metals which deter sensings seriously. Now, it is time to evaluate systems which were developed using RFID/USN technology. However, no systematic approach has been made for the evaluation. In this paper, a framework using BSC is introduced for the evaluation of systems using RFID/USN. In this framework, some Critical Success Factors(CSF) are derived and some Key Performance Indices(KPI) are developed for each CSF.

• 한국기계기술학회지
• /
• 제13권2호
• /
• pp.9-19
• /
• 2011

Most real world design evaluation and risk-based decision support combine quantitative and qualitative (linguistic) variables. Decision making based on conventional mathematics that combines qualitative and quantitative concepts always exhibit difficulty in modelling actual problems. The successful selection process for choosing a design/procurement proposal is based on a high degree of technical integrity, safety levels and low costs in construction, corrective measures, maintenance, operation, inspection and preventive measures. In this paper, a design decision support framework using a composite structure methodology grounded in approximate reasoning approach and evidential reasoning method is suggested for design evaluation of machinery space of a ship engine room at the initial stages. An illustrative example is used to demonstrate the application of the proposed framework.

• Journal of Information Processing Systems
• /
• 제15권3호
• /
• pp.655-669
• /
• 2019

Supplier evaluation is of great significance in green supply chain management. Influenced by factors such as economic globalization, sustainable development, a holistic index framework is difficult to establish in green supply chain. Furthermore, the initial index values of candidate suppliers are often characterized by uncertainty and incompleteness and the index weight is variable. To solve these problems, an index framework is established after comprehensive consideration of the major factors. Then an adaptive weight D-S theory model is put forward, and a fuzzy-rough-sets-AHP method is proposed to solve the adaptive weight in the index framework. The case study and the comparison with TOPSIS show that the adaptive weight D-S theory model in this paper is feasible and effective.

• 국제학술발표논문집
• /
• The 1th International Conference on Construction Engineering and Project Management
• /
• pp.1058-1063
• /
• 2005

More and more organizations in construction industry adopt knowledge management system (KMS) to facilitate process of creating, acquiring, capturing, sharing, and using knowledge so as to improve the competitiveness, productivity and efficiency of their organization. In spite of the tremendous efforts devoted to KMS, the return of investment on KMS is usually a black box to the investor due to the lack of a systematic framework for performance evaluation of the KMS. This paper aims at fulfilling such need. A conceptual performance evaluation framework is proposed based on Balanced Scorecard (BSC) method. Then a preliminary case study is conducted to assess the applicability of the proposed framework in an A/E consulting firm to evaluate the performance of KMS.