• 한국IT서비스학회지
• /
• 제6권2호
• /
• pp.161-175
• /
• 2007

Face recognition technology has lately attracted considerable attention because of its non-intrusiveness, usability and applicability. Related companies insist that their commercial products show the recognition rates more than 95% according to their self-testing. But, the rates cannot be admitted as official recognition rates. So, performance evaluation methods and tools are necessary to objectively measure the accuracy and performance of face recognition systems. In this paper, I propose a reference model for biometrics recognition evaluation tools, and implement an evaluation tool for the face recognition system based on the proposed reference model.

• 품질경영학회지
• /
• 제49권2호
• /
• pp.127-143
• /
• 2021

Purpose: Smart Safety Living Lab is a Living Lab facility, constructed and operated by KITECH in Korea, to support the user experience(UX) evaluation, planning and certification of smart safety products and services. The purpose of this study is to develop a UX evaluation methodology that accommodates the characteristics of the Living Lab and smart safety products and services for a systematic and efficient UX evaluation in the Smart Safety Living Lab. Methods: A generic model of UX evaluation was first derived based on a review of related literature. Then, the generic model is revised to accommodate the characteristics of the Smart Safety Living Lab and smart safety products and services, resulting in the UX Evaluation Methodology for Smart Safety Living Lab (SSLL-UXEM). Results: The developed SSLL-UXEM consists of a structured process for UX evaluation, a guideline for conducting each step of the process, and a set of forms for recording the major evaluation results in each step. Conclusion: SSLL-UXEM can help to enhance the efficiency of the UX evaluation process and the consistency of the UX evaluation results. SSLL-UXEM is also expected to serve as a basis for UX evaluation in various living lab environments in the future.

• 국제학술발표논문집
• /
• The 1th International Conference on Construction Engineering and Project Management
• /
• pp.719-724
• /
• 2005

It has been debating on the performance evaluation of professional construction management (PCM) services since its introduction to Taiwan's construction industry more than a decade ago. Several evaluation systems were proposed by previous researchers. However, there has no comparison study been conducted for the feasibility, effectiveness, and appropriateness of these systems to the performance management (PM) of practical PCM services. This paper is intended for this end to compare the existing PCM performance evaluation systems in Taiwan. A real world design/build (D/B) building project was selected for case study. The result of case study concludes and compares the pro's and con's of the three systems. At the end, it recommends strategies for selecting the most appropriate PCM performance evaluation for PCM services.

• Journal of Information Science Theory and Practice
• /
• 제8권2호
• /
• pp.68-78
• /
• 2020

This study is a preliminary study to develop an evaluation framework necessary for evaluating the DataON platform. The first objective is to examine expert perceptions of the level of DataON platform construction. The second objective is to evaluate the importance, stability, and usability of DataON platform features over OpenAIRE features. The third objective is to derive weights from the evaluation perspective for future DataON platform evaluation. The fourth objective is to examine the preferences of experts in each evaluation perspective and to derive unbiased evaluation criteria. This study used a survey method for potential stakeholders of the DataON platform. The survey included 12 professionals with at least 10 years of experience in the field. The 57 overall functions and services were measured at 3.1 out of 5 for importance. Stability was -0.07 point and usability was measured as -0.05 point. The 42 features and services scored 3.04 points in importance. Stability was -0.58 points and usability was -0.51 points. In particular, the stability and usability scores of the 42 functions and services provided as of 2018 were higher than the total functions were, which is attributed to the stable and user-friendly improvement after development. In terms of the weight of the evaluation point, the collection quality has the highest weight of 27%. Interface usability is then weighted 22%. Subsequently, service quality is weighted 19%, and finally system performance efficiency and user feedback solicitation are equally weighted 16%.

• 한국도서관정보학회지
• /
• 제25권
• /
• pp.441-474
• /
• 1996

Up to recently, information service have emphasized mainly on efficiencies of information collection, storage, process. But, now, many people take interest in criteria and evaluation on quality of information itself and its services because of growth of electronic materials and development of telecommunication. Especially, since the greater part of infomation is made gradually digital format, quality of information service regards as of great importance. This study attempts to investigate the quality problem in information services and its a n.0, pplication. Also, to su n.0, pport high quality, it is needed criteria of information services to evaluate and measure. To understand quality of information services, This articles deal with concept of quality on information related sector, quality management, the reason of importance of information quality, quality work of information services. There is little method to measure and evaluate quality of internet services. So it is necessary to study on internet quality, user's selection on its quality, and development on high quality site.

• 한국IT서비스학회지
• /
• 제3권1호
• /
• pp.117-126
• /
• 2004

In this study an evaluation method is proposed, with the strong relationship between the ante and post audit works evaluation. The ante evaluation does in general and systematic ways, with past audit results and proposals. The criteria-based evaluation is used for the audit activities and outputs. The critical success factors for the projects applies to the activities evaluation and product evaluation framework to the output. The ante and post evaluation have the cross evaluation items to be the whole and continuous one. Eighteen common evaluation items are derived, with their own evaluation elements in detail, which have only differences of the actually done and expectations between the ante and post. The proposed evaluation makes the ante and post one to be related with each other in a systematic and objective ways, to enhance the reliability of audit results and effectiveness of the audit.

• 한국응급구조학회지
• /
• 제24권3호
• /
• pp.41-53
• /
• 2020

Purpose: This study tests the validity of a standard evaluation tool of ambulance ride practices with new evaluation items and supports its application by 119 preceptors. Methods: We tested the validity of standard evaluation items collected from 19 on-site professionals assessing ambulance ride practices. New evaluation items, 'understanding of emergency rescue equipment' and 'ability to communicate', were added as additional criteria. The modified Delphi technique was used to test the three evaluation areas and ten evaluation items. We used the analytic hierarchy process to analyze the weighting value of the reconstructed evaluation tool model. Results: All three evaluation areas and 10 evaluation items within the standard evaluation tools used for ambulance ride practices corresponded with the consistency index, degree of convergence, and agreement in the modified Delphi panel. Conclusion: These results provide evidence of the consistency and usefulness behind preceptors' use of this standard evaluation tool in ambulance ride practice.

• 한국IT서비스학회지
• /
• 제10권2호
• /
• pp.141-162
• /
• 2011

The controls of Information Systems (IS) have been an more critical issue controls as the sophistication and integration of IS is more proceeded. ITGI (The Information Technology Governance Institute) of ISACA (Information Systems Audit and Control Association) has suggested COBIT (Control Objectives for Information and related Technology) and this has been widely recognized the evaluation model of IS controls. In COBIT, IS was evaluated in terms of process, information quality, and IT resources. This study used COBIT in order to suggest and empirically test an evaluation model of IS service. The data was collated from one major Chinese SI (Systems Integration) company in four domains of processes : planning and organization, acquisition and implementation, delivery and support, and monitoring. Seven factors are extracted using an exploratory factor analysis as follows : Overall IT planning process, technological assessment process in IT planning of IT, cost-benefit assessment process in IT planning, implementation process, support process, monitoring process, post-implementation evaluation process. The results of confirmatory analysis of three alternative measurement models indicated that the measurement model with one inherent or conceptual variable has greater model fitness than the other models. This study suggests the logical and general way to test and apply COBIT in evaluating IS services.

• 한국산업정보학회논문지
• /
• 제13권5호
• /
• pp.158-167
• /
• 2008

최근 정보기술의 발달로 유비쿼터스 컴퓨팅과 이를 이용한 유비쿼터스 서비스가 개발 중이거나 서비스 중이다. 향후 많은 산업에서 유비쿼터스 서비스 활용이 증가할수록 서비스에 대한 평가가 필수적이라 하겠다. 본 연구에서는 유비쿼터스 서비스의 평가를 위한 구체적인 평가항목을 도출하고 이들 간의 중요도를 산출하는 프레임워크를 제시하고자 한다. 이를 위하여 유비쿼터스 서비스의 평가와 관련된 문헌을 고찰하고 전문가의 의견을 수합하여 주요 평가항목의 결정과 계층적 분석과정 기법을 이용하여 항목간의 중요도를 산출하고자 하였다. 평가자 평가결과의 정확성을 보정하기 위해 퍼지(fuzzy) 개념을 활용하여 중요도를 계산하였으며 설문을 통하여 실제 특정 분야에서 유비쿼터스 서비스를 평가하기 위한 항목의 중요도를 도출하였다.

• 한국정보과학회논문지:소프트웨어및응용
• /
• 제36권1호
• /
• pp.1-9
• /
• 2009

분산된 환경에서 유사한 기능을 제공하는 서비스들의 수가 증가함에 따라, 웹서비스의 신뢰성은 매우 중요한 서비스 선택 요인이 되고 있다. 기업 간 협업과 같은 개방적 비즈니스 모델을 충족시키기 위해, 여러 단위 웹서비스들이 상호 연동하여 상위 수준의 비즈니스 트랜잭션을 형성하는 웹서비스 조합에서 신뢰성의 문제는 더욱 중요해진다. 그러나 단위 웹서비스 각각의 신뢰성이 보장된다고 해도, 조합된 서비스의 신뢰성은 보장되지 않는다. 따라서, 조합된 서비스의 신뢰성에 대한 평가 및 서비스 결정을 위한 방법이 필요하다. 본 논문은 웹서비스의 신뢰성을 평가하기 위한 신뢰도 평가 메트릭스를 정의하고, 이를 통해 조합된 웹 서비스의 신뢰수준을 추측하기 위한 평가 방법을 제안한다. 제안된 신뢰성 평가 모델을 기반으로 웹서비스 조합에서 신뢰할 수 있는 웹서비스 선택을 지원하기 위한 프레임워크를 정의한다. 서비스 사용자의 직관적인 선택이 아니라 정량적인 평가를 통한 선택이 이루어짐으로써, 사용자가 기능적 요구사항뿐만 아니라 품질 요구사항에서도 보다 만족할만한 선택 결과를 얻을 수 있을 것으로 기대한다.