• Journal of Information Technology Applications and Management
• /
• 제11권2호
• /
• pp.45-64
• /
• 2004

Many researchers have proved that information systems auditing is a very effective tool for improving information systems quality. However, information system auditing in Korea still includes many subjective judgements. This study deals with applying a quantitative model to improve information system auditing quality on security domain. First of all, we have looked at previous researches on information systems audit, especially on security audit. Based on this survey, we have come up with solutions to improve the evaluation efficiency on security audit. We have merged the security audit guidelines of NCA and KISA, and developed a quantified evaluation scheme. We have proved the validity of this model by interviews with experts and by case studies.

• International Journal of Contents
• /
• 제7권3호
• /
• pp.48-59
• /
• 2011

The present thesis is on a construction of the system which supports exhibition evaluation of curators, which automatically collects, keeps, and totalizes objective data on visitor behavior in museums, and which comprehensively displays the results by tables and graphs. The system is composed by access points and mobile exhibition exposition devices in the museum operating together. Obtainable visitor information include a user number, an average staying period, contents use hour, and exhibition viewing frequency. Prototype experiment at museums shows that the system is effective in efficient data collection and exhibition evaluation and is expected to become an information collecting tool for visitor research and an exhibition evaluation tool for exhibition improvement.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제13권5호
• /
• pp.2610-2628
• /
• 2019

Advanced persistent threats (APTs) are constant attacks of specific targets by hackers using intelligent methods. All current internal infrastructures are constantly subject to APT attacks created by external and unknown malware. Therefore, information security officers require a framework that can assess whether information security systems are capable of detecting and blocking APT attacks. Furthermore, an on-line evaluation of information security systems is required to cope with various malicious code attacks. A regular evaluation of the information security system is thus essential. In this paper, we propose a dynamic updated evaluation framework to improve the detection rate of internal information systems for malware that is unknown to most (over 60 %) existing static information security system evaluation methodologies using non-updated unknown malware.

• Journal of Information Science Theory and Practice
• /
• 제1권3호
• /
• pp.12-32
• /
• 2013

The paper introduces the research area of interactive information retrieval (IIR) from a historical point of view. Further, the focus here is on evaluation, because much research in IR deals with IR evaluation methodology due to the core research interest in IR performance, system interaction and satisfaction with retrieved information. In order to position IIR evaluation, the Cranfield model and the series of tests that led to the Cranfield model are outlined. Three iconic user-oriented studies and projects that all have contributed to how IIR is perceived and understood today are presented: The MEDLARS test, the Book House fiction retrieval system, and the OKAPI project. On this basis the call for alternative IIR evaluation approaches motivated by the three revolutions (the cognitive, the relevance, and the interactive revolutions) put forward by Robertson & Hancock-Beaulieu (1992) is presented. As a response to this call the 'IIR evaluation model' by Borlund (e.g., 2003a) is introduced. The objective of the IIR evaluation model is to facilitate IIR evaluation as close as possible to actual information searching and IR processes, though still in a relatively controlled evaluation environment, in which the test instrument of a simulated work task situation plays a central part.

• 한국컴퓨터정보학회논문지
• /
• 제26권2호
• /
• pp.229-235
• /
• 2021

제4차산업혁명의 핵심기술 중의 하나로 인식되고 있는 블록체인은 인터넷을 기반으로 중앙집중적인 제어가 없이도 작동되는 자율적인 분산 정보관리시스템이다. 블록체인은 정보의 무결성, 신뢰성 등을 특징으로 하며, 이러한 특징을 필요로 하는 곳에는 블록체인을 활용할 수 있다. 대표적인 응용으로는 금융, 거래, 평가관리 등을 들 수 있다. 본 논문에서는 블록체인을 기반으로 사용자들이 자유롭게 평가개체(instance)를 생성하고 관리할 수 있는 평가관리시스템을 설계하였다. 평가관리자는 자신의 목적에 맞게 평가개체를 하나 생성하고, 평가항목과 평가자들을 배정할 수 있다. 평가자들이 평가항목에 대해서 평가를 마치면 평가관리자는 해당 평가개체에 대해서 평가 결과를 집계를 할 수 있다. 여러 용도로 평가를 시행하고 싶지만 평가시스템을 갖추지 못한 경우에 본 시스템을 이용하면 이를 비교적 간단히 평가시스템을 구현할 수 있다. 또한 블록체인의 특성으로 인하여 평가자들은 자신이 이미 기록한 평가 값을 수정하지 못하며, 시스템 관리자 또는 평가 관리자 역시 평가 값을 수정하지 못한다. 이런 이유로 평가의 신뢰성은 높아진다고 볼 수 있다.

• Journal of Information Technology Applications and Management
• /
• 제15권1호
• /
• pp.203-224
• /
• 2008

The purpose of this study is to investigate the evaluation perspectives of IT business value and empirically analyze the differences of evaluation perspectives between ex ante evaluation and post implementation evaluation, and among various information system types. 4 evaluation perspectives which have been used in the previous studies and in the field of industry practices are financial, customer, internal process, and growth, which are based on the BSC model. Data of 98 information systems have been collected from 89 companies including manufacturers, banks, insurances, and stock trading companies. As results of multi-way MANOVA test, 3 out of 8 hypothesis have been accepted statistically. While the order of importance of 4 perspectives in ex ante evaluation is customer, financial, internal process, and growth, the order of post implementation evaluation appears to be much different : that is, internal process, customer, financial, and growth. These findings provide insights for both IT practitioners and researchers.

• 디지털산업정보학회논문지
• /
• 제6권3호
• /
• pp.191-201
• /
• 2010

The Korean central government has been investing a lot of efforts to promote performance of local governments. For example, the Ministry of Public Administration and Security (MOPAS) supported the local governments to develop and provide with a 'balanced score card' and a 'customer satisfaction innovation. ' Many other central ministries also conducted individual evaluations for local governments in their substantive policy areas. These evaluation systems of 78 appraisals for local governments conducted by the MOPAS and other ministries had made the local governments to work harder. However, most local governments have appealed their 'reform fatigue' caused by the overlapping evaluation systems. In this context, the MOPAS initiated merging the evaluations into a co-evaluation system under the new Government Performance Evaluation Act of 2006. In this process of introduction of new evaluation system, there are two significant movements. Firstly, as Korean Government has strong information technology, MOPAS has developed 'Virtual Policy Studio (VPS)' which evaluates the performance of each local government with on line. In other words, in the co-evaluation system for local government performance most evaluation steps are implemented by computer and Internet. So most stakeholder can access and work on the VPS in real time when they want to. And the other thing is that cooperation among stakeholders has been occurred in the co-evaluation system. Furthurmore the cooperative governance is systemized and sustain for a long time because MOPAS made IT based co-evaluation system. Therefore this paper intends to illustrate the process of introduction of VPS, main process of co-evaluation system based on VPS and analyze collaborative governance of the co-evaluation system.

• Journal of Information Technology Applications and Management
• /
• 제11권4호
• /
• pp.61-85
• /
• 2004

It is tried that evaluation areas and items of information system in public sector are derived ration-ally and its weight value call be applied differently to type of information system to enhance validity and objectiveness of measurement in evaluating IS in this research. To obtain the goal of this research, firstly, five sectors - system sector, user sector, organization and management sector, the degree of strategic contribution to IS, and the degree of optimizing re-source in IS - are categorized based on broadly reviewing previous theoretical and practical research. Secondly, IS type in public sector is divided into internal operation one and customer oriented one that is object of the IS, and divided into application oriented and IT infrastructure oriented which are influence by IS. Thirdly, evaluation areas and its items are measured by 5 point scales (Likert summated scales) in addition to analysis of validity and reliability to improve objectiveness of establishing evaluation areas and its items. Fourthly, the weight values in the evaluation areas and its items are derived by using analytic hierarchy process. According to the results of analysis of weight value through AHP, it were found to be 30.4% to organization and management sector. 25.5% to degree of strategic contribution, 21.0% to user sector, 13.5% to degree of optimization of resource management, and 9.6% to system sector. and. different weight values each of the four IS type are proposed which establishing in this research. The main implications of this study is that the criteria by which IS in public sector can be categorized 4 ones is suggested and The weighted evaluation for four types of IS based on the AHP analysis enables proposing an objective evaluation method of IS in public sector for considering individual IS characterics.

• 한국정보통신학회논문지
• /
• 제17권4호
• /
• pp.1020-1027
• /
• 2013

오늘날, 기능성게임 시장의 많은 부분을 교육용기능성게임이 차지하고 있지만 교육용기능성게임에 대한 유용한 품질평가 정보를 사용자 또는 개발자에게 제공하기 위한 품질평가 시스템은 부족한 실정이다. 비록 기능성게임을 위한 기존의 메타데이터 관리 시스템이 개발되어 있지만 기존 시스템은 교육용기능성게임의 품질평가 정보를 관리 할 수 있는 기능은 제공되지 않고 있다. 따라서 교육용기능성게임의 품질평가 관리시스템의 개발은 매우 중요한 과제이다. 우리는 교육기능성게임에 대한 메타데이터 및 품질평가를 모두 관리하기 위한 시스템의 설계를 제안하였다. 본 시스템의 장점은 일반사용자와 개발자에게는 신뢰할 수 있는 유용한 정보를 제공하고, 시스템 관리자에게 메타데이터와 품질정보를 쉽고 편리하게 관리할 수 있는 수단을 지원하는 것이다.

• International journal of advanced smart convergence
• /
• 제8권4호
• /
• pp.1-8
• /
• 2019

The online retail market continues to grow, especially in China, as e-commerce has developed rapidly in recent years in many countries. Meanwhile, the development and use of new network information technology provides consumers with various contact and experience environments for online shopping. Based on the theory of media weakness, the study began to focus consumer experience on the nature of commercial transactions. The study proposed and designed an initial measure of the consumer information evaluation index, which combines previous findings with implications. Finally, the five-dimensional B2C system was established to evaluate consumers' information experience providing information display, information interaction, information support and information personalization. We researched on evaluation index system for information experience of B2C e-commerce consumers based on samples of Chinese consumers.