• Journal of Information Technology Applications and Management
• /
• v.11 no.2
• /
• pp.45-64
• /
• 2004

Many researchers have proved that information systems auditing is a very effective tool for improving information systems quality. However, information system auditing in Korea still includes many subjective judgements. This study deals with applying a quantitative model to improve information system auditing quality on security domain. First of all, we have looked at previous researches on information systems audit, especially on security audit. Based on this survey, we have come up with solutions to improve the evaluation efficiency on security audit. We have merged the security audit guidelines of NCA and KISA, and developed a quantified evaluation scheme. We have proved the validity of this model by interviews with experts and by case studies.

• International Journal of Contents
• /
• v.7 no.3
• /
• pp.48-59
• /
• 2011

The present thesis is on a construction of the system which supports exhibition evaluation of curators, which automatically collects, keeps, and totalizes objective data on visitor behavior in museums, and which comprehensively displays the results by tables and graphs. The system is composed by access points and mobile exhibition exposition devices in the museum operating together. Obtainable visitor information include a user number, an average staying period, contents use hour, and exhibition viewing frequency. Prototype experiment at museums shows that the system is effective in efficient data collection and exhibition evaluation and is expected to become an information collecting tool for visitor research and an exhibition evaluation tool for exhibition improvement.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.5
• /
• pp.2610-2628
• /
• 2019

Advanced persistent threats (APTs) are constant attacks of specific targets by hackers using intelligent methods. All current internal infrastructures are constantly subject to APT attacks created by external and unknown malware. Therefore, information security officers require a framework that can assess whether information security systems are capable of detecting and blocking APT attacks. Furthermore, an on-line evaluation of information security systems is required to cope with various malicious code attacks. A regular evaluation of the information security system is thus essential. In this paper, we propose a dynamic updated evaluation framework to improve the detection rate of internal information systems for malware that is unknown to most (over 60 %) existing static information security system evaluation methodologies using non-updated unknown malware.

• Journal of Information Science Theory and Practice
• /
• v.1 no.3
• /
• pp.12-32
• /
• 2013

The paper introduces the research area of interactive information retrieval (IIR) from a historical point of view. Further, the focus here is on evaluation, because much research in IR deals with IR evaluation methodology due to the core research interest in IR performance, system interaction and satisfaction with retrieved information. In order to position IIR evaluation, the Cranfield model and the series of tests that led to the Cranfield model are outlined. Three iconic user-oriented studies and projects that all have contributed to how IIR is perceived and understood today are presented: The MEDLARS test, the Book House fiction retrieval system, and the OKAPI project. On this basis the call for alternative IIR evaluation approaches motivated by the three revolutions (the cognitive, the relevance, and the interactive revolutions) put forward by Robertson & Hancock-Beaulieu (1992) is presented. As a response to this call the 'IIR evaluation model' by Borlund (e.g., 2003a) is introduced. The objective of the IIR evaluation model is to facilitate IIR evaluation as close as possible to actual information searching and IR processes, though still in a relatively controlled evaluation environment, in which the test instrument of a simulated work task situation plays a central part.

• Journal of the Korea Society of Computer and Information
• /
• v.26 no.2
• /
• pp.229-235
• /
• 2021

Blockchain, recognized as one of the core technologies of the 4th industrial revolution, is an Internet-based distributed data management system which does not require centralized control. Blockchain is characterized by the integrity and reliability of information, and blockchains can be used where such characteristics are required. Typical applications of blockchain include finance, transaction, and evaluation management. In this paper, we designed a blockchain-based evaluation management system that allows users to freely create and manage evaluation instances. Evaluation managers can create an evaluation instance according to their purpose and allocate evaluation items and evaluators. When the evaluators finish evaluating the evaluation items, the evaluation manager can aggregate the evaluation results for the instance. Someone, who want to perform evaluation for various purposes but do not have an evaluation system, can implement the evaluation system relatively simply by using this system. In addition, due to the characteristic of the blockchain, evaluators cannot modify the evaluation scores they have already recorded, and neither the system administrator nor the evaluation administrator can modify the evaluation scores. For this reason, the reliability of the evaluation increases.

• Journal of Information Technology Applications and Management
• /
• v.15 no.1
• /
• pp.203-224
• /
• 2008

The purpose of this study is to investigate the evaluation perspectives of IT business value and empirically analyze the differences of evaluation perspectives between ex ante evaluation and post implementation evaluation, and among various information system types. 4 evaluation perspectives which have been used in the previous studies and in the field of industry practices are financial, customer, internal process, and growth, which are based on the BSC model. Data of 98 information systems have been collected from 89 companies including manufacturers, banks, insurances, and stock trading companies. As results of multi-way MANOVA test, 3 out of 8 hypothesis have been accepted statistically. While the order of importance of 4 perspectives in ex ante evaluation is customer, financial, internal process, and growth, the order of post implementation evaluation appears to be much different : that is, internal process, customer, financial, and growth. These findings provide insights for both IT practitioners and researchers.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.6 no.3
• /
• pp.191-201
• /
• 2010

The Korean central government has been investing a lot of efforts to promote performance of local governments. For example, the Ministry of Public Administration and Security (MOPAS) supported the local governments to develop and provide with a 'balanced score card' and a 'customer satisfaction innovation. ' Many other central ministries also conducted individual evaluations for local governments in their substantive policy areas. These evaluation systems of 78 appraisals for local governments conducted by the MOPAS and other ministries had made the local governments to work harder. However, most local governments have appealed their 'reform fatigue' caused by the overlapping evaluation systems. In this context, the MOPAS initiated merging the evaluations into a co-evaluation system under the new Government Performance Evaluation Act of 2006. In this process of introduction of new evaluation system, there are two significant movements. Firstly, as Korean Government has strong information technology, MOPAS has developed 'Virtual Policy Studio (VPS)' which evaluates the performance of each local government with on line. In other words, in the co-evaluation system for local government performance most evaluation steps are implemented by computer and Internet. So most stakeholder can access and work on the VPS in real time when they want to. And the other thing is that cooperation among stakeholders has been occurred in the co-evaluation system. Furthurmore the cooperative governance is systemized and sustain for a long time because MOPAS made IT based co-evaluation system. Therefore this paper intends to illustrate the process of introduction of VPS, main process of co-evaluation system based on VPS and analyze collaborative governance of the co-evaluation system.

• Journal of Information Technology Applications and Management
• /
• v.11 no.4
• /
• pp.61-85
• /
• 2004

It is tried that evaluation areas and items of information system in public sector are derived ration-ally and its weight value call be applied differently to type of information system to enhance validity and objectiveness of measurement in evaluating IS in this research. To obtain the goal of this research, firstly, five sectors - system sector, user sector, organization and management sector, the degree of strategic contribution to IS, and the degree of optimizing re-source in IS - are categorized based on broadly reviewing previous theoretical and practical research. Secondly, IS type in public sector is divided into internal operation one and customer oriented one that is object of the IS, and divided into application oriented and IT infrastructure oriented which are influence by IS. Thirdly, evaluation areas and its items are measured by 5 point scales (Likert summated scales) in addition to analysis of validity and reliability to improve objectiveness of establishing evaluation areas and its items. Fourthly, the weight values in the evaluation areas and its items are derived by using analytic hierarchy process. According to the results of analysis of weight value through AHP, it were found to be 30.4% to organization and management sector. 25.5% to degree of strategic contribution, 21.0% to user sector, 13.5% to degree of optimization of resource management, and 9.6% to system sector. and. different weight values each of the four IS type are proposed which establishing in this research. The main implications of this study is that the criteria by which IS in public sector can be categorized 4 ones is suggested and The weighted evaluation for four types of IS based on the AHP analysis enables proposing an objective evaluation method of IS in public sector for considering individual IS characterics.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.17 no.4
• /
• pp.1020-1027
• /
• 2013

Today, Educational serious games are occupying a large portion of the serious game market but there is a lack of the quality evaluation systems for providing useful quality evaluation information about educational serious game to user or developer. Although the existing metadata management system for serious game is developed, the system had not provided a function to manage the quality evaluation information for educational serious game. Therefor the development of quality evaluation management system of educational serious game is a very important challenge. We proposed design of the system for managing a metadata and a quality evaluation for educational serious game. The advantage of our system is that the system provide a lot of reliable useful information for general users and developers, and support an easy and convenient tool to manage the metadata and quality information to managers.

• International journal of advanced smart convergence
• /
• v.8 no.4
• /
• pp.1-8
• /
• 2019

The online retail market continues to grow, especially in China, as e-commerce has developed rapidly in recent years in many countries. Meanwhile, the development and use of new network information technology provides consumers with various contact and experience environments for online shopping. Based on the theory of media weakness, the study began to focus consumer experience on the nature of commercial transactions. The study proposed and designed an initial measure of the consumer information evaluation index, which combines previous findings with implications. Finally, the five-dimensional B2C system was established to evaluate consumers' information experience providing information display, information interaction, information support and information personalization. We researched on evaluation index system for information experience of B2C e-commerce consumers based on samples of Chinese consumers.