• Journal of Information Science Theory and Practice
• /
• v.1 no.3
• /
• pp.12-32
• /
• 2013

The paper introduces the research area of interactive information retrieval (IIR) from a historical point of view. Further, the focus here is on evaluation, because much research in IR deals with IR evaluation methodology due to the core research interest in IR performance, system interaction and satisfaction with retrieved information. In order to position IIR evaluation, the Cranfield model and the series of tests that led to the Cranfield model are outlined. Three iconic user-oriented studies and projects that all have contributed to how IIR is perceived and understood today are presented: The MEDLARS test, the Book House fiction retrieval system, and the OKAPI project. On this basis the call for alternative IIR evaluation approaches motivated by the three revolutions (the cognitive, the relevance, and the interactive revolutions) put forward by Robertson & Hancock-Beaulieu (1992) is presented. As a response to this call the 'IIR evaluation model' by Borlund (e.g., 2003a) is introduced. The objective of the IIR evaluation model is to facilitate IIR evaluation as close as possible to actual information searching and IR processes, though still in a relatively controlled evaluation environment, in which the test instrument of a simulated work task situation plays a central part.

• Journal of the Korean BIBLIA Society for library and Information Science
• /
• v.26 no.2
• /
• pp.269-287
• /
• 2015

The purpose of this study is discussing the applicability of a logic model as a mean measuring library outcomes. For a case study, this paper suggested a full framework for Reading Academy, a reading program for children and adolescents. Among the outcomes composing of the framework, medium-term outcomes were analyzed by manipulating the data the library have in its database. The findings say what the output evaluation could not show. In terms of book circulation, this program positively influenced to 52 percent of participants. Additionally, some participants joined reading book clubs after the program and some were likely to read books in various topics. This program, however, didn't make a positive impact on its re-attendance and other cultural programs' attendance. These findings indicate that the logic model contributes in the field of library outcomes and values.

• Journal of Korean Library and Information Science Society
• /
• v.53 no.3
• /
• pp.455-477
• /
• 2022

This study aimed to compare and analyze librarian teacher evaluation index from evaluation of teachers' competency development with the the topics of information utilization education. To this end, LDA topic modeling was conducted by collecting papers related to information utilization education published in four major journals in the field of literature and information from 1995 to May 2022. As a result of topic modeling, it can be seen that information utilization education (T10) was the most actively discussed at 12.0% of the 20 topics, followed by library utilization classes (T2) 10.4% and user service (T3) 8.8%.On the other hand, 3.3% of reading discussion (T7), 2.9% of reading education (T19), 2.1% of manpower management (T13), and 2.1% of librarian teacher job satisfaction (T17) showed the lowest distributions 3.3%, 2.9%, 2.1%, and 2.1%, respectively. In addition, although librarian teacher's class model development (T1) and curriculum development (T20) are essential processes for collaborative classes and information utilization education, they were not reflected in the current teacher competency development evaluation index. Therefore, this study proposed that 'instructional model and curriculum development' indicator should be added on 'training and support classes' factors in the Librarian Teacher Evaluation Index in Teachers' Competency Development Evaluation for further evaluation.

• Journal of the Korean Society for Library and Information Science
• /
• v.8
• /
• pp.183-207
• /
• 1981

Library standards have been the source of considerable controversy, whereas many problems are involved in developing stardard for university library collections. For evaluation purposes, standards should be precise, quantifiable and measurable. In the United States, however, standards for academic libraries are limited to qualitative statements and principles. Quantitative standards, when given, are ususally related to the number of population in the institution being served, or the prescribed quantitative objectives are often arbitrarily formulated by value judgements. The study in this paper attempts to explain the problems involved in developing quantitative standard for academic library collections. Two problems facing in the formulation of the optimal size of collection are identified. One is the theoretically faulty concept of adequacy of collection to meet the situations of diversity of university libraies, and the other is the difficulties in quantification and measurement, along with the lack of concept of adequacy of collection. However, quantification of adequate size of collection is proved to be useful on the pratical level, even though not valid theoretically. ACRL, Clapp/Jordan and Voigt developed formulas or models for setting the optimal size of a library collection for any particular university library. The main purpose of this study is the analysis of the above formulas. ACRL standard was drawn from obervation and analysis of statistcs in leading library collections. In academic field, this judgement appears to have been based on the assumption that a high-grade institution would be apt to have a good library collection. This study criticizes ACRL standard for its failure to include some determinants of measurements, and points out the limitations of the standard. In contrast. Clapp/Jordan developed a formula rather scientifically based upon bibliographical sources. This is similarly empirical but has the advantage of bringing into play the elements which make universities diverse in nature. Both ACRL and Clapp/Jordan formulas share two major defects. (1) the specific subject needs of the collection are not indiacted directly, and (2) percentage rate of growth is an indicator in measuring the potential utility of a collection. Thus both formulas failed to provide a basis for meaningful evaluation. Voigt further developed a model for determining acquisition rates for currently published materials based on bibliographic technique. Voigt model encourages experimentation with different programs and different allocations of input resources, designed to meet the needs of the library's particular population. Standard for university library collections can be formulated in terms of input(traditional indicator), or additionally, in terms of output(cost-effectiveness). Cost effectiveness is expressed as user satisfaction, ability to provide wanted materials within a reasonable time period. Thus simple quantitative method does not cover all the situations of diversity of university library collections, nor measures the effectiveness of collections. Valid standard could not be established without further research.

• Journal of Korean Library and Information Science Society
• /
• v.43 no.2
• /
• pp.77-98
• /
• 2012

Contracting out became popular in the public library sector since the early of 2000s. It is expected to lower cost of service provision, improve the quality of service provision, better timeliness of service through the discipline of the market and open competition. In practice the expectation was questionable. The numerous failures indicate either poor contract specification or unsuitability of the chosen contractor. The study analyzed 3 case studies of local governments where the entire entity of the public libraries service were decided contracting out and developed 5 criteria and 18 specific evaluation items as alternative evaluation structure. This evaluation model is expected to help to choose a suitable contractor in pubic library management.

• Journal of information and communication convergence engineering
• /
• v.15 no.3
• /
• pp.165-169
• /
• 2017

Altmetrics is an emergent research area whereby social media is applied as a source of metrics to evaluate scientific impact. Recently, the interest in altmetrics has been growing. Traditional scientific impact evaluation indictors are based on the number of publications, citation counts and peer reviews of a researcher. As research publications were increasingly placed online, usage metrics as well as webometrics appeared. This paper explores the potential benefits of altmetrics and the deep relationship between each metrics. Firstly, we found a weak-to-medium correlation among the 11 altmetrics and visualized such correlation. Secondly, we conducted principal component analysis and exploratory factor analysis on altmetrics of social media, divided the 11 altmetrics into four feature sets, confirming the dispersion and relative concentration of altmetrics groups and developed the altmetrics evaluation model. We can use this model to evaluate the scientific impact of articles on social media.

• Journal of the Korean BIBLIA Society for library and Information Science
• /
• v.5 no.1
• /
• pp.85-105
• /
• 1981

Information is an essential factor leading the rapid progress which is one of the distinguished characteristics in modem society. As more information is required and as more is supplied by individuals, governmental units, businesses, and educational institutions, the greater will be the requirement for efficient methods of communication. One possibility for improving the information dissemination process is to use computers. The capabilities of such machine are beginning to be used in the process of Information storage, retrieval and dissemination. An important problems, that must be carefully examined is whether one technique for information retrieval is better for worse than another. This paper examines problem of how to evaluate an information retrieval system. One specific approach is a cost accounting model for use in studying how to minimize the cost of operating a mechanized retrieval system. Through the use of cost analysis, the model provides a method for comparative evaluation between systems. The general cost accounting model of the literature retrieval system being designed by this study are given below. 1. The total cost accounting model of the literature retrieval system. The total cost of the literature retrieval system = (the cost per unit of user time X the amount of user time) + ( the cost per unit of system time X the amount of system time) 2. System cost accounting model system cost = (the pre-search system cost per unit of time X time) + (the search system cost per unit of time X time) + (the post search system cost per unit of time X time) 1) Pre-search system cost per unit of time = cost of channel per unit time + cost of central processing unit per unit time + cost of storage per unit time 2) Search system cost per unit of time = comparison cost + document representation cost. 3) Post-search system cost per unit of time. = cost of channel per unit time + cost of central processing unit per unit time + cost of storage per unit time 3. User cost accounting model Total user cost = [pre-search user cost per unit of time X (time + additional time) ] + [search user cost per unit of time X (time + additional time) ] + [post-search user cost per unit of time X (time + additional time) ].

• Journal of Korean Library and Information Science Society
• /
• v.34 no.3
• /
• pp.317-343
• /
• 2003

The purpose of this study is to develop a general model for web-based children's literature education and to validate the model. Both qualitative and quantitative methods were used for the analysis of this study. The findings of this research were three point. At First, the model of web-based children's literature education have five major components i.e., objects, construction of activity, display of activity, management of it, and evaluation of it. At second, the creative writing was revealed the core of the web-based children's education. The third, web-based children's literature activity can be followed by cyber learning community activities.

• Journal of the Korean BIBLIA Society for library and Information Science
• /
• v.21 no.4
• /
• pp.205-215
• /
• 2010

This study has extracted the basic component of the Library Course Pages through case studies of the Library Course Pages Service, and examined the staus quo of the Open Course Ware(OCW) for the sharing of the course materials. The study has also designed and established a ontology-based retrieval system model that is capable of semantic-based retrieval of the course materials in colleges. A comparison between and analysis of the past keyword search results was conducted to evaluate the model. Through evaluation, the study concluded that the ontology-based system was more effective than the keyword search method in both retrieval result and material sharing between the institutions.

• Journal of Korean Library and Information Science Society
• /
• v.45 no.3
• /
• pp.37-61
• /
• 2014

The goal of this study is to suggest the models for establishing and operating the collaborative repository for academic libraries by region in Korea. For this purpose, author analyzed the status of academic libraries by provinces and types, the collection space shortage of academic libraries, location and evaluation criteria of collaborative repository. And based on these analysis results, author proposed the basic principles, key functions and practices to accomplish, architectural scales of the collaborative repositories, transfer criteria and ownership model of library collection, desirable management and operation unit of the collaborative repository.