• Journal of Information Technology Services
• /
• v.19 no.1
• /
• pp.113-127
• /
• 2020

Current web accessibility checks and automatic assessments have been pointed out that the assessment items and scores are evaluated from the developer's point of view rather than from the user's one. In addition, although most of the grades of an automatic assessment on the public web sites are excellent because they are built in accordance with the web accessibility development guidelines, not a few web sites shows relatively low grades in evaluating their usability test made by those users. Taking into account the inadequacy of these web accessibility assessments, this study has identified the differences between the grades of usability evaluations and automatic evaluations for people with low vision and analyzed the major factors affecting web accessibility usability evaluations using Repertory Grid Techniques. Also, the Hard Laddering method of the Means-End Chain theory was adopted to visualize the relationship between Attributes-Conferences-Value and a hierarchical value system analysis based on FGI(Focused Group Interview) to people with the low vision. This study proposed the measures to improve the current web accessibility automatic assessment allocation, expert evaluation criteria, and user task assessment. In particular, it is a web accessibility user evaluation model that can consider the web accessibility quality certification criteria and user review assessment by directly analyzing the user cognitive structure and value system. This study is expected to be useful as a research to enhance the quality of web accessibility assessment.

• The Journal of Society for e-Business Studies
• /
• v.17 no.3
• /
• pp.85-103
• /
• 2012

This study focused on user evaluation for personalized recommender systems with the integrated view of performance of the system and user attitude of recommender systems. Since users' evaluations of recommender systems can be affected by recommendation outcomes and presentation methods, both system performances based on outcomes and user attitudes formed by the presentation methods should be considered when explaining users' evaluations. However, an integrated view of system performance and user attitudes has not been applied to explain users' evaluation of recommender systems. Thus, the goal of this study is to explain users' evaluations of recommender systems under the integrated view of predictive features and explanation features at the same time. Our findings suggest that social presence, both accuracy and noveltyhave impacts onuser satisfaction for recommender systems. Especially, predictive features including accuracy and novelty affected user satisfaction. Novelty as well as accuracy is one of the significant factors for user satisfaction while recommender systems provided usual items users have experienced when systems provide serendipitous items. Likewise, explanation features with social presence and self-reference were important for user evaluation of personalized recommender systems. For explanation features, while social presence appears as one of important factors to user satisfaction of evaluating personalized recommendations, self-reference has no significant effect on user's satisfaction for recommender systems when compared to the result of social presence. Self-referencing messages did not affect user satisfaction but the levels of self-referencing are different between low and high groups in the experiment.

• Journal of the Ergonomics Society of Korea
• /
• v.32 no.1
• /
• pp.69-75
• /
• 2013

Objective: This study proposes an alarm display and compares it with the one(alarm tile display) widely used in main control rooms(MCRs) of nuclear power plants. Background: Catching up with the rapid development of computer technologies, advanced MCRs has been required. Using modern technologies of computers and visual displays, we have a lot of potential to improve user performance and satisfaction as well as safety in MCRs. Method: The alarm bar display has been proposed to reduce some potential problems of the alarm tile display in this study. Human factors evaluations were conducted to compare both types of displays. Two interfaces of bar alarm and tile alarm were simulated on the desktop computer for the user-involved experiment. Eight students participated in the experiment with the within-subject design. Results: The alarm bar was slightly better in terms of situation awareness, and preferred to understand alarm dynamics. The alarm tile was slightly or significantly better in other measures. Conclusion: Both alarm displays have their own advantages and disadvantages. Therefore, combining benefits of both displays can be used to optimize the design of alarm displays. Application: The proposed display is expected to compensate the existing displays for certain purposes.

• Journal of Information Technology Services
• /
• v.16 no.4
• /
• pp.161-176
• /
• 2017

Recently, most of the users can easily get access to a variety of information sources about companies, products, and services through online channels. Therefore, the online user evaluations are becoming the most powerful tool to generate word of mouth. The user's evaluation is provided in two forms, quantitative rating and review text. The rating is then divided into an overall rating and a detailed rating according to various evaluation criteria. However, since it is a burden for the reviewer to complete all required ratings for each evaluation criteria, so most of the sites requested only mandatory inputs for overall rating and optional inputs for other evaluation criteria. In fact, many users input only the ratings for some of the evaluation criteria and the percentage of missed ratings for each criteria is about 40%. As these missed ratings are the missing values in each criteria, the simple average calculation by ignoring the average 40% of the missed ratings can sufficiently distort the actual phenomenon. Therefore, in this study, we propose a methodology to predict the rating for the missed values of each criteria by analyzing user's evaluation information included the overall rating and text review for each criteria. The experiments were conducted on 207,968 evaluations collected from the actual hotel evaluation site. As a result, it was confirmed that the prediction accuracy of the detailed criteria ratings by the proposed methodology was much higher than the existing average-based method.

• The Journal of Korean Association of Computer Education
• /
• v.22 no.1
• /
• pp.63-78
• /
• 2019

This study aims to improve User eXperience (UX) of the diagnostic-supplement learning system for Basic academic skills which has been utilized by teachers nationwide since 2015 in order to provide a consistent and systematic support on students' basic academic skills in K-12 school contexts. To achieve the research objective, usability evaluations such as basic questionnaire about UX/UI of the system according to user types, user testing, in-depth interview, expert heuristics were conducted. In addition, user-centered system was suggested through developing and iteratively evaluating the prototypes based on the user requirements drawn from the findings of such quantitative and qualitative usability evaluations. This study has an implication in suggesting the user-friendly design through the UX/UI improvements of the diagnostic-supplement learning system for Basic academic skills.

• Korean Institute of Interior Design Journal
• /
• v.21 no.1
• /
• pp.20-29
• /
• 2012

The study was intended to evaluate common spaces of office building in view point of universal design. The common spaces were access road, main entrance, parking lot, corridor, and restroom. Two office buildings in Centum city of Busan were evaluated by their workers, each 100 ones. The check list for evaluating them consisted of 36 universal design elements which related to five common spaces. First, there were many universal design elements which need to be improved. Second, among five common spaces, restroom has the most elements to be rated low. First of all, at least one restroom for wheelchair should be provided each floor. Third, even though both of two office buildings were recently built, there were significant difference between their users' evaluations. This implies that the concept of universal design is not applied to office buildings well. Fourth, there were significant difference among users' evaluations according to age, especially in case of design related elements. This means that users' age is an important factor to be considered.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.19 no.1
• /
• pp.91-107
• /
• 2023

With the recent expansion of the commerce ecosystem, a large number of user evaluations have been produced. Accordingly, attempts to create business insights using user evaluation data have been actively made. However, since user evaluation can change after the user experiences the product, it is difficult to say that the analysis based only on reviews immediately after purchase fully reflects the user's evaluation of the product. Moreover, studies conducted so far on user evaluation have overlooked the fact that the length of time a user has used a product can affect the user's product evaluation. Therefore, in this study, we build a model that predicts the direction of change in the user's rating after use from the user's rating and reviews immediately after purchase. In particular, the proposed model reflects the product's period of use in predicting the change direction of the star rating. However, since the posterior information on the duration of product use cannot be used as input in the inference process, we propose a structure that utilizes information about the product's period of use using an auxiliary classifier. As a result of an experiment using 599,889 user evaluation data collected from the shopping platform 'N' company, we confirmed that the proposed model performed better than the existing model in terms of accuracy.

• International Journal of Knowledge Content Development & Technology
• /
• v.11 no.1
• /
• pp.85-111
• /
• 2021

This study aims to analyze users' assessment of electronic libraries in the mobile app market and promote service improvement based on this. To this end, the basic background and purpose of the research, research method, and research scope were first set, and the relevant literature and empirical prior studies were analyzed. Next, users' evaluations of electronic libraries were collected and analyzed from Google Play Store. Based on the results analyzed, measures to improve the quality of electronic libraries were discussed. Based on the results of the study, the following improvement measures are proposed. Need for systemic improvement and stabilization. Provision of applications suitable for multi-device environments. Resumption of services after systematic inspection after updating. Simplification of sign up, log in, and authentication procedures. User support through real-time chat. Introduction of a detailed assessment of reviews. Provision of guidance and user manual for electronic libraries. Improvements to expand user convenience, and Securing differentiation from other similar services.

• Journal of Korea Multimedia Society
• /
• v.23 no.1
• /
• pp.85-92
• /
• 2020

This paper analyzes the design and usability of maternal notebook mobile application and suggests the improvement direction of the application. The researcher compared and analyzed the functions of maternal notebook applications, conducted user interviews and expert evaluations. The conclusions of this study are the use of appropriate information volume, proportional screen division focusing on main functions, the use of GNB format of main menus, the prohibition of double menu configuration, the use of color consistent with the image of the service, the use of few font sizes, the use of appropriate colors in typography, the use of rich icons with uniform design, card format, list format, but also timeline and infographic forms that make rich user interface design. Maternal notebook application research is expected to be an important reference for research on similar mobile applications with complex functions such as information provision, user history, and community, along with improved research in healthcare design.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.10 no.2
• /
• pp.744-768
• /
• 2016

As various pieces of information can be provided through the web, schemes that provide search results optimized for individual users are required in consideration of user preference. Since the existing social search schemes use users' profiles, the accuracy of the search deteriorates. They also decrease the reliability of a search result because they do not consider a search time. Therefore, a new social search scheme that considers temporal information as well as popularities and user preferences is required. In this paper, we propose a new mobile social search scheme considering popularities and user preferences based on temporal information. Popularity is calculated by collecting the visiting records of users, while user preference is generated by the actual visiting information among the search results. In order to extract meaningful information from the search target objects that have multiple attributes, a skyline processing method is used, and rank is given to the search results by combining the user preference and the popularity with the skyline processing result. To show the superiority of the proposed scheme, we conduct performance evaluations of the existing scheme and the proposed scheme.