• Journal of Information Science Theory and Practice
• /
• v.8 no.2
• /
• pp.68-78
• /
• 2020

This study is a preliminary study to develop an evaluation framework necessary for evaluating the DataON platform. The first objective is to examine expert perceptions of the level of DataON platform construction. The second objective is to evaluate the importance, stability, and usability of DataON platform features over OpenAIRE features. The third objective is to derive weights from the evaluation perspective for future DataON platform evaluation. The fourth objective is to examine the preferences of experts in each evaluation perspective and to derive unbiased evaluation criteria. This study used a survey method for potential stakeholders of the DataON platform. The survey included 12 professionals with at least 10 years of experience in the field. The 57 overall functions and services were measured at 3.1 out of 5 for importance. Stability was -0.07 point and usability was measured as -0.05 point. The 42 features and services scored 3.04 points in importance. Stability was -0.58 points and usability was -0.51 points. In particular, the stability and usability scores of the 42 functions and services provided as of 2018 were higher than the total functions were, which is attributed to the stable and user-friendly improvement after development. In terms of the weight of the evaluation point, the collection quality has the highest weight of 27%. Interface usability is then weighted 22%. Subsequently, service quality is weighted 19%, and finally system performance efficiency and user feedback solicitation are equally weighted 16%.

• International Journal of Computer Science & Network Security
• /
• v.23 no.3
• /
• pp.123-129
• /
• 2023

The most effective tutoring method is one-on-one, face-to-face in-person human tutoring. However, due to the limited availability of human tutors, computer-based alternatives have been developed. These software based alternatives are called Intelligent Tutoring Systems (ITS) which are used to tutor students in different domains. Although ITS performance is inferior to that of human teachers, the field is growing and has recently become very popular. User interfaces play key role in usability perspective of ITS. Even though ITS research has advanced, the majority of the work has concentrated on learning sciences while mostly disregarding user interfaces. Because of this, the present ITS includes effective learning modules but a less effective interface design. Usability is one approach to gauge a software's performance, while "ease of use" is one way to assess a software's quality. This paper measures the usability effectiveness of an ITS which is designed to teach Object-Oriented (OO) analysis and design concepts using Unified Modeling Language (UML). Computer Supported Usability Questionnaire (CSUQ) survey was conducted for usability evaluation of UML-ITS. According to participants' responses to the system's usability survey, all responses lie between 1 to 3 scale points which indicate that the participants were satisfied and comfortable with most of the system's interface features.

• Archives of design research
• /
• v.17 no.1
• /
• pp.253-264
• /
• 2004

The final goal of this research is development of graphic design evaluation methodology in elevation of a usability at the mobile internet services and of measurement model which can forecast user needs in interface design, and systemize evaluation basis. For this, we systemize core contents of GUI design evaluation methodology and embodied UI design support system that supports prototype layout and evaluation process directly. The sight language that can inform flow of controled information by the quick and implicated method so that user may complete task in a short time without overload of recognition in limited display environment of Small Screen device it must improve objectivity in the reflection of UI design with image. Thus evaluation methodology that can evaluate usability of mobile internet systematically is important and specially, graphic design evaluation model which can forecast user's design need and trend is meaningful because of special quality that can reflect sensitive aspect of user in interface design. Mobile internet GUI was done by the result of this design evaluation, and I hope this result can be utilized for the GUI development of Ubiquitous environment for the future research.

• International Journal of Internet, Broadcasting and Communication
• /
• v.12 no.1
• /
• pp.27-36
• /
• 2020

The popularization of smartphones allows people to instantly get the information that they want, through mobile apps, including financial services, movies and public transportation reservations, games and shopping. Furthermore, leisure activities through overseas travel are increasing due to the improvement of the living standards of people. These increases in overseas travel and the use of mobile apps lead to the increased use of mobile travel apps when booking tour packages. Although there are many studies on the usability assessment and user interface improvement for mobile apps, studies on the usability assessment for mobile travel apps are limited. We tested the usability for mobile travel apps to present some suggestions for improvements so that anyone can purchase travel packages easily and simply. We selected the top three mobile travel apps on Rankey.com that have different UIs. The heuristic method was used to evaluate usability. We present a better UI to allow users to use the app functions more easily by analyzing user interaction, ease of learning, readability, efficiency, and satisfaction for the entire use.

• Journal of Information Technology Services
• /
• v.7 no.4
• /
• pp.179-198
• /
• 2008

It is widely known that usability is a critical quality attribute of IT systems. Many studies have developed various methods for finding out usability problems. Usability professionals have emphasized that usability should be integrated into the development life cycle in order to maximize the usability of systems with minimal cost. To achieve this, it is essential to classify usability problems systematically and connect them into the activities of designing user interfaces and tasks. However, there is a lack of framework or method for these two problems and thus remains a challengeable research issue. As a beginning study, this paper proposes a conceptual framework for addressing the two issues. We firstly summarize usability-related studies so far, including usability factors and evaluation methods. Secondly, we review seven approaches to identifying and classifying usability problems. Based on this review and opinions of usability engineers in real industry as well as the review results, this paper proposes a framework comprising three viewpoints, from which more sound classification scheme of usability problems can be inductively developed.

• Journal of the Ergonomics Society of Korea
• /
• v.30 no.6
• /
• pp.765-773
• /
• 2011

Objective: This study aims towards exploring a model of the HCI evaluation methods to improve the usability of mobile device, based on a case of a Mobile PDA system in a Museum context. Background: Mobile PDA systems in a Museum context is widely utilized for the educational purposes, but it is criticized for low usability that the device only play a role in textbooks on legs without any interactive educational activities. Therefore, the usability improvements on the mobile PDA system should be considered. Method 1: This model was developed with a combination of the expert review and the user testing, and with a combination of the qualitative and quantitative studies. In more details, first of all, a qualitative study was conducted as a combination of three different methods: 1) expert review with heuristics, 2) interviews with persons working in a museum, and 3) contextual enquiry. Results 1: The experts review provided with critical usability issues, and the semi-constructive interview helped to understand the background of the mobile device. Lastly, the contextual enquiry showed user experience problems and directions of improving the device from user's perspective. Method 2: Based on the results of the qualitative study, a questionnaire was designed. Results 2: The analysis of the quantitative study was conducted to generalize the problems, and prioritize the direction of improving the device within the limitation of the cost and time in a museum. Conclusion: This study has implications in developing an example of a HCI evaluation model to improve the user experience of the mobile device as well as finding problems and directions of how to improve the mobile PDA systems in the museum. Application: In fact, most of the studies related to the evaluation of the mobile device have been conducted in a laboratory context due to the cost and time. This paper, however, attempted to apply to various HCI research techniques from different constituents in real context.

• Journal of the Ergonomics Society of Korea
• /
• v.28 no.2
• /
• pp.17-26
• /
• 2009

In this study, anthropometric analysis and usability evaluation for four-wheeled walker were carried out and then ergonomics design guidelines were proposed. In anthropometric analysis, design factors of four-wheeled walker were firstly identified and anthropometric design guidelines were made using Korean human scales. Design suitability for two typical four-wheeled walkers was analyzed in based on anthropometric design guidelines. Usability evaluation for two typical walkers was also performed through observation method and expert evaluation. Several usability problems were identified and design solutions were proposed for the design improvement of four-wheeled walker. Finally a design model of four wheeled walker considering analysis results was proposed.

• Korea Science and Art Forum
• /
• v.20
• /
• pp.409-419
• /
• 2015

Service Design Platform which has been developing under the sponsorship of the Ministry of Knowledge Economy is aimed at facilitating service design consultancy to carry out service design projects smoothly online. In the development process in order to verify and improve the usability of the platform, heuristic evaluations by usability experts along with usability test done by user participation are required. This study was conducted for the purpose of deriving appropriate evaluation areas and detailed evaluation indices prior to carrying out the heuristic evaluation. For the study, first, the concept of the service design platform was identified and the features of its component were analyzed. Second, based on literature study of standards which are related to usability evaluation indices, usability evaluation areas and indices were analyzed. Third, in order to establish and verify evaluation areas and indices which are appropriate for the evaluation, Delphi survey was conducted and its validity was verified. Through this study, evaluation indices with 4 evaluation areas and 45 detailed items were derived. Derived evaluation indices was made in the form of checklist and will be utilized for heuristic evaluation by usability experts.

• 한국HCI학회:학술대회논문집
• /
• 2008.02b
• /
• pp.608-613
• /
• 2008

Web usability for e-commerce sites becomes a more important issue as e-commerce gains its popularity. As for fresh foods, consumers are especially sensitive to the quality of information during transaction process. Successful fresh food e-commerce sites, such as Wine. com and Tesco, identified regular usability testing as part of key success factors. This paper aims to identify processes for evaluating usability of fresh food e-commerce sites and provide recommendations to improve usability. The study aims to evaluate Web usability of selected Web sites using heuristic evaluation to provide objective Web usability analysis for each transaction process and think aloud method to understand how users actually evaluate the Web site.

• Journal of the Ergonomics Society of Korea
• /
• v.33 no.5
• /
• pp.407-422
• /
• 2014

Objective: The purpose of the study is to develop quantitative usability evaluation criteria for senior-friendly autonomous transportation robot. Background: The Republic of Korea has become the most rapidly aging society, and is anticipated to enter the post-aged society in 2026. To raise the quality of life of a senior with limited mobility and to reduce the burden of caregivers, many high-tech assistive products with information technologies are developed nowadays. The senior-friendly autonomous transportation robot is one person robot vehicle to move a senior to the destination for hospitals, nursing homes or silver town complex. With built-in navigation system and environmental monitoring censors, it automatically seeks the path to the destination and avoids collision to obstacles and pedestrians on the way. Due to the early stage of the product, few usability studies in this field have been done, mostly on general service robots to assist seniors, power wheelchairs and delivery robots. ISO and KS standards for the service robots are focused on safety. Method: Based on the reference usability index, the early draft of the usability evaluation questionnaires was developed. After small group tests and interviews, the experts modified the initial draft to the Usability Evaluation Criteria for Senior-Friendly Autonomous Transportation Robot (UEC-SFATR). Result: UEC-SFATR consisted of 4 subscales - Safety, Controllability, Efficiency and Satisfaction. All of the 4 subscales of UEC-SFATR were passed the reliability criteria by 4 groups of seniors, divided by gender and familiarity of smart-devices. Conclusion: UEC-SFATR covers wider area of user experiences of the SFATR and is a good measurement tool to help both the users and developers of the robot. Application: This study provides guide to the future product development and product competitiveness evaluation by quantifying user experiences for the SFATR.