• The Journal of the Korea Contents Association
• /
• v.19 no.5
• /
• pp.249-258
• /
• 2019

Currently, people are paying more attention to smart home businesses. Therefore, the research on smart home system is becoming important. Smart Home App, which is an important component of smart home system, needs to consider the development of evaluation indicators for usability. In this regard, this paper takes smart home App as the object to develop the usability evaluation indicators of smart home App design. For this purpose, this study performed three rounds of survey by using the Delphi method. In the first round, 8 suitable areas were selected by collecting opinions from experts and analyzing the Content Validity Ratio, which was derived from literature review. Based on the results of the first survey, a total of 38 evaluation items were collected through prior research and user interview surveys. For the 38 collected evaluation items, 27 evaluation items have been selected by analyzing Average Value, Standard Deviation, Content Validity Ratio, Consultation and Convergence in the second and third rounds. The result of this study can be used as a guideline when evaluating the usability of smart home App design.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.27 no.4
• /
• pp.843-853
• /
• 2017

In the case of electronic payment, the obligation to use the certificate-based authentication was abolished. As Fin-tech service providers gain autonomy, various authentication methods are provided. SMS, ARS, PIN, Text-passwords, Fingerprints are popular authentication methods in the mobile Fin-tech services. In this study evaluate the usability and security of authentication methods in a unified mobile environment. We evaluate the usability through SUS and interview. Also we evaluate the security level of authentication methods through NIST guideline. At the result of the usability evaluation, Fingerprint authentication method had been determined as the highest usability, also Fingerprint authentication method had been determined as the safest authentication method by obtaining Security Level 4.

• Archives of design research
• /
• v.12 no.3
• /
• pp.105-114
• /
• 1999

As the microelectronics technology is developed, new types of smart intelligent products are being emerged. OSD user interface is one of the critical factor in this kind of product, especially brown goods and information devices, as it is responsible for imput and output function. OSD is being treated as accompaniment to hardware in spite of its importance, and therefore is developed from only simple and separate usability testing based on performance measurement. This study propose a usability evaluation method of OSD based on subjective preference to support existing usability testing. The purpose of this analysis is to make clear what is important factor and how its preference level is from the user's viewpoint. The various attributes of OSD are clarified from user's questionaire and interview, and orthogonal array is generated with specified factor levels. The prototypes are generated from rapid prototyping tool and tested in natural simulation environment. The preference data which collected in this usability testing is analyzed with conjoint analysis module. This usability evaluation is not the final stage in user interface design process but the early planned and circulated stage.

• Journal of the Ergonomics Society of Korea
• /
• v.30 no.2
• /
• pp.331-338
• /
• 2011

Objective: The present study developed a comprehensive usability testing and analysis framework based on a physical interface model of product and user and applied the proposed framework to usability testing of canister-type vacuum cleaner. Background: The development of a user-centered product design is important to satisfy customers who want to use the product with ease of use and to keep the manufacturer competitive in the market. Method: The proposed testing and analysis framework consists of (1) characterization of physical product-user interface, (2) preparation and administration of usability testing questionnaire, and (3) analysis and interpretation of usability testing results. A usability evaluation of five vacuum cleaners was planned and administered based on the proposed framework and its analysis produced detailed and overall usability testing results for various aspects such as tasks, usability criteria, and design components. Results: The testing results were further utilized to identify usability problems and preferred design features of the vacuum cleaners. Conclusion: The proposed usability testing and analysis framework was found effective to identify preferred features and problems of a product design in a systematic, holistic manner. Application: The proposed framework can be of effective use for practitioners of product design and development to obtain comprehensive, quantitative usability testing information in a systematic manner.

• The Journal of the Korea Contents Association
• /
• v.16 no.8
• /
• pp.508-516
• /
• 2016

With the rapid development of Social Network Service and with the diversification of user needs, new types of image-based SNS have emerged. Image-based SNS provides customized service to meet users' specified contents needs that have yet to be satisfied in conventional relation-based SNS like Facebook, leading the trend of service diversification. Unlike text-based SNS that has inconvenient view on a small mobile screen, image-based SNS provides the communication way focused on simple text message and image, and thus the main users of the image-based SNS are young people in their 20s who get accustomed to images, rather than text messages. Accordingly, the functions and roles of SNS UI have varied, and usability has been more important. With the users in their 20s who use image-based SNS, this study tried to look into the usability of the image-based SNS. To do that, heuristic evaluation method was applied to find UI problems. The main factors constituting usability were extracted, and user evaluation method was redesigned. Aside from the satisfaction measurement, this study conducted and analyzed a questionnaire survey with users in their 20s who used actual image-based SNS. This study analyzed usability factors that influenced of image-based SNS users. The analysis results are considered to be used as a fundamental material to improve usability in the process of developing social media service.

• Journal of the Ergonomics Society of Korea
• /
• v.18 no.3
• /
• pp.87-103
• /
• 1999

The present study employed an experimental usability testing technique to explore cognitive engineering characteristics of WWW. Based on the results of our previous study which employed non-experimental methods such as questionnaire and heuristic evaluation method, this study used a behavioral performance-measurement technique to evaluate the usability of a domestic web-site design. Specifically, we revised the menu and document structure of the original 'Movie-Friend' site to solve the design problems which were extracted from the results of the heuristic evaluation method of our previous study. Exp. 1 compared the relative navigation efficiency of the original frame menu site and the revised pop-up toolbar site, and Exp. 2 compared the toolbar menu site and the revised frame site. As a result of Exp. 1, the revised pop-up toolbar site showed improved navigation efficiency compared to the original site, as indicated by the mean latency and the number of pathways to reach the target page. However, we found no performance difference between the frame site and toolbar site in Exp. 2.

• Journal of the Ergonomics Society of Korea
• /
• v.19 no.3
• /
• pp.23-37
• /
• 2000

Usability is one of the most important factors that affect customers' decision to purchase a product. Several studies have been conducted to model the relationship between the product design variables and the product usability. Since there could be hundreds of design variables to be considered in the model, a variable screening method is required. Traditional variable screening methods are based on expert opinions (Expert screening) in most Kansei engineering studies. Suggested in this study are statistical methods for screening important design variables by using the principal component regression(PCR), cluster analysis, and partial least squares(PLS) method. Product variables with high effect (PCR screening and PLS screening) or representative variables (Cluster screening) can be used to model the usability. Proposed variable screening methods are used to model the usability for 36 audio/visual products. The three analysis methods (PCR, Cluster, and PLS) show better model performance than the Expert screening in terms of $R^2$, the number of variables in the model, and PRESS. It is expected that these methods can be used for screening the product design variables efficiently.

• Advanced Industrial SCIence
• /
• v.1 no.1
• /
• pp.28-34
• /
• 2022

Many studies have been conducted on software quality evaluation. Recently, as artificial intelligence-related software has been developed a lot, research on methods for evaluating artificial intelligence functions in existing software is being conducted. Software evaluation has been based on eight quality characteristics: functional suitability, reliability, usability, maintainability, performance efficiency, portability, compatibility, and security. Research on the part that needs to be confirmed through evaluation of the function of the intelligence part is in progress. This study intends to introduce the contents of the evaluation method in this part. We are going to propose a quality evaluation method for artificial intelligence software by presenting the existing software quality evaluation method and the part to be considered in the AI part.

• The Journal of the Korea Contents Association
• /
• v.16 no.10
• /
• pp.719-729
• /
• 2016

This study is analyzed by comparing the evaluation of usability and study achievement for simulation learning based on Web 3D and VR and it is aimed to verify the characteristics of the virtual reality through a difference in studying effect between each learning method. Therefore, this study is analyzed by comparing the evaluation of usability and study achievement for the CSI Forensics Lab simulation content that has been developed in two learning methods for scientific experiments of DNA analysis with the 75 university students of Life Science as a population(Web 3D=37, VR=38). The results of the study, in usability of user task action, exploratory and navigation, Web 3D simulation learning was positive in a significant difference, but in usability of satisfaction, VR simulation learning was positive in a significant difference. In study achievement, Web 3D simulation learning was slightly higher but did not confirm the significant differences between both of learning.

• Journal of the Ergonomics Society of Korea
• /
• v.34 no.5
• /
• pp.401-410
• /
• 2015

Objective: The present study was to improve the graphic user interface (GUI) of a military computer-based training (CBT) system in terms of usability. Background: Existing studies have focused on usability evaluation of a particular GUI type such as sequence, hierarchy, or context type; however, few research has been conducted which identifies preferred GUI features based on a comparative analysis of different GUI types. Method: A comparative evaluation was conducted by 9 CBT design experts using a 7-point scale (1: very low, 4: neutral, and 7: very high) on hierarchy and context GUI types of a military CBT system in terms of 10 usability criteria. Then, preferred features of the hierarchy and context types being accommodated, a new GUI was developed and validated by 22 CBT users. Results: While the hierarchy type was found preferred by 1.6 times in terms of controllability to the context type, the opposite was found in terms of attractiveness, simplicity, and responsiveness by 0.6, 0.8, and 0.8 times, respectively. The proposed GUI was found superior to the hierarchy and context types in terms of accessibility and informativeness by more than 1.5 times, but inferior to the hierarchy and context type in terms of simplicity by 0.6 and 0.9 times, respectively. Conclusion: The new GUI developed by accommodating the preferred features of the hierarchy and context types improves usability in terms of accessibility and informativeness except simplicity. Application: The comparative analysis of various GUIs can be applied to develop an improved GUI in a systematic manner based on preferred features of the existing GUIs.