• Title/Summary/Keyword: usability evaluation tools

Search Result 37, Processing Time 0.024 seconds

Usability Evaluation Procedure for the Agricultural Equipments in Local Agricultural Task Environment

  • Cha, Woo-Chang
    • Journal of the Ergonomics Society of Korea
    • /
    • v.30 no.4
    • /
    • pp.491-494
    • /
    • 2011
  • Objective: to improve agricultural working environment using tools and equipments. Background: most existing tools currently used, in fact, are discrepant from human factor guidelines so that they are still exposed to the musculoskeletal disease. Method: the provided tools and equipments are mostly designed considering human factor engineering or usability engineering in a way to avoid musculoskeletal disease. Results: propose the top-down procedure and usability engineering steps to evaluate them for the system design suitability. Conclusion: apply them conveniently into rural environment to help farmers working environment.

A Study on the Video Analysis Tool to Support Collaboration for Effective Usability Evaluation (효율적인 사용성 평가를 위해 협력작업을 지원하는 비디오 분석 도구에 관한 연구)

  • 박정순;신수길
    • Archives of design research
    • /
    • v.17 no.3
    • /
    • pp.373-382
    • /
    • 2004
  • Video protocol analysis is a popular and effective technique in many research disciplines including industrial design and HCI for understanding the interactions between people, and between people and machines. Analysing and transcribing video recordings is, however, notoriously time consuming, and a variety of single-user computer based tools have been developed to ease the task. This paper examines collaborative video analysis. The motivation for groupware tools for video analysis is described, and the desirable features of such tools are identified. The following section reviews related work on video analysis and on single-user video analysis tools. The review is used to derive a set of design goals for collaborative video analysis tools. We then detail prototype's user interface, its collaborative facilities, and its implementation. The preliminary evaluation is described prior the conclusions which identify directions for further work.

  • PDF

Deriving Usability Evaluation Criteria for Threat Modeling Tools (위협 모델링 도구의 사용성 평가기준 도출)

  • In-no Hwang;Young-seop Shin;Hyun-suk Cho;Seung-joo Kim
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.34 no.4
    • /
    • pp.763-780
    • /
    • 2024
  • As the domestic and international landscape undergoes rapid changes, the importance of implementing security measures in response to the growing threats that businesses face is increasing. In this context, the need for Security by Design (SbD), integrating security from the early design stages, is becoming more pronounced, with threat modeling recognized as a fundamental tool of SbD. Particularly, to save costs and time by detecting and resolving security issues early, the application of the Shift Left strategy requires the involvement of personnel with limited security expertise, such as software developers, in threat modeling. Although various automated threat modeling tools have been released, their lack of user-friendliness for personnel lacking security expertise poses challenges in conducting threat modeling effectively. To address this, we conducted an analysis of research related to threat modeling tools and derived usability evaluation criteria based on the GQM(Goal-Question-Metric) approach. An expert survey was conducted to validate both the validity and objectivity of the derived criteria. We performed usability evaluations of three threat modeling tools (MS TMT, SPARTA, PyTM), and the evaluation results led to the conclusion that MS TMT exhibited superior usability compared to other tools. This study aims to contribute to the creation of an environment where personnel with limited security expertise can effectively conduct threat modeling by proposing usability evaluation criteria.

The Design and Implementation of a Performance Evaluation Tool for the Face Recognition System (얼굴인식시스템 성능평가 도구의 설계 및 구현)

  • Shin, Woo-Chang
    • Journal of Information Technology Services
    • /
    • v.6 no.2
    • /
    • pp.161-175
    • /
    • 2007
  • Face recognition technology has lately attracted considerable attention because of its non-intrusiveness, usability and applicability. Related companies insist that their commercial products show the recognition rates more than 95% according to their self-testing. But, the rates cannot be admitted as official recognition rates. So, performance evaluation methods and tools are necessary to objectively measure the accuracy and performance of face recognition systems. In this paper, I propose a reference model for biometrics recognition evaluation tools, and implement an evaluation tool for the face recognition system based on the proposed reference model.

A Study on Usability Evaluation of Reference Resources Management Tools (참고정보원 관리도구의 사용성 평가에 관한 연구)

  • Kweon, Beom-Joong;Kwak, Seung-Jin
    • Journal of the Korean Society for information Management
    • /
    • v.24 no.3
    • /
    • pp.219-244
    • /
    • 2007
  • Reference resources management tools can be divided into three types: Desktop-based, Web-based, and Web 2.0-based. This study is intended to compare and analyze the functions provided by the three types of tools and also to compare and evaluate their usability. Each Tools were chosen to represent each type. For comparison and analysis of the functions provided by the three types of tools, we divided the process of using reference resources management tools into four steps and then compared and analyzed sub items in each step. Satisfaction, understandability, conformance and efficiency that items for comparison and evaluation of the usability were compared using both quantitative and qualitative approaches. We surveyed the participants to collect data for quantitative research; and interviewed them and analyzed the results for qualitative research. Here are the results from evaluating the usability of Tool A(Desktop-based), B(Web-based), C(Web 2.0 based). First, Tool B had the highest mean user satisfaction, followed by Tool A and Tool C. Secondly, Tool B had the lead in understandability, followed by Tool A and Tool C. Thirdly, Tool A had the highest mean conformance, followed by Tool B and Tool C. Fourth, Tool B had the highest mean efficiency, followed by Tool A and Tool C.

Development Software to Select Boundary Manikins for Product Evaluation: Applied to an Automobile Case (사용성 평가 전용 인체모델 선정 소프트웨어 개발 및 자동차 적용사례)

  • Lim, Young-Jae;Park, Sung-Joon;Park, Woo-Jin;Park, Jun-Soo;Jung, Eui-S.;Lim, Ik-Sung
    • Journal of the Ergonomics Society of Korea
    • /
    • v.29 no.6
    • /
    • pp.831-841
    • /
    • 2010
  • Usability evaluation of physical products involves characterizing complex physical interactions between humans and products. Human models known as manikins have been widely utilized as usability evaluation tools for automobile interior package design. When combined with computer-aided design software programs, such manikins can be used to simulate driving postures and evaluate driver-interior fits early in the design process, and therefore, may greatly facilitate achieving high-quality design in a cost-efficient manner. The purpose of this study was to define a set of manikins for designing automobile interior packages for the South Korean male population. These manikins were conceptualized as "boundary" manikins, which represent individuals lacking in certain physical capacities or having usability-related issues (e.g., an individual with the 5th percentile forward reach capability, an individual with the 95th percentile shoulder width). Such boundary manikins can serve as an efficient tool for determining if an automobile interior design accommodates the majority of the population. The boundary manikins were selected from the large sample of Korean males whose anthropometric dimensions were described in the recent Size Korea anthropometric database. For each male in the database, his comfortable driving posture was represented using a kinematic body linkage model and various physical capacity measured and usability-related characteristics relevant to driver accommodation were evaluated. For each such measure, a boundary manikin was selected among the Korean males. The manikins defined in this study are expected to serve as tools for ergonomic design of automobile interior packages. The manikin selection method developed in this study was implemented as a generic software program useful for various product design applications.

A Study on Design Guideline of Cyber Chatting System based on Usability Evaluation (사이버 채팅 시스템의 사용성 평가를 통한 사용자 인터페이스 설계 지침에 관한 연구)

  • 전대인;박정순
    • Archives of design research
    • /
    • v.14 no.1
    • /
    • pp.35-46
    • /
    • 2001
  • Recently varieties of user groups are formed as the number of people using cyber chatting gets increased and there are many changes in the range and field of its use. But because most of the cyber chatting systems are being operated to enlarge the additional sonics use, the using environments are stereotyped. And as its function is being various as well, it can not provide with a user-centered environment. So this thesis compares and analyzes the problems derived from the usability evaluation for solving the problems in using cyber chatting systems, and presents the guidelines of emotion-intended user interface design for improving the usability as the result of the analysis. First, this study investigates cyber chatting systems as a means of web communication tools through the existing literatures. Secondly, this study finds out the problems in using them through satisfaction evaluation, heuristic evaluation, performance evaluation, and observation evaluation and presents a way of solving the provisional problems in using them as the analysis of the result of usability evaluation. And this was proceeded for the purpose of applying and activating the better usability evaluation of cyber chatting systems later. Through the usability evaluation, it is found out that the structuralization of chatting function, the screen visibility by the size and arrangement of the compositional elements of a screen, and the improvement and development of the proper metaphor use of images and functions by the communication environment are necessary.

  • PDF

A Study on the Development of Mobile APP Usability Evaluation Tool for Time Management (시간관리 모바일 앱 사용성 평가도구 개발에 관한 연구)

  • Lee, Saem;Nam, Won-Suk
    • Journal of the Korea Convergence Society
    • /
    • v.12 no.12
    • /
    • pp.19-29
    • /
    • 2021
  • Although several industrial revolutions and technological developments have provided time for modern people, more than 75% of modern people are currently suffering from the problem of "lack of time". Therefore, in this paper, it was judged that it was necessary to improve the mobile APP service for efficient time management of modern people, and a study was conducted on the development of usability evaluation tools. First, the current status was analyzed through case studies of six time management apps with different purposes, and then usability studies were conducted to establish a total of five evaluation principles with operability, cognition, user suitability, minimization of work errors, and sharing. Based on this, a draft of the time management mobile app usability evaluation item was prepared, and a total of 44 usability evaluation tool items were derived through three Delphi surveys of design experts over 5 years and less than 10 years. As a result, intuitive screen and menu composition and user's perception of content were evaluated as the most important factors, and conclusions such as the need to improve the structure and function of the main content screen for user error prevention and usability were drawn. This study will not only contribute to improving the usability of existing time management mobile apps, but will also be used as a material for designing an integrated time management platform for efficient time management and purpose promotion in the future, and is expected to be used as an academic reference.

A Content Analysis for Website Usefulness Evaluation: Utilizing Text Mining Technique

  • Kwon, Do Young;Jeong, Seung Ryul
    • Journal of Internet Computing and Services
    • /
    • v.16 no.4
    • /
    • pp.71-81
    • /
    • 2015
  • With the increasing influence of online media, company websites have become important communication channels between companies and customers. Companies use their websites as a marketing tool for a variety of purposes, including enhancing their image and selling products or services. Many researchers have examined the criteria, methods, and tools for website evaluation, but most have focused on usability. Prior content analyses have focused not on text content but on website components, an approach likely to produce subjective evaluations. This study attempts to objectively evaluate company websites by utilizing text mining. We analyze the usefulness of company websites by presenting visualized outputs from a business perspective, allowing practitioners to easily understand the results of the website evaluation and use them in decision making. To demonstrate our method empirically, we selected a company with a number of affiliates in Korea and analyzed the text content of their websites to assess their usefulness using natural language processing and graphics packages in R. Practitioners can easily employ our objective evaluation method, and researchers can use it to gain a new perspective on website evaluation.

A Study on the Effects of Visual Aesthetics and Usability of Web Site Design on their Performance (웹사이트 디자인의 시각적 요소와 유용성이 성과에 미치는 영향에 관한 연구)

  • Kim, Seung-Kyung;Lee, Jae-Kwan
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.32 no.2
    • /
    • pp.17-40
    • /
    • 2007
  • Most research on web site design has focused on technological factors, while visual aesthetic factors have been considered less important. In contrast, this study focuses on visual aesthetic factors in web site design. Findings of this study can be summarized as follows : (1) The result of SPSS-factor analysis shows that there are 3 distinct factors, 'classical aesthetics', 'expressive aesthetics', and 'usability' 'Classical aesthetics' and 'expressive aesthetics' can be described by visual aesthetic design, 'Visual aesthetic design' can be distinguished from 'usability'. This conceptual confusion relating to 'usability' and 'visual aesthetic design' can be clarified by these findings. (2) As a result of multiple regression analyses, 'classical aesthetics', 'expressive aesthetics', and 'usability' have a positive influence on 'interactivity' and 'web site evaluation'. This research clarifies the concepts of 'expectations' of Grier [18] and 'engagement' of Rosen and Purinton [33] as the 'interactivity' between users and web sites. Furthermore, this research suggests a valid model with high $R^2$(interactivity, 48% : web site evaluation, 68%). (3) Empirical tests show that the differences among users in 'entry point' are related to the characteristics of web sites and the personal characteristics of users. The differences among users in terms of 'scanning time' are closely related to the attitudes and evaluation tendencies of users with respect to web sites. These findings could contribute to the 'search phase' of the Faraday model [16], enabling it to be more precise and extensible. The managerial implication of this study is that customers' preferences regarding web site designs are differences, as their preferences are based on their individual characteristics. Therefore, marketing managers should consider promotional tools on web sites that are relevant to the target market. An optimal strategy for web design could be a carefully-selected combination of factors that are relevant to the 'interactivity' and 'evaluation' of web sites. Additionally, if marketing managers want to attract more favorable attitudes and more affirmative evaluations from users, web sites should be designed so that they are understood more quickly by users. finally, this study suggests that 'good design' for web sites depends on understanding how to attain the appropriate balance between 'classical aesthetics' and 'expressive aesthetics', based on the target customer.