• Title/Summary/Keyword: Computer System Usability Questionnaire

Search Result 10, Processing Time 0.021 seconds

UML-ITS Usability Evaluation of Intelligent Tutoring System

  • Sehrish Abrejo;Amber Baig;Mutee U Rahman;Adnan Asghar Ali
    • International Journal of Computer Science & Network Security
    • /
    • v.23 no.3
    • /
    • pp.123-129
    • /
    • 2023
  • The most effective tutoring method is one-on-one, face-to-face in-person human tutoring. However, due to the limited availability of human tutors, computer-based alternatives have been developed. These software based alternatives are called Intelligent Tutoring Systems (ITS) which are used to tutor students in different domains. Although ITS performance is inferior to that of human teachers, the field is growing and has recently become very popular. User interfaces play key role in usability perspective of ITS. Even though ITS research has advanced, the majority of the work has concentrated on learning sciences while mostly disregarding user interfaces. Because of this, the present ITS includes effective learning modules but a less effective interface design. Usability is one approach to gauge a software's performance, while "ease of use" is one way to assess a software's quality. This paper measures the usability effectiveness of an ITS which is designed to teach Object-Oriented (OO) analysis and design concepts using Unified Modeling Language (UML). Computer Supported Usability Questionnaire (CSUQ) survey was conducted for usability evaluation of UML-ITS. According to participants' responses to the system's usability survey, all responses lie between 1 to 3 scale points which indicate that the participants were satisfied and comfortable with most of the system's interface features.

The Social Media Factor: How Platforms Impact Usability of Blackboard at Umm Al Qura University

  • Ahmed R Albashiri
    • International Journal of Computer Science & Network Security
    • /
    • v.24 no.7
    • /
    • pp.207-213
    • /
    • 2024
  • This study investigated the perceived usability of the Blackboard learning management system (LMS) amongst students at Umm Al-Qura University. A quantitative approach was employed to explore the potential relationship between Blackboard usability and social media platform usage. Additionally, the study aimed to identify other factors influencing perceived usability. Data were collected through a three-section questionnaire distributed electronically to a sample of students (n=544). The findings, based on System Usability Scale (SUS) scores, revealed that the overall perceived usability of Blackboard resided near the midpoint of the scale, indicating an "acceptable" level. A potential negative correlation emerged between social media usage time and perceived Blackboard usability. Students who reported lower social media usage exhibited higher SUS scores. Training on Blackboard usage demonstrably exerted a positive influence on perceived usability. Gender was not identified as a statistically significant factor. An analysis of student support methods revealed that seeking help from a friend was the most prevalent approach, followed by search engines, university technical support, and social media platforms. The findings suggest that implementing strategies to improve Blackboard usability at Umm Al-Qura University could be achieved through readily accessible training materials and the exploration of alternative support channels.

Evaluating the Usability and Effectiveness of Madrasati Platforms as a Learning Management System in Saudi Arabia for Public Education

  • Alkinani, Edrees A.;Alzahrani, Abdullah I.A.
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.6
    • /
    • pp.275-285
    • /
    • 2021
  • Ministries of Education are integrating different Learning Management Systems (LMS) to enhance teaching and learning during the lockdown to avoid academic loss. The key factor for delivering a high-quality education through LMS platforms is teachers' acceptance and adoption of the platform. Madrasati platform (which means My school) was introduced by Saudi Arabian Ministry of education as the formal teaching and learning for distance education for public education levels. This study aims to examine the effectiveness, usability and adoption of "Madrasati" platform from teachers' perspectives in Saudi Arabia. "SUS, CSUQ" tests were used to test the usability of the new platform. Using quantitative research design, data were collected using questionnaire. 200 teachers were selected randomly answered the survey. Data was analysed descriptively and inferentially using SPSS (25). The results obtained indicate that the teachers are highly satisfied using Madrasati platform and technically it is well designed. Also, Madrasati has positive effect on teaching quality. Moreover, Madrasati has high usability in teaching. One of the key findings were that the quality of the information content in Madrasati has a strong effect on teachers' perception of the Madrasati usefulness that led to a positive attitude towards Madrasati. These findings would be useful to the ministry of education and institutions trying to integrate technology in their teaching and learning processes. Thus, this paper contributes towards more effective utilisation of the extensive functionalities that Madrasati have to offer, which will contribute toward the development of pedagogy in Saudi Arabia.

User-friendly Improved Prototype Development on Web-based Diagnostic-supplement Learning System for Basic Academic Skills (웹기반 기초학력 진단-보정학습 시스템의 사용자 친화적인 개선 프로토타입 개발)

  • Hwang, Yunja;Cha, Hyun-jin
    • The Journal of Korean Association of Computer Education
    • /
    • v.22 no.1
    • /
    • pp.63-78
    • /
    • 2019
  • This study aims to improve User eXperience (UX) of the diagnostic-supplement learning system for Basic academic skills which has been utilized by teachers nationwide since 2015 in order to provide a consistent and systematic support on students' basic academic skills in K-12 school contexts. To achieve the research objective, usability evaluations such as basic questionnaire about UX/UI of the system according to user types, user testing, in-depth interview, expert heuristics were conducted. In addition, user-centered system was suggested through developing and iteratively evaluating the prototypes based on the user requirements drawn from the findings of such quantitative and qualitative usability evaluations. This study has an implication in suggesting the user-friendly design through the UX/UI improvements of the diagnostic-supplement learning system for Basic academic skills.

User Interface Satisfaction of the Air Traffic Control System (항공교통관제시스템에 대한 사용자 인터페이스 만족도 조사)

  • Song, Chang-Sun;Sohn, Young-Woo;Kwon, Hyuk-Jin
    • Journal of the Korean Society for Aviation and Aeronautics
    • /
    • v.22 no.4
    • /
    • pp.1-7
    • /
    • 2014
  • The purpose of study is to investigate the current user interface level of air traffic control system with the usability analysis and satisfaction survey questionnaire on user satisfaction. Think aloud protocol is used to identify not only task analysis, but also the level of user-friendliness of the FIMS and ASDE system, and the user interface questionnaires was conducted by QUIS. We collected data from 6 controllers for Think aloud protocol and 15 controllers for QUIS in Incheon airport. The results showed that the system was the valuable tool for ensuring human performance with the support of memory and the facilitation of decision-making tasks. It helps air traffic controllers perform better and minimize errors in a congested time. The human-computer interface system design, however, was not applied, which led to the increase of workload. Air traffic controller participation in software development provided excellent examples for applications in terms of software in FIMS. Based on these results, the study provided that the usability of system interface was necessary to take into account human factors. The development and design of system was discussed in User Interface environment.

Development and Evaluation of Repeatability of the Integrated Constitutional Diagnosis System (통합 체질진단 시스템 개발 및 반복성 평가)

  • Jeon, Young-Ju;Kim, Jang-Woong;Kim, Jae-Uk;Bae, Jang-Han;Kim, Jong-Yeol;Kim, Keun-Ho
    • Journal of Sasang Constitutional Medicine
    • /
    • v.24 no.3
    • /
    • pp.34-41
    • /
    • 2012
  • Objectives In this study, we developed a mock-up of the system for Sasang Constitutional (SC) diagnosis. This system consists of 5 devices which are the face analyzer, the voice analyzer, the skin analyzer, the pulse analyzer, and the computer-based questionnaire. Our goal is to evaluate the repeatability of the system. Methods Each device is capable of classifying SC types. The classification probability of the integrated system for the SC types was obtained by summing the probability from each device. For evaluating the repeatability of the system, we collected data for 5 subjects, and repeated the measurement three times for each individual. The average and standard deviation were used for calculating the Coefficient of Variation. Results The results showed that the repeatability of the classification probability of the integrated system is about 8%, which implies the system is repeatable. Conclusions To increase usability of this system, it is desirable for the system to offer information on health condition of the user. The integrated constitutional diagnosis system will be upgraded to complement the convenience and to develop the diagnostic algorithm for the user's health condition.

An Interactive Cooking Video Query Service System with Linked Data (링크드 데이터를 이용한 인터랙티브 요리 비디오 질의 서비스 시스템)

  • Park, Woo-Ri;Oh, Kyeong-Jin;Hong, Myung-Duk;Jo, Geun-Sik
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.3
    • /
    • pp.59-76
    • /
    • 2014
  • The revolution of smart media such as smart phone, smart TV and tablets has brought easiness for people to get contents and related information anywhere and anytime. The characteristics of the smart media have changed user behavior for watching the contents from passive attitude into active one. Video is a kind of multimedia resources and widely used to provide information effectively. People not only watch video contents, but also search for related information to specific objects appeared in the contents. However, people have to use extra views or devices to find the information because the existing video contents provide no information through the contents. Therefore, the interaction between user and media is becoming a major concern. The demand for direct interaction and instant information is much increasing. Digital media environment is no longer expected to serve as a one-way information service, which requires user to search manually on the internet finding information they need. To solve the current inconvenience, an interactive service is needed to provide the information exchange function between people and video contents, or between people themselves. Recently, many researchers have recognized the importance of the requirements for interactive services, but only few services provide interactive video within restricted functionality. Only cooking domain is chosen for an interactive cooking video query service in this research. Cooking is receiving lots of people attention continuously. By using smart media devices, user can easily watch a cooking video. One-way information nature of cooking video does not allow to interactively getting more information about the certain contents, although due to the characteristics of videos, cooking videos provide various information such as cooking scenes and explanation for each recipe step. Cooking video indeed attracts academic researches to study and solve several problems related to cooking. However, just few studies focused on interactive services in cooking video and they still not sufficient to provide the interaction with users. In this paper, an interactive cooking video query service system with linked data to provide the interaction functionalities to users. A linked recipe schema is used to handle the linked data. The linked data approach is applied to construct queries in systematic manner when user interacts with cooking videos. We add some classes, data properties, and relations to the linked recipe schema because the current version of the schema is not enough to serve user interaction. A web crawler extracts recipe information from allrecipes.com. All extracted recipe information is transformed into ontology instances by using developed instance generator. To provide a query function, hundreds of questions in cooking video web sites such as BBC food, Foodista, Fine cooking are investigated and analyzed. After the analysis of the investigated questions, we summary the questions into four categories by question generalization. For the question generalization, the questions are clustered in eleven questions. The proposed system provides an environment associating UI (User Interface) and UX (User Experience) that allow user to watch cooking videos while obtaining the necessary additional information using extra information layer. User can use the proposed interactive cooking video system at both PC and mobile environments because responsive web design is applied for the proposed system. In addition, the proposed system enables the interaction between user and video in various smart media devices by employing linked data to provide information matching with the current context. Two methods are used to evaluate the proposed system. First, through a questionnaire-based method, computer system usability is measured by comparing the proposed system with the existing web site. Second, the answer accuracy for user interaction is measured to inspect to-be-offered information. The experimental results show that the proposed system receives a favorable evaluation and provides accurate answers for user interaction.

A Study on The Evaluation for Quality Factors of SNS and SNS Media by Using AHP (AHP 기법을 적용한 SNS 품질요인 및 SNS 매체 평가에 관한 연구)

  • Li, Nan;Park, Deuk
    • Journal of the Korea Society of Computer and Information
    • /
    • v.19 no.12
    • /
    • pp.299-307
    • /
    • 2014
  • Nowadays, SNS media has become one of the most common and economic communication methods in the modern word. With the rapid development of communication technology, a variety of SNS media makes easier for us to reach other people everywhere and people are getting more and more reliant on them. The surge in SNS media users and SNS media diversity gets more important every day, but academic research on SNS media evaluation program is scanty. In order to present an evaluation program on the SNS media, this study selected some applicable measurement factors based on reference research, and then evaluate major SNS medias by using AHP analysis method. With these purposes, Kakaotalk, Twitter and Facebook, are the three major SNS medias that were chosen for the analysis. Through collections and analysis of usability evaluation factors about SNS quality from related literature, some factors were concluded: system quality, information quality, interface quality and service quality, to build an AHP frame. And to achieve these purposes, this study applied comprehend mutual questionnaire survey for experts and users to gather research date. Empirical studies about the results were performed using AHP method with Microsoft Office Excel 2010. In this study, the final SNS media evaluation result is that Kakaotalk ranks first of the three SNS media, Facebook is in the second place, and Twitter as least. When SNS media are evaluated, system quality, information quality, interface quality and service quality should be considered. Among all factors, service quality is the most important.

Annotation Method based on Face Area for Efficient Interactive Video Authoring (효과적인 인터랙티브 비디오 저작을 위한 얼굴영역 기반의 어노테이션 방법)

  • Yoon, Ui Nyoung;Ga, Myeong Hyeon;Jo, Geun-Sik
    • Journal of Intelligence and Information Systems
    • /
    • v.21 no.1
    • /
    • pp.83-98
    • /
    • 2015
  • Many TV viewers use mainly portal sites in order to retrieve information related to broadcast while watching TV. However retrieving information that people wanted needs a lot of time to retrieve the information because current internet presents too much information which is not required. Consequentially, this process can't satisfy users who want to consume information immediately. Interactive video is being actively investigated to solve this problem. An interactive video provides clickable objects, areas or hotspots to interact with users. When users click object on the interactive video, they can see additional information, related to video, instantly. The following shows the three basic procedures to make an interactive video using interactive video authoring tool: (1) Create an augmented object; (2) Set an object's area and time to be displayed on the video; (3) Set an interactive action which is related to pages or hyperlink; However users who use existing authoring tools such as Popcorn Maker and Zentrick spend a lot of time in step (2). If users use wireWAX then they can save sufficient time to set object's location and time to be displayed because wireWAX uses vision based annotation method. But they need to wait for time to detect and track object. Therefore, it is required to reduce the process time in step (2) using benefits of manual annotation method and vision-based annotation method effectively. This paper proposes a novel annotation method allows annotator to easily annotate based on face area. For proposing new annotation method, this paper presents two steps: pre-processing step and annotation step. The pre-processing is necessary because system detects shots for users who want to find contents of video easily. Pre-processing step is as follow: 1) Extract shots using color histogram based shot boundary detection method from frames of video; 2) Make shot clusters using similarities of shots and aligns as shot sequences; and 3) Detect and track faces from all shots of shot sequence metadata and save into the shot sequence metadata with each shot. After pre-processing, user can annotates object as follow: 1) Annotator selects a shot sequence, and then selects keyframe of shot in the shot sequence; 2) Annotator annotates objects on the relative position of the actor's face on the selected keyframe. Then same objects will be annotated automatically until the end of shot sequence which has detected face area; and 3) User assigns additional information to the annotated object. In addition, this paper designs the feedback model in order to compensate the defects which are wrong aligned shots, wrong detected faces problem and inaccurate location problem might occur after object annotation. Furthermore, users can use interpolation method to interpolate position of objects which is deleted by feedback. After feedback user can save annotated object data to the interactive object metadata. Finally, this paper shows interactive video authoring system implemented for verifying performance of proposed annotation method which uses presented models. In the experiment presents analysis of object annotation time, and user evaluation. First, result of object annotation average time shows our proposed tool is 2 times faster than existing authoring tools for object annotation. Sometimes, annotation time of proposed tool took longer than existing authoring tools, because wrong shots are detected in the pre-processing. The usefulness and convenience of the system were measured through the user evaluation which was aimed at users who have experienced in interactive video authoring system. Recruited 19 experts evaluates of 11 questions which is out of CSUQ(Computer System Usability Questionnaire). CSUQ is designed by IBM for evaluating system. Through the user evaluation, showed that proposed tool is useful for authoring interactive video than about 10% of the other interactive video authoring systems.

User Centered Interface Design of Web-based Attention Testing Tools: Inhibition of Return(IOR) and Graphic UI (웹 기반 주의력 검사의 사용자 인터페이스 설계: 회귀억제 과제와 그래픽 UI를 중심으로)

  • Kwahk, Ji-Eun;Kwak, Ho-Wan
    • Korean Journal of Cognitive Science
    • /
    • v.19 no.4
    • /
    • pp.331-367
    • /
    • 2008
  • This study aims to validate a web-based neuropsychological testing tool developed by Kwak(2007) and to suggest solutions to potential problems that can deteriorate its validity. When it targets a wider range of subjects, a web-based neuropsychological testing tool is challenged by high drop-out rates, lack of motivation, lack of interactivity with the experimenter, fear of computer, etc. As a possible solution to these threats, this study aims to redesign the user interface of a web-based attention testing tool through three phases of study. In Study 1, an extensive analysis of Kwak's(2007) attention testing tool was conducted to identify potential usability problems. The Heuristic Walkthrough(HW) method was used by three usability experts to review various design features. As a result, many problems were found throughout the tool. The findings concluded that the design of instructions, user information survey forms, task screen, results screen, etc. did not conform to the needs of users and their tasks. In Study 2, 11 guidelines for the design of web-based attention testing tools were established based on the findings from Study 1. The guidelines were used to optimize the design and organization of the tool so that it fits to the user and task needs. The resulting new design alternative was then implemented as a working prototype using the JAVA programming language. In Study 3, a comparative study was conducted to demonstrate the excellence of the new design of attention testing tool(named graphic style tool) over the existing design(named text style tool). A total of 60 subjects participated in user testing sessions where their error frequency, error patterns, and subjective satisfaction were measured through performance observation and questionnaires. Through the task performance measurement, a number of user errors in various types were observed in the existing text style tool. The questionnaire results were also in support of the new graphic style tool, users rated the new graphic style tool higher than the existing text style tool in terms of overall satisfaction, screen design, terms and system information, ease of learning, and system performance.

  • PDF