• Educational Technology International
• /
• v.25 no.1
• /
• pp.1-25
• /
• 2024

This study aims to analyze the impact of learners' usability perceptions of topic modeling-based visual feedback and generative AI interpretation on reflection levels in online discussions. To achieve this, we asked 17 students in the Department of Korean language education to conduct an online discussion. Text data generated from online discussions were analyzed using LDA topic modeling to extract five clusters of related words, or topics. These topics were then visualized in a network format, and interpretive feedback was constructed through generative AI. The feedback was presented on a website and rated highly for usability, with learners valuing its information usefulness. Furthermore, an analysis using the non-parametric Mann-Whitney U test based on levels of usability perception revealed that the group with higher perceived usability demonstrated higher levels of reflection. This suggests that well-designed and user-friendly visual feedback can significantly promote deeper reflection and engagement in online discussions. The integration of topic modeling and generative AI can enhance visual feedback in online discussions, reinforcing the efficacy of such feedback in learning. The research highlights the educational significance of these design strategies and clears a path for innovation.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.30 no.4
• /
• pp.545-558
• /
• 2020

The gaze-based input provides feedback to confirm that the typing is correct when the user types the text. Many studies have already demonstrated that feedback can increase the usability of gaze-based inputs. However, because the information of the typed text is revealed through feedback, it can be a target for shoulder-surfing attacks. Appropriate feedback needs to be used to improve security without compromising the usability of the gaze-based input using the original feedback. In this paper, we propose a new gaze-based input method, FFI(Fake Flickering Interface), to resist shoulder-surfing attacks. Through experiments and questionnaires, we evaluated the usability and security of the FFI compared to the gaze-based input using the original feedback.

• Journal of the Ergonomics Society of Korea
• /
• v.19 no.3
• /
• pp.51-60
• /
• 2000

Non-verbal sound feedback, called earcon, has been used for portable digital electronic products to give appropriate information for the selected function. This study evaluated usability based on user cognition time, error rate, and subjective satisfaction using 20 male and female subjects. The study compared five major user functions from a portable digital electronic product with currently available earcons and the same functions from the product with the new earcons (suggested by this study) which considered user cognitive characteristics, such as loudness, pitch, melody, and length. For subjective evaluation, the study assessed various earcons by subjective impression of sounds using the seven-point rating scales. Major statistical results indicated that the new earcons significantly reduced user error rates and generally improved user performance functions, such as 'play, off, stop, fast forward, and rewind.'

• Phonetics and Speech Sciences
• /
• v.3 no.2
• /
• pp.79-87
• /
• 2011

Recently, usability has become very important in voice user interface systems. In this paper, we have designed and implemented a wizard-of-oz (WOZ) usability testing tool for command-and-control voice user interfaces. We have proposed the VUIDML (Voice User Interface Design Markup Language) to design the usability test scenario of command-and-control voice interfaces in the early design stages. For highly satisfactory voice user interfaces, we have to select highly preferred voice commands and prompts. In VUIDML, we can specify possible prompt candidates. The WOZ usability testing tool can also be used to collect user-preferred voice commands and feedback from real users.

• Science of Emotion and Sensibility
• /
• v.12 no.4
• /
• pp.531-544
• /
• 2009

In the past, objective usability was one of the most important aspects when user used system. But nowadays user's subjective experiences are getting more critical element than objective usability in HCI(human-computer interaction). Most people own their mobile phone and use it frequently these days. It is especially important to make user's subjective experiences more positive when using devices like mobile phones people frequently carry and interact with. This study investigates whether the interfaces which express the emotion give more positive experiences to users. Researchers created mobile phone prototypes to compare the effect of mechanical melody feedback(the major auditory feedbacks on mobile phones) and emotional voice feedback(recorded human voice). Participants experienced four kinds of mobile phone prototypes(no feedback, mechanical melody feedback, emotional voice feedback and dual feedback) and evaluated their experienced usability, hedonic quality and preference. The result suggests that person's perceptional fun and hedonic quality were getting increased in the phone which gave the emotional voice feedback than the mechanical melody feedback. Nevertheless, the preference was evaluated lower in the emotional voice feedback condition than the others.

• Perspectives in Nursing Science
• /
• v.5 no.1
• /
• pp.17-31
• /
• 2008

Purpose: The purpose of this study was to evaluate the usability of a prototype personal digital assistant (PDA)-based decision support system for the management of obesity through usability testing with end-users (Advanced Practice Nurses [APNs]) prior to its implementation in clinical settings. Methods: This descriptive study used observational and think aloud techniques to address the research question: what usability problems are perceived by end-users? Five APNs were provided with the scenarios and the list of tasks to evaluate the application. Their verbalizations were recorded through Morae usabil ity software. Data analysis was based on the data captured through Morae, transcriptions, notes, and the end-user survey. Results: End-users completed all the required tasks without encountering a severe usability problem, and agreed that the system was easy to use. clear, concise, and useful. Usability issues that were unrecognized by the developer or usability experts were identified by APNs. The usability problems were categorized according to positive characteristics, negative characteristics, and recommendations. The usability issues were discussed with the project team members, and solutions were suggested to improve the user interface of the PDA-based decision support system before the final implementation. Conclusions: This approach had an important impact on making the system easier to use and more useful from the perspective of design and content. The results of this evaluation provided iterative feedback regarding the design and implementation of the PDA-based decision support system for the management of obesity.

• Industrial Engineering and Management Systems
• /
• v.8 no.1
• /
• pp.54-65
• /
• 2009

The existence of Internet revolutionized the computer and communications world. With the rising demand for accessing the Internet, the mobile technology has incorporated the use of Internet in mobile phones. Wireless Application Protocol (WAP) has combined two of the widest utilized technology today: mobile phones and Internet. This study aims to assess the existing WAP pages offered by the top service providers in the Philippines through usability testing experiments. The paper also aims to identify existing problems in WAP interface by focusing on the errors committed by the users. From the usability study, it was found out that common usability problems are wrong selection of links, unclear grouping of categories, wrong feedback, and redundant links. The type of service provider used is significant in determining the performance of users while experience in accessing WAP is insignificant.

• Industrial Engineering and Management Systems
• /
• v.7 no.1
• /
• pp.66-77
• /
• 2008

The existence of Internet revolutionized the computer and communications world. With the rising demand for accessing the Internet, the mobile technology has incorporated the use of Internet in mobile phones. Wireless Application Protocol (WAP) has combined two of the widest utilized technology today: mobile phones and Internet. This study aims to assess the existing WAP pages offered by the top service providers in the Philippines through usability testing experiments. The paper also aims to identify existing problems in WAP interface by focusing on the errors committed by the users. From the usability study, it was found out that common usability problems are wrong selection of links, unclear grouping of categories, wrong feedback, and redundant links. The type of service provider used is significant in determining the performance of users while experience in accessing WAP is insignificant.

• The Journal of the Korea Contents Association
• /
• v.1 no.1
• /
• pp.100-108
• /
• 2001

To develope more competitive products, lots of attentions are paid to the study of user participation in the process of product design. In this circumstance, the user participation at a usability testing phase is relatively active. However, the usability testing in the controlled laboratory has some drawbacks. for stance, It needs a lot of money, efforts, and time. Most of all, it is difficult to collect a vast range of data and gain a fast feedback Recently, to overcome these difficulties mentioned above, international usability testing has been applied. Especially, usability testing Contents through Internet is considered most effective one. Because it has a lot of merits such as easiness of collecting remote user, simplicity of collecting data, cost effectiveness and so on. With these merits, this study takes advantage of using a WWW to carry out usability test and to collect remote usability data. And a website was development for posting computer simulated product so that the remote users can test its usability through internet.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.1109-1113
• /
• 2009

Exchange of data between users and system is made by users' inputting their information into HTML input forms like when signing up in websites or buying in online shopping malls. If users make a mistake of inputting their information, the system gives an error message in order for users to correct their mistakes. Although ISO recommends immediate feedback, Bargas et al. gave a report that feedback in all after filling forms out is more usable than feedback one by one when inputting data online. We made a comparative experiment on usability under each case of feedback one by one and feedback in all. The result is immediate feedback is more usable and satisfactory. The analysis of data resulted that immediate feedback produced fewer error and gets higher subjective ratings.