• Title/Summary/Keyword: think-aloud protocols

Search Result 12, Processing Time 0.021 seconds

Analysis of Think Aloud Protocols Generated During the Retrieval Process of an Online Database (학술정보데이터베이스 검색과정의 사고구술 프로토콜분석)

  • Kim, Jong-Ae
    • Journal of the Korean BIBLIA Society for library and Information Science
    • /
    • v.22 no.3
    • /
    • pp.335-351
    • /
    • 2011
  • This study aimed to improve our understanding of users' cognitive processes based on think aloud protocols generated during the retrieval process of an online database. It analyzed think aloud protocols generated by participants while performing pre-defined tasks using an online database. The protocols were encoded using the open coding method. As the results, four broad categories including retrieval, system format, system functionality, and information were drawn, and 21 detailed categories were generated. Based on the results, suggestions for the design of online databases were provided.

Cooking with a smart speaker: User experience of cooking with a voice-only recipe service (스마트 스피커와 요리하기: 음성기반 레시피 제공 서비스의 사용자 경험)

  • Jung, Gumin;Jeong, Heisawn
    • Journal of the Korea Computer Graphics Society
    • /
    • v.27 no.5
    • /
    • pp.13-23
    • /
    • 2021
  • This study examined how users use smart speakers in cooking situations. Skilled and unskilled participants cooked a new recipe while following voice instructions delivered by a smart speaker. The results from video recordings of their cooking, think-aloud protocols, and interviews showed that the smart speakers freed users' hands, allowing them to cook while checking recipes. The lack of visual information did not pose a serious challenge to the cooking task, but impacted cooking quality. The implications for VUI-based recipe service designs are discussed.

A User Study on Information Searching Behaviors for Designing User-centered Query Interface of Content-Based Music Information Retrieval System (내용기반 음악정보 검색시스템을 위한 이용자 중심의 질의 인터페이스 설계에 관한 연구)

  • Lee, Yoon-Joo;Moon, Sung-Been
    • Journal of the Korean Society for information Management
    • /
    • v.23 no.2
    • /
    • pp.5-19
    • /
    • 2006
  • The purpose of this study is to observe and analyze information searching behaviors of various user groups in different access modes for designing user-centered query interface of content-based Music Information Retrieval System(MIRS). Two expert groups and two non-expert groups were recruited for this research. The data gathering techniques employed in this study were in-depth interviewing, participant observation, searching task experiments, think-aloud protocols, and post-search surveys. Expert users, especially majoring in music theory, preferred to input exact notes one by one using the devices such as keyboard and musical score. On the other hand, non-expert users preferred to input melodic contours by humming.

A Comparison of web Searching and Library System Searching: Perceived Difficulty, Self-Efficacy, and Effort (웹과 도서관 시스템에서 이용자 정보탐색 비교연구)

  • Rieh, Soo-Young
    • Journal of the Korean Society for information Management
    • /
    • v.24 no.2
    • /
    • pp.29-44
    • /
    • 2007
  • The purpose of this study was to explore whether the concept of amount of invested mental effort (AIME) developed in the field of educational psychology can help explain why people put so little effort into online searching. In this experimental study, two information retrieval systems - a web search engine and a university library system - were used to make a comparison. The data were collected from 15 undergraduate students through background questionnaires, think-aloud protocols, search logs, post-search questionnaires, and post-task interviews. The findings indicate that perception of the web's "easy-ness" and high levels of self confidence in searching capability led the subjects to put less effort into web searching than they do into library system searching. In addition, the perceived difficulty of search task influenced the extent of mental effort invested. The AIME proved a useful framework for understanding search behavior and user experience for both web search engines and library systems.

A New Approach to the Science Education Assessment Using Partial Credits to Different Science Inquiry Problem Solving Process Types

  • Lee, Hang-Ro;Lim, Cheong-Hwan
    • Journal of the Korean earth science society
    • /
    • v.23 no.2
    • /
    • pp.147-153
    • /
    • 2002
  • Reasonable and reliable assessment method is one of the most important issues in science education, Partial credits method is an effective tool for assessing students' science inquiry problem solving. The purposes of this study were to classify the Problem solving types based on the analysis of the thinking Process, and how much the related science concept and the science process skills were used in solving science inquiry problems, and to describe the possibility and rationality of the assessment method that gives partial credit 128 high school seniors were selected and their answers were analyzed to identify science concepts they used to solve each problem, and the result was used as the criterion in the scientific concept test development. Also, to study the science inquiry problem solving type, 152 high school seniors were selected, and protocols were made from audio-taped data of their problem solving process through a think-aloud method and retrospective interviews. In order to get a raw data needed in statistical comparison of reliability, discrimination and the difficulty of the test and the production of the regression equation that determines the ratio of partial credit, 640 students were selected and they were given a science inquiry problem test, a science process skills test, and a scientific concept test. Research result suggested it is more reasonable and reliable to switch to the assessment method that applies partial credit to different problem solving types based on the analysis of the thinking process in problem solving process, instead of the dichotomous credit method.

The Generating Processes of Scientific Emotion in the Generation of Biological Hypotheses (생물학 가설의 생성에서 나타난 과학적 감성의 생성 과정)

  • Kwon, Yong-Ju;Shin, Dong-Hoon;Park, Ji-Young
    • Journal of The Korean Association For Science Education
    • /
    • v.25 no.4
    • /
    • pp.503-513
    • /
    • 2005
  • The purpose of this study was to analyze the generating processes of scientific emotion, that appears during the generation of biological hypotheses. To perform the study, a tentative model was set up through pilot test, a think-aloud training procedure was planned and a standardized interview instrument was developed before getting protocols. In this study, 8 college students were selected to bring out protocol through the method of think-aloud, retrospective debriefing, focused interview and observing. As the result of analysis of the collected protocol through coding scheme, 4 types of process for scientific emotion-generating were sorted out. First type was a basic process which was a feeling process in prior to recognition. Second type was a retrospective process that explains the process of retrospect for emotional memory based on the past. Third type was a cognitive process and it explains emotion that occurs during thinking process to achieve cognitive goal. Fourth type was an attribution process and it explains that emotion is generated in the process of attribution for cognitive goal's achievement. These types of process of scientific emotion-generating can contribute the basis for developing cognitive model of EBL (Emotional Brain-based Learning) strategy.

Korean EFL Writers' Composing Processes: An Exploratory Study of College Students

  • Lim, Jeong-Wan
    • English Language & Literature Teaching
    • /
    • v.12 no.2
    • /
    • pp.127-152
    • /
    • 2006
  • For the past 20 years the process approach to writing has been popular in second language writing classrooms. However, there have been very few studies conducted in Korea with regard to the composing processes and the effects of proficiency on writers' usage. The present study attempts to begin to fill this gap. Three groups of college students with different writing proficiency participated in the study: the advanced group, the intermediate group, and the beginning group. The verbal protocol of their writing processes revealed that they approached writing tasks differently. While the advanced writers focused on generating texts and ideas and examined their writing at both global and local levels, the other two groups of students tended to focus on evaluating text at the local level and generated fewer ideas and less text. The findings from this study are then compared to those of some major studies of the composing process as conclusions are subsequently drawn about the specific needs of Korean college writers.

  • PDF

Differential Effect of Item Characteristics on Science Achievement Between Genders

  • Shin, Dong-Hee;Moon, Nan-Moo
    • Journal of The Korean Association For Science Education
    • /
    • v.24 no.1
    • /
    • pp.17-28
    • /
    • 2004
  • The purpose of this study is to determine the patterns of differences between genders in science achievement. Eleventh grade, 140 female and male students were sampled from a school in Seoul. According to the analysis results of pilot study, 20 items were finally selected for the main study. To sharpen our interpretations of the factors and provide some confirmation, we supplemented the statistical analysis with a more detailed cognitive study of the items using think-aloud protocols and interviews with student test takers. The analysis of this study took into account the different item formats, contexts, and presentation styles. The findings are as follows: First, there was no significant gender difference between multiple-choice and open-ended items. Second, male students achieved significantly better in the context of everyday life in multiple-choice items. Third, male students favored items presented as written texts. Fourth, in problem-solving process, female students tend to apply their science concepts, whereas male students tend to apply their everyday experiences. The results of this investigation indicate that gender difference in science achievement depends heavily on item characteristics.

Analysis of Characteristics of Problem Solving Process in Gas Phase Problems of College Students (대학생들의 기체의 성질에 대한 문제해결 과정의 분석)

  • Hong, Mi-Young;Park, Yune-Bae
    • Journal of The Korean Association For Science Education
    • /
    • v.14 no.2
    • /
    • pp.143-158
    • /
    • 1994
  • This study aims to identify the characteristics of gas phase problem solving of college freshmen. Four students were participated in this study and solved the problem by using think-aloud method. The thinking processes were recorded and transferred into protocols. Problem solving stage, the ratio spended in each solving stage, solving strategy, misconceptions, and errors were identified and discussed. The relationships between students' belief system about chemistry problem solving and problem solving characteristics were also investigated. The results were as follows: 1. Students felt that chemical equation problem was easier than word problem or pictorial problem. 2. When students had declarative knowledge and procedural knowledge required by given problem, their confidence level and formula selection were not changed by redundunt information in the problem. 3. When the problem seemed to be difficult, students tended to use the Means-End or Random strategy. 4. In complicated problems, students spent longer time for problem apprehension and planning. In familiar problems, students spent rather short time for planning. 5. Students spent more time for overall problem solving process in case of using Means-End or Random strategy than using Knowledge-Development strategy.

  • PDF

Extraction of user's representative emotions expressed while using a product (제품 사용 중 표출되는 사용자의 대표감성 추출에 관한 연구)

  • Jeong, Sang-Hoon;Lee, Kun-Pyo
    • Archives of design research
    • /
    • v.18 no.1 s.59
    • /
    • pp.69-80
    • /
    • 2005
  • So far, there have been mary studies on human emotions and the emotional side of products in the field of emotional engineering. Contemporary emotion-related researches have focused mainly on the relationship between product aesthetics and the emotional responses elicited by the products, but little is known about emotions elicited from using the products. In this study we have extracted some emotional words that can come up during user interaction with a product and reveal emotional changes. Firstly, we assembled a set of emotional words that were sufficient to represent a general overview of Korean emotions, collected from various literature studies in the field of psychology, linguistics, emotional engineering. Secondly, we found emotional words from collecting user opinion on the website. In this study, we used heavy traffic websites such as shopping mall and mania sites. Finally the emotional words were collected from verbal protocols by using Think Aloud technique. The collected words were integrated according to standards and they were applied on evaluation survey twice for evaluating their appropriateness. This survey was conducted for identification of emotional expressions while using a product. Finally, we extracted 88 emotional words for measuring user's emotions expressed while using products. And we categorized the 88 words to form 6 groups by using factor analysis. The 6 categories that were extracted as a result of this study, such as aesthetics, satisfaction in usability, novelty, uncomfortable- ness, pleasure and excellence were found to be user's representative emotions expressed while using products. It is expected that emotional words and user's representative emotions extracted in this study will be used as subjective evaluation data that is required to measure user's emotional changes while using a product.

  • PDF