• Proceedings of the Korea Society of Design Studies Conference
• /
• 2005.05a
• /
• pp.54-55
• /
• 2005

• Journal of the HCI Society of Korea
• /
• v.14 no.2
• /
• pp.31-39
• /
• 2019

This research examined the changes that fast-growing voice-based devices would bring in the media multitasking environment. Based on the theoretical background that information processing efficiency improves when performing multiple tasks requiring different resource structures at the same time, we conducted an experiment where participants searched for information with voice-based or screen-based devices while performing an additional visual task. Results showed that both task performance environment and interface modality had significant main effects on cognitive load. The overall cognitive load level was higher in the voice interface group, but the difference in cognitive load between the two groups decreased in a multitasking environment where the additional visual resources was required. The visual task performance was significantly higher when using the voice interface than the screen interface. Our findings suggest that voice interfaces offered advantages in the cognitive load and task performance by distributing two tasks to the auditory and visual channels. The results of this study imply that voice-based devices have the potential to facilitate efficient information processing in the screen-centric environment where visual resources collide. We provided theoretical evidence of resource distribution using multiple resource theory and tried to identify the advantages of the voice interface more specifically based on the threaded cognition model.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.13 no.11
• /
• pp.4968-4974
• /
• 2012

A haptic device is regarded as the human machine interface technology for easier, more accurate, and intuitive operation. The purpose of this paper is to study how to improve the cognitive ability of the existing vehicle haptic device used only tactile feedback. In this study, usability evaluation used the multi-sensory feedback which is adding auditory feedback to the existing tactile feedback. The emotional factor that drivers have on the haptic device is extracted by the sensibility analysis. The result of study provides some consideration and direction to need in implementation of a haptic device and it also confirms their possibility meaningfully. And it is possible to suggest the design direction that satisfies the driver.

• Archives of design research
• /
• v.19 no.2 s.64
• /
• pp.91-98
• /
• 2006

The product convergence and complex application environment raise the need of multi-modal interface which enables us to interact products through various human senses. The sense of vision has been used predominantly more than any other senses for the traditional and general information gathering situation, but in the future which will be developed based on the digital network technology, the practical use of the various senses will be desired for more convenient and rational usage of the information appliances. The sense of auditory which possibility of practical use is becoming higher than ever with the sense of vision, the possible usage will be developed broader and in the various ways in the future. Based on this situation, the characteristics of the written language and the colloquial language and the comparative analysis of the difference between male and female's reaction for each language were examined through this study. To achieve this purpose, the literature research about the diverse components of the language system was peformed. Then, some peculiar characters of the sense of vision and auditory were reviewed and the appropriate experimentation was planned and carried out. The result of the accomplished experimentation was examined by the objective analysis method. The main results of this study are as follows: first, the reaction time for written language is shorter than colloquial language, second, there is a partial difference between the male's and female's reaction for those two stimuli, third, there is no selection bias between the sense of sight and the sense of hearing. I think the continuous development of the broad and diverse ways of study for various senses is needed based on this study.

• The Journal of the Korea Contents Association
• /
• v.16 no.8
• /
• pp.427-434
• /
• 2016

This paper focuses on a real-time hardware processing by implementing the ARM Cortex-M4 based embedded system, using a conversion algorithm from a muscular sense to both visual and auditory elements, which recognizes rotations of a human body, directional changes and motion amounts out of human senses. As an input method of muscular sense, AHRS(Attitude Heading Reference System) was used to acquire roll, pitch and yaw values in real time. These three input values were converted into three elements of HSI color model such as intensity, hue and saturation, respectively. Final color signals were acquired by converting HSI into RGB color model. In addition, Three input values of muscular sense were converted into three elements of sound such as octave, scale and velocity, which were synthesized to give an output sound using MIDI(Musical Instrument Digital Interface). The analysis results of both output color and sound signals revealed that input signals of muscular sense were correctly converted into both color and sound in real time by the proposed conversion method.

• Archives of design research
• /
• v.18 no.2 s.60
• /
• pp.211-218
• /
• 2005

As digital Information equipment is new arrival, new paradigm such as 'function exist but form don't' is needed in the field of design. Therefore, the activity of design is focused on the relationship of human and machine against visual form. For that reason, it is involved emotional factor in the relationship and studied on new field, the emotional interlace. The goal of this paper is to suggest the way of emotional interface on searching multimedia data. The main target of paper is effect sound and human's step and the main way of research is visualization after measuring and analyzing numerically similarity level among emotion-words. This paper suggests the theoretical bad(ground such as personal opinion, the character of auditory information and human's step and case studies on the emotion research. The experimental content about sound is fueled from my previous research and the main experimental content about human's step is made with regression-expression to substitute Quantification method 1 for value about stimulation. The realistic prototype to apply the research result will is suggested on the next research after studying the search environment.

• Journal of Biomedical Engineering Research
• /
• v.36 no.6
• /
• pp.283-290
• /
• 2015

We proposed blink based online speller for the locked-in syndrome (LIS) patients, paralyzed in nearly all voluntary muscles expect for the eyes, with a simple and easy-to-use eye blink detection glasses. Electrooculogram (EOG) is the golden standard method of eye movement or blink measurement with Ag/AgCl electrodes. However, this method has several drawbacks such as skin irritation and dehydration of conductive gel. To resolve the shortcomings, we used a blink detection system based on a transparent capacitively coupled electrode, which is conductive indium tin oxide (ITO) films. The films make it possible to measure eye blink without direct skin contact and obstruction of field of view. We finally developed user-friendly blink based online speller with the blink detection system. To classify voluntary and non-voluntary blink, we used the double blink for command of the speller. The online speller experiment result with six healthy subjects shows that mean accuracy is 98.96% and letter per minute (LPM) is 4.73, which are better result by comparison with conventional P300 or auditory brain-computer interface (BCI) paradigm. The result of the experiment demonstrates the possibility of applying the proposed system as a communication method for the LIS patients.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2003.05a
• /
• pp.84-89
• /
• 2003

The virtual reality(VR) technology can provide various stimuli, including, visual and auditory stimuli, simultaneously in the virtual environment and encourage the user to interact. Virtual reality is a set of computer technologies, which when combined, provide an interactive interface to a computer generated world. In this world the subject can see, hear and navigate in a dynamically changing environment in which he participates as an active player, by modifying the environment according to his will. Moreover, the subject can get a feeling for the virtual environment in much the same way as one feels real life situations. In the real world, a plethora of information from various modalities may be in conflict, and modulate each other to form an illusion. In this study we investigated whether a tactile illusion on a real hand could be evoked by a virtual stimulus, the time required to generate this illusion and its duration. This study shows that the illusion occurred, and that was correlated with presence score in the virtual environment.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.23 no.2
• /
• pp.178-183
• /
• 2013

In this study, we proposed a method for electroencephalogram (EEG) classification using invariant CSP at special channels for improving the accuracy of classification. Based on the naive EEG signals from left and right hand movement experiment, the noises of contaminated data set should be eliminate and the proposed method can deal with the de-noising of data set. The considering data set are collected from the special channels for right and left hand movements around the motor cortex area. The proposed method is based on the fit of the adjusted parameter to decline the affect of invariant parts in raw signals and can increase the classification accuracy. We have run the simulation for hundreds time for each parameter and get averaged value to get the last result for comparison. The experimental results show the accuracy is improved more than the original method, the highest result reach to 89.74%.

• Journal of Digital Convergence
• /
• v.10 no.9
• /
• pp.151-158
• /
• 2012

This study aims to suggest ways of experiential marketing management plan that the virtual tour service in the internet shopping mall is as a agents and the role of the physical interface of the internet virtual experience. It is a empirical analysis to analyze the relationship among Schmitt's five experiential Marketing elements. By the result, the rankings for high impact experiential marketing feedback relationship of cognitive creativity, composition, relationship between social intimacy, behavioral lifestyle, providing a sense of the acoustic auditory effect, a sense of dimensional visual effects in order. This result means that the intimacy and creativity, giving feedback that the opinion of consumers actively prefer internet shopping mall. In addition, it means more visual rather than auditory experience to provide marketing services and provide the lifestyle behaviors that the customer want in the Internet shopping mall. It is needs to make virtual experiential marketing relationships, strengthen the recognition specificity of these results because of experiential marketing relationship's ultimate purpose is to make the relationship between brand and customer service satisfaction of the Internet shopping mall through strengthening the relationship.