• The Journal of the Korea Contents Association
• /
• v.10 no.7
• /
• pp.470-480
• /
• 2010

Although e-Learning contents contain audio materials as well as visual materials, research on the design of audio materials has been focused on visual design. If it is considered that non-speech sounds which are a type of audio materials can promptly provide feedbacks of learners' responses and guide learners' learning process, the systemic design of non-speech sounds is needed. Therefore, the purpose of this study is to investigate the learners' perceptions toward non-speech sounds contained the e-Learning contents with multidimensional scaling method. For this purpose, the eleven non-speech sounds were selected among non-speech sounds designed Korea Open Courseware. The 66 juniors in A university responded the degree of similarity among 11 non-speech sounds and the learners' perceptions towards non-speech sounds were represented in the multidimensional space. The result shows that learners perceive separately non-speech sounds by the length of non-speech sounds and the atmosphere which is positive or negative.

• Journal of the HCI Society of Korea
• /
• v.11 no.3
• /
• pp.23-30
• /
• 2016

The landscape of the current fitness trackers is not only limited to the aerobic exercises but also the weight training is comparatively excluded. Recently, a few weight training fitness tracker was released, human-computer interaction was not well designed due to the lack of considering the context. Because body movement would be intense while doing exercises, having exercise performers hold or operate a device makes a negative experience. As the wearable device is always inseparable to body, it could provide effective feedback because holding or operating a device is not necessary. Therefore, this study aims to make the exercise performers feel a natural feedback through the wearable device to do effective exercises. As a result, this study identified three findings. First, the information which exercise performers most needed was 'during exercise.' and the most necessary information for exercise performers through wearable device's sensory feedback was about 'pace control' with counting and motivation. Second, the order of the most preferred presentation type of sensory feedback was auditory feedback, haptic feedback and visual feedback. Third, the satisfaction, utility, usefulness score of sensory feedback as same as the personal trainer's feedback. In conclusion, this study illustrated the feedback design implications using a wearable device while doing weight training and the possibilities that wearable device could be substitute for personal trainer.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.44 no.2 s.314
• /
• pp.37-46
• /
• 2007

In this paper, we propose technologies for enhancing the immersive realization of virtual objects in AR-based product design. Generally, multimodal senses such as visual/auditory/tactile feedback are well known as a method for enhancing the immersion in case of interaction with virtual objects. By adapting tangible objects we can provide touch sensation to users. A 3D model of the same scale overlays the whole area of the tangible object so the marker area is invisible. This contributes to enhancing immersion. Also, the hand occlusion problem when the virtual objects overlay the user's hands is partially solved, providing more immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In our work, both vibrotactile feedback through page motors, pneumatic tactile feedback, and sound feedback are considered. In our scenario, a game-phone model is selected, by way of proposed augmented vibrotactile feedback, hands occlusion-reduced visual effects and sound feedback are provided to users. These proposed methodologies will contribute to a better immersive realization of the conventional AR system.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2008.02a
• /
• pp.173-178
• /
• 2008

본 연구에서는 영상음향의 사운드디자인 구조의 차이가 수용자에게 어떠한 감응도 변화가 있는가를 알아 보았다. 실험은 60초의 TV광고음향을 음악으로만 디자인한 음향트랙과(A), 음향효과와 음악으로 디자인한 음향트랙(B)을 청취하게 하여, 어떠한 사운드 구조가 감응도(주의력, 활성도, 감성도)에 더 유의한 영향을 미치는가를 알아 보았다. 실험은5명씩의 남.여 대학생을 대상으로 이루어 졌고 안정상태와 Fp1, Fp2를 중심으로 한 전두엽측정방식으로 한 뉴로피드백(Neuro feedback)뇌파측정방법으로 측정하였다. 그 결과, 음악으로만 디자인한 A음향트랙에서의 감응도는 주의((ATQ)와 활성도(ACQ), 감성도(EQ)모두가 증가했으나 B트랙보다는 낮았다. 음악+효과음으로 디자인한 B트랙에서는 주의력(ATQ), 활성도(ACQ),는 A트랙보다 증가하였으나 EQ(감성도)는 반대로 A트랙보다 낮았다. 결과적으로 영상에서 음향은 주의력과 활성도 에는 기본적으로 뇌의 변화에 작용하나 정서적인 면은 역시 음악이 유효한 것으로 나타났다. 그러나 강한 효과음들은 음악보다 주의력과 집중도를 높이기는 하나 스트레스적(SQ)지수는 오히려 높은 것으로 나타났다. 본 연구를 통하여 방송과 영화 등의 사운드구조는 영상과의 호흡을 기본으로 하지만 실제로 시각정보와 청각정보가 동시에 합쳐져서, 심리적으로 어떠한 영향을 미치는가를 뇌신경측정으로 고찰한 것에 의의가 있다.

• Journal of the Korea Computer Graphics Society
• /
• v.28 no.3
• /
• pp.79-89
• /
• 2022

With the popularity and the advanced graphics hardware technology of mobile devices, various mobile applications that help children with physical activities have been studied. This paper presents SandUp, a mobile application that guides the play of building sand castles using artificial intelligence and augmented reality(AR) technology. In the process of building the sandcastle, children can interactively explore the target virtual sandcastle through the smartphone display using AR technology. In addition, to help children complete the sandcastle, SandUp informs the sand shape and task required step by step and provides visual and auditory feedback while recognizing progress in real-time using the phone's camera and deep learning classification. We prototyped our SandUp app using Flutter and TensorFlow Lite. To evaluate the usability and effectiveness of the proposed SandUp, we conducted a questionnaire survey on 50 adults and a user study on 20 children aged 4~7 years. The survey results showed that SandUp effectively helps build the sandcastle with proper interactive guidance. Based on the results from the user study on children and feedback from their parents, we also derived usability issues that can be further improved and suggested future research directions.

• 재활복지
• /
• v.21 no.1
• /
• pp.193-212
• /
• 2017

The elderly often produce irrelevant speech and get off-topic more easily than the young; the former also has difficulty generating fewer syntactic structures and makes errors of grammatical morphemes. In particular, the elderly might have more difficulty writing since it requires more complex cognitive processes than storytelling. The participants in this study were 32 young people and 32 older people. They were asked to write a short story of Korean fairy tale('Heungbu Nolbu'). The data was analyzed in narrative composition and syntactic structures. The study revealed the following: First, in composition aspects, the elderly group showed significantly lower total number of story grammar and episodes. In addition, the elderly produced more off topic statements. Second, in syntactic aspects, although there was no significant difference in the number of producing complex sentences between two groups, the elderly group generated more inadequate cohesive devices and used fewer relative and adverbial clauses. These findings suggest that the elderly have a tendency to perform tasks by producing more off-topic statements and shows decreasing coherence by using lower number of relative and adverbial clauses. However, this study also uncovers that the elderly were able to write more complex and longer sentences using visual feedback.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.25 no.6
• /
• pp.807-812
• /
• 2021

In order to be able to interact with the user to experience it as if it were real in virtual reality contents, input/output devices that make them feel the five senses of humans are required . In virtual reality (VR), devices that stimulate sight and hearing are the most representative. For a more realistic experience, suits and gloves that stimulate the sense of touch have recently been released, but there are not many cases applied to actual contents due to the limitation of device . In this paper, we analyze a virtual reality glove that can detect hand movement and touch in a virtual world. Based on the analysis, we propose an algorithm that can sense the intensity of collision with a VR object by tactile sense by improving the UI/UX using the vibration of the feedback method used in the existing virtual reality glove. In addition, the system implemented by the algorithm is applied to an actual case.

• Proceedings of the Korean Information Science Society Conference
• /
• 2005.07b
• /
• pp.550-552
• /
• 2005

실감 재현이 중요한 가상현실 응용에서는 사용자에게 고급 그래픽 환경을 제시하고 사용자의 인터랙션에 즉각적인 피드백을 제공함으로서 실재감과 몰입감을 증대시키는 연구가 진행되어왔다. 실재감, 공간감 전달을 위해 시각과 청각을 함께 활용하는 것이 효과적이나, 가상공간의 특징을 반영한 3차원 사운도 재현 연구는 국내외 통틀어 초기단계에 머물러 있다. 실재감과 공간감을 반영한 3차원 사운드의 재현을 위해서는 음원의 전파, 반사, 잔향 풍의 계산이 사용자의 인터랙션에 따라 새롭게 계산되어야한다. 그러나 사운드 전파경로와 공간을 이루는 모든 폴리곤들과의 충돌을 검사하며 반사 등을 계산하는 것은 실시간성이 중요한 가상현실응용에서는 무리가 따르므로 실 시간성을 보장하기 위한 계산량 축소가 요구된다. 본 논문에서는 다수의 음원이 존재하는 복잡한 가상공간에서의 3차원 사운드를 재현하기 위하여 사운드 신과 계산에 필요한 최소한의 정보를 가지는 오디오 씬 그라프의 공간을 재구성하고 다수의 음원을 대상으로 음원 축소 및 군집화를 적용하여 3차원 사운드효과를 실시간으로 재현하는 알고리즘을 제안한다.

• Physical Therapy Korea
• /
• v.25 no.2
• /
• pp.53-61
• /
• 2018

Background: Stroke patients show abnormal walking patterns due to brain injury. In order to have the desired walking pattern, appropriate stimulation is required to activate the central pattern generator. For this reason, our study performed treadmill ambulatory training with rhythmic auditory stimulation. However we did not consider the influence of visual feedback. Objects: The purpose of this study was to compare the gait abilities in chronic stroke patients following either treadmill walking training with rhythmic auditory stimulation and visual feedback (TRASVF) or treadmill walking training with rhythmic auditory stimulation (TRAS) alone. Methods: Twenty-one stroke patients were divided into two groups: A TRASVF group (10 subjects) and a TRAS group (11 subjects). They received 30 minutes of neuro-developmental therapy (NDT) and walking training for 30 minutes, five times a week for three weeks. Temporal and spatial gait parameters were measured before and after the training period. The Biodex gait trainer treadmill system measured gait parameters. Results: After the training periods, the TRASVF group showed a significant improvement in walking speed, the step length of the affected limb, and time on each foot of the affected limb when compared to the TRAS group (p<.05). Conclusion: The results of this study showed that the treadmill walking training with rhythmic auditory stimulation and visual feedback improved individual gait ability more than the treadmill walking training with rhythmic auditory stimulation alone. Therefore, visual feedback should be considered along with rhythmic auditory stimulation training.