• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.44 no.2 s.314
• /
• pp.37-46
• /
• 2007

In this paper, we propose technologies for enhancing the immersive realization of virtual objects in AR-based product design. Generally, multimodal senses such as visual/auditory/tactile feedback are well known as a method for enhancing the immersion in case of interaction with virtual objects. By adapting tangible objects we can provide touch sensation to users. A 3D model of the same scale overlays the whole area of the tangible object so the marker area is invisible. This contributes to enhancing immersion. Also, the hand occlusion problem when the virtual objects overlay the user's hands is partially solved, providing more immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In our work, both vibrotactile feedback through page motors, pneumatic tactile feedback, and sound feedback are considered. In our scenario, a game-phone model is selected, by way of proposed augmented vibrotactile feedback, hands occlusion-reduced visual effects and sound feedback are provided to users. These proposed methodologies will contribute to a better immersive realization of the conventional AR system.

• KIPS Transactions on Software and Data Engineering
• /
• v.12 no.6
• /
• pp.275-284
• /
• 2023

Virtual reality simulations are used for education and training in various fields, and are especially widely used in the medical field recently. The education/training simulator consists of tactile/force feedback generation and image/sound output hardware that provides a sense similar to a doctor's treatment of a real patient using real surgical tools, and software that produces realistic images and tactile feedback. Existing simulators are complicated and expensive because they have to use various types of hardware to simulate various surgical instruments used during surgery. In this paper, we propose a dental surgical simulation system using a force feedback device and a morphable haptic controller. Haptic hardware determines whether the surgical tool collides with the surgical site and provides a sense of resistance and vibration. In particular, haptic controllers that can be deformed, such as length changes and bending, can express various senses felt depending on the shape of various surgical tools. When the user manipulates the haptic feedback device, events such as movement of the haptic feedback device or button clicks are delivered to the simulation system, resulting in interaction between dental surgical tools and oral internal models, and thus haptic feedback is delivered to the haptic feedback device. Using these basic techniques, we provide a realistic training experience of impacted wisdom tooth extraction surgery, a representative dental surgery technique, in a virtual environment represented by sophisticated three-dimensional models.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.11 no.4
• /
• pp.125-130
• /
• 2011

This paper investigates the possibility of exploiting haptic force-feedback technology for interacting with Nanta music. We use VR technologies including touch processing technologies and haptic devices to offer touch of cylinder objects and cup object to users. Haptic device is used to implement touch model in VR space. Matlab/Simulink and proSENCE Virtual Touch Toolbox of Handshake Inc. for experiment, are used as programing tools. Function needed to describe the movement of x, y, and z axis respectively are applied to delineate the natural movement of water in cup object modeled with 3D. A certain amount of water in cup object has the difference of sounds. In experiment, to perceive the appearance of 3D object by touch and to feel the tactile by touch are conducted with the effect of sound on Haptic perception. We also verify that it is possible to develop games or contents in VR space by using point.

• Journal of the Korea Computer Graphics Society
• /
• v.27 no.3
• /
• pp.43-53
• /
• 2021

This paper presents an interactive wind system that generates artificial winds in a virtual reality (VR) environment according to online user inputs from a steering wheel and an acceleration pedal. Our system is composed of a head-mounted display (HMD) and three electric fans to make the user sense touch from the winds blowing from three different directions in a racing car VR application. To evaluate the effectiveness of the winds for reducing VR cybersickness, we employ the simulator sickness questionnaire (SSQ), which is one of the most common measures for cybersickness. We conducted experiments on 13 subjects for the racing car contents first with the winds and then without them or vice versa. Our results showed that the VR contents with the artificial winds clearly reduce cybersickness while providing a positive user experience.

• 한국HCI학회:학술대회논문집
• /
• 2007.02a
• /
• pp.64-69
• /
• 2007

이 논문은 촉각 가상 환경(Haptic Virtual Environment)에서 촉각(haptic) 데이터를 촉각 데이터 특성에 맞추어 네트워크에 적응적이고 효율적으로 전송할 수 있는 전송 알고리즘을 제안한다. 촉감 상호작용 측정을 위해 네트워크 햅틱 협업 응용을 작성하였고 지연, 지터, 손실에 따른 변화를 분석하였다. 이를 바탕으로 네트워크 트래픽에 적응할 수 있는 알고리즘을 구성하였다. 손실되거나 지터의 영향을 받은 패킷에는 간단한 선형예측 방법을 사용하여 보상하여 손실과 지터로 인한 오차를 줄였다. 이는 심각한 손실이나 지터에 의해 떨림 현상이 나타나는 햅틱 장치의 문제점을 개선하게 되었다. 또한 네트워크 협업에서 지연이 발생할 때 나타나는 클라이언트들 사이의 비동시성을 해결하기 위하여 완충시간을 두었다. 지연이 큰 클라이언트는 버퍼를 사용하지 않고 실시간으로 처리하고, 지연이 적은 클라이언트는 버퍼를 사용하여 전송받은 좌표를 완충시킨 후에 처리하는 방법을 사용하여 클라이언트들 사이의 햅틱 렌더링을 동기화 하였다. 제안된 알고리즘은 다양한 네트워크 상황에서의 협업에서 개선된 결과를 보였다. 이를 바탕으로 향후 선형예측 방법을 다양하게 적용시키고 서버와 클라이언트 사이의 동기화를 구현하는 알고리즘을 작성할 것이다. 본 논문은 다양한 네트워크 상황 에서 햅틱 데이터를 전송하고 처리하는 연구의 기초자료가 될 수 있을 것이다.

• Journal of the Korea Computer Graphics Society
• /
• v.15 no.3
• /
• pp.1-9
• /
• 2009

Traditional computer simulation uses only traditional input and output devices. With the recent emergence of haptic techniques, which can give users kinetic and tactile feedback, the field of computer simulation is diversifying. In particular, as the virtual-reality-based surgical simulation has been recognized as an effective training tool in medical education, the practical virtual simulation of surgery becomes a stimulating new research area. The surgical simulation framework should represent the realistic properties of human organ for the high immersion of a user interaction with a virtual object. The framework should make proper both haptic and visual feedback for high immersed virtual environment. However, one model may not be suitable to simulate both haptic and visual feedback because the perceptive channels of two feedbacks are different from each other and the system requirements are also different. Therefore, we separated two models to simulate haptic and visual feedback independently but at the same time. We propose an adaptive mass-spring method as a multi-modal simulation technique to synchronize those two separated models and present a framework for a dual model of simulation that can realistically simulate the behavior of the soft, pliable human body, along with haptic feedback from the user's interaction.

• Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
• /
• 2010.06a
• /
• pp.304-304
• /
• 2010

최근 생활에 편리하며 휴대하기 좋은 전자기기들이 개발되고 있다. 휴대폰이나 MP3와 같은 전자기기들은 거의 필수품이라고 할 정도로 우리의 일상생활에 근접하여 있다. 그 종 대표적으로 휴대폰의 종류로 스마트폰과 같은 터치스크린을 이용한 사례는 점차 상승하고 있으며 시간이 지날수록 그 수요는 더욱 많아지고 있다. 때문에 몰입감 제공을 위하여 햅틱장치의 채용이 일반화 되고 있다. 햅틱장치란 가상환경이나 원거리에 있는 환경과 사용자가 상호 작용할 때 사용자에게 촉감이나 힘의 정보를 전달하여 주는 장치로 진동 및 회동 저항에 의해 사용자로 하여금 촉감들 느낄 수 있도록 하는 장치를 뜻한다. 즉, 현실감을 전달을 중점으로 하는 햅틱장치는 빠른 응답 속도와, 진동의 주파수와 크기는 독립적으로 제어가 가능해야 하며 기계적 수용기들을 직접적으로 자극할 수 있어야 한다. 하지만 모바일 햅틱장치의 경우 크기 및 소비전력의 문제로 모든 스펙을 만족하기에는 어려워 좀 더 한정적인 느낌을 제공할 수 없다. 현재까지 모바일 장치에서 햅틱 피드백을 위하여 진동모터나, 솔레노이드, 압전 액츄에이터 등이 많이 사용되어 지고 있다. 그 중 압전 액츄에이터는 입력에너지를 기계적 출력에너지로 변환되는 효과를 이용 한 것으로 압력 센서, 초음파 센서 등 많은 분야에서 응용되고 있으며 변위 범위는 작지만, 크기가 매우 작고 변위 정밀도가 높으며 발생력과 응답속도가 빠르다는 장점이 존재한다. 이를 이용한 햅틱 압전 엑츄에이터의 제작에 사용되는 압전 세라믹스는 높은 전기적 특성을 가질수록 더 졸은 효율을 가지며 이로 인하여 보다 좋은 전기적 특성을 가지는 압전 세라믹스를 필요로 한다. 현재 많이 사용되는 PZT계 세라믹스는 우수한 전기적 특성으로 많이 사용되고 있지만 Pb의 유독성으로 인한 환경문제로 Pb가 포함된 제품을 제한하고 있어 현재 Lead-free의 연구가 이루어지고 있다. Lead-free중 Ba$(Ti_{0.8}Zr_{0.2})O_3$(BZT)는 PZT계 세라믹스를 대체할 차세대 압전 재료로 주목받고 있다. 일반적으로 Lead-free의 압전계수($d_{33}$=100~300pC/N)는 비교적 낮은 값을 보이지만 BZT의 압전계수(BZT $d_{33}$~620pC/N)는 PZT계 세라믹스의 압전계수($d_{33}$=500~600pC/N)와 비교하여 부족하지 않은 압전계수를 보여주며 PZT를 대체할 재료로 주목받고 있다. 본 실험은 햅틱 압전 엑츄에이터용 무연 압전세라믹스의 제작을 위하여 Ba$(Ti_{0.8}Zr_{0.2})O_3-(Ba_{0.7}Ca_{0.3})-TiO_3$(BZT -BCT)의 조성으로 유전 및 압전 특성을 조사하였다.

• Journal of the HCI Society of Korea
• /
• v.7 no.2
• /
• pp.49-56
• /
• 2012

The camera-based mobile applications such as color, pattern and object reading can improve the living quality of blind people. However currently available camera-based applications are uncomfortable for the blind, since these applications do not reflect accessibility requirements of the blind especially on touch screen. We investigated accessibility requirements about rapidly growing camera-based mobile applications on touch screen devices for the blind. In order to identify accessibility requirements, we conducted a usability testing for color reading applications with three different types of interfaces on Android OS. The results of the usability testing were as follows: (1) users preferred short depth of menu hierarchy, (2) the initial audio help was more useful than just-in-time help, (3) users needed both manual and automatic camera shooting modes although they preferred manual to automatic mode, (4) users wanted the OS supported screen reader function to be turned off during the color reading application was running, and (5) users required tactile feedback to identify touch screen boundary. We designed a new user interface for blind people by applying the identified accessibility requirements. From a usability testing of the new user interface with 10 blind people, we showed that the identified accessibility requirements were very useful accessibility guidelines for camera-based mobile applications.

• Journal of KIISE:Software and Applications
• /
• v.37 no.8
• /
• pp.611-619
• /
• 2010

This paper presents an efficient modeling system of virtual pottery in which the user can deform a body of virtual clay with a haptic tool for E-learning. We propose a Circular Sector Element Method (CSEM) which represents the virtual pottery with a set of circular sector elements based on the cylindrical symmetry of pottery. Efficient algorithms for collision detection and response, interactions between adjacent elements, and GPU-based visual-haptic synchronization are designed and implemented for the CSEM. Empirical evaluation showed that the modeling system is computationally efficient with finer details and provides convincing model deformation and force feedback. The developed system, if combined with educational contents, is expected to be used as an effective E-learning platform for elementary school students.

• Journal of Internet Computing and Services
• /
• v.24 no.6
• /
• pp.23-29
• /
• 2023

As an effort to maximize the immersiveness of user experience in virtual reality, there have been constant efforts to provide a user with tactile sensation by providing haptic feedback. Most of the haptic feedback methods, however, can create only limited or unrealistic haptic sensations since they utilize affordable actuators such as a vibrotactile actuator. When it comes to martial arts training or a game, the limitation of such haptic feedback is apparent due to the significant difference between the physical impact of hitting an object and the sensation departed from a vibrotactile actuator. Noting this, we proposed a haptic impact system that can create a haptic impact when the user hits a virtual object with the fist. The haptic interface uses a quick-return mechanism that can deliver haptic impact feedback to a user's fist. The realism of the haptic impact was evaluated by conducting a human-subject experiment. The results indicate a significant effect of haptic feedback on the realism of the virtual impact.