• Proceedings of the Korean Information Science Society Conference
• /
• 2008.06a
• /
• pp.92-97
• /
• 2008

적절한 촉각자극과 결합된 효과음은 실감성을 향상시킨다고 알려져 있다. 예를 들어, 영화나 게임의 총소리 효과음에 진동자극이 결합되면 훨씬 몰입감이 증진된다. 영화의 경우, 미디어 파일 내에 진동효과 관련한 정보를 부가하는 연구가 진행되기도 하였으나 대중화되지는 못했다. 게임의 경우, 진동을 유발시키도록 프로그래밍하는 방식을 사용하기도 한다. 하지만 진동을 고려하여 개발하는 게임은 전체 10% 미만일 정도로 일반화되어 있지 않다. 따라서 효과음향을 실시간으로 감지하여 진동을 발생시키는 시스템이 바람직하다. 본 논문에서는 이러한 시스템에서 특정 효과음을 실시간으로 감지하는 알고리즘을 제안한다. 이 알고리즘에서는 감지하고자 하는 효과음의 주파수 분포를 미리 분석해서 저장해 놓는다. 입력되는 효과음에 대해 실시간으로 주파수를 분석하여 저장된 값과의 차이를 비교하여 특정 효과음을 감지하게 된다. 실시간 주파수 분포에는 sliding fast Fourier transform (SFFT)를 사용한다. 이는 특정 효과음의 시작순간을 명확히 알 수 없기 때문이다. 제안 알고리즘을 First Person Shooting (FPS) 게임에 적용하여 성능분석을 하였다. 소음이 없을 경우, 감지율은 $80{\sim}90%$였으나, 소음 정도가 커질수록 감지율이 선형적으로 반비례하였다. 또한 감지에 걸리는 시간은 효과음 발생순간부터 0.45초 이내였다.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.158-162
• /
• 2009

Sound effects coming with appropriate tactile stimuli can strengthen its reality. For example, gunfire in games and movies, if it is accompanied by vibrating effects, can enhance the impressiveness. On a similar principle, adding the vibration information to existing sound data file and playing sound while generating vibration effects through haptic interfaces can augment the sound experience. In this paper, we propose a method to generate vibration information by analyzing the sound. The vibration information consists of vibration patterns and the timing within a sound file. Adding the vibration information is labor-intensive if it is done manually. We propose a sound detection algorithm to search the moments when specific sounds occur in a sound file and a method to create vibration effects at those moments. The sound detection algorithm compares the frequency characteristic of specific sounds and finds the moments which have similar frequency characteristic within a sound file. The detection ratio of the algorithm was 98% for five different kinds of gunfire. We also develop a GUI based vibrating pattern editor to easily perform the sound search and vibration generation.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.28 no.6
• /
• pp.669-676
• /
• 2010

Visualization requires for effective analysis of the spatial data collected by various sensors. The best way to convey 3D digital spatial information which is modeling of the real world to the users, realistic 3D visualization and display technology. Since most of the display is based on 2D or 2.5D projection to the plane, there is limitation in representing real world in 3D space. In this paper, data from airborne LiDAR for topographic mapping, Flashi-LiDAR as emerging sensor with great potential to 3D data acquisition, and multibeam echo-sounder for underwater measurement, were stereoscopically visualized. 3D monitors are getting popular and could be information media and platform in geoinformatics. Therefore, study on creating 3D stereoscopic contents of spatial information is essential for new technology of stereo viewing systems.

• Journal of Platform Technology
• /
• v.6 no.4
• /
• pp.78-86
• /
• 2018

In this paper, a VR-based cyber hiking system was designed to provide virtual reality for famous mountains that can offer the real senses and feelings of hiking in supporting environmental factors of actual mountains such as the temperature, air, sound, echoes, etc., of the mountain the user wants to climb. The VR-based cyber hiking system that reflects real-time site conditions is largely consisted of the data collection module that collects data from the live site, multiple drive modules that enables the user to feel real senses using data from the sites, and sensor module to detect the stimuli provided by the drive modules and the user's physical body transition. Unlike existing VR-based hiking systems, the proposed cyber hiking system not only provides simple virtual reality for the wanted mountain, but can also provide the natural conditions of real mountains and implement the uphill and downhill of hiking routes. In particular, it has the effect of providing fun and game elements to users by excluding unnecessary conditions and risks that may arise in actual hiking and instead supporting augmented realities such as squirrels on actual hiking paths. In addition, in providing users with the changes in their body before and after hiking, it is expected to be effective in providing diverse feedback such as the height, gradient, and speed of mountain hiking.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.42 no.2
• /
• pp.432-443
• /
• 2017

The primary goal of the MPEG-H 3D Audio standard is to provide immersive audio environments for high-resolution broadcasting services such as UHDTV. This standard incorporates a wide range of technologies such as encoding/decoding technology for multi-channel/object/scene-based signal, rendering technology for providing 3D audio in various playback environments, and post-processing technology. The reference software decoder of this standard is a structure combining several modules and can operate in various modes. Each module is composed of independent executable files and executed sequentially, real time decoding is impossible. In this paper, we make DLL library of the core decoder, format converter, object renderer, and binaural renderer of the standard and integrate them to enable frame-based decoding. In addition, by measuring the computation complexity of each mode of the MPEG-H 3D-Audio decoder, this paper also provides a reference for selecting the appropriate decoding mode for various hardware platforms. As a result of the computational complexity measurement, the low complexity profiles included in Korean broadcasting standard has a computation complexity of 2.8 times to 12.4 times that of the QMF synthesis operation in case of rendering as a channel signals, and it has a computation complexity of 4.1 times to 15.3 times of the QMF synthesis operation in case of rendering as a binaural signals.

• Science of Emotion and Sensibility
• /
• v.8 no.4
• /
• pp.423-433
• /
• 2005

The computer hardware development has provided many chances of emergence between art and technology. In many cases today's interactive artworks cannot be completed without audience's participation. The interactive production process with technical supplementation can be celled feedback. Mr. Nam Jun Paik showed 'Participant TV' that interacts with audience's response in real time. It means artwork changes with the constantly changing value from the data set from human visual perception. Dan Graham showed another feedback related work, which delays 5second playback in mirror that implies consequence of time. Today's media art has to sublimate coincidence, time ant audience into philosophical artwork through consonance that comes with video and sound as we can see from Bill Viola. Stelarc produced artworks. That use input data that is weak signals from brain, muscles. Through a terminal display with player, body expanded meaning of media. Jeffrey Shaw's 'Legible City' provided a fabrication of the reality with the interaction of bicycle's pedal speed and steering direction that is controlled by 4river. RE:MARK used microphone as input device as Edmond Couchot's 'Je same a la vent' and Nam Jun Paik's 'Participant TV' did. There is no communication without feedback between human being. The reality makes audience involved into artworks. That is the reason why feedback has to be natural. Through the feedback process, the originality of the idea is altered by audience. The feedback is not just part of flesh of artwork rather skeleton of it. Technological showoff cannot be art itself The perfection of technological application plan helps feedback that interacts with audience naturally in order that audience hoes not feel the feedback as artificial plan. Interactive media art has to be evolved into new media form with new integration feedback technology.

• KIPS Transactions on Software and Data Engineering
• /
• v.12 no.6
• /
• pp.275-284
• /
• 2023

Virtual reality simulations are used for education and training in various fields, and are especially widely used in the medical field recently. The education/training simulator consists of tactile/force feedback generation and image/sound output hardware that provides a sense similar to a doctor's treatment of a real patient using real surgical tools, and software that produces realistic images and tactile feedback. Existing simulators are complicated and expensive because they have to use various types of hardware to simulate various surgical instruments used during surgery. In this paper, we propose a dental surgical simulation system using a force feedback device and a morphable haptic controller. Haptic hardware determines whether the surgical tool collides with the surgical site and provides a sense of resistance and vibration. In particular, haptic controllers that can be deformed, such as length changes and bending, can express various senses felt depending on the shape of various surgical tools. When the user manipulates the haptic feedback device, events such as movement of the haptic feedback device or button clicks are delivered to the simulation system, resulting in interaction between dental surgical tools and oral internal models, and thus haptic feedback is delivered to the haptic feedback device. Using these basic techniques, we provide a realistic training experience of impacted wisdom tooth extraction surgery, a representative dental surgery technique, in a virtual environment represented by sophisticated three-dimensional models.