• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.66 no.9
• /
• pp.1424-1430
• /
• 2017

Human senses have been studied widely. Many studied are being actively conducted to analyze correlations between two or more different senses. Among them, research on tactile visuality where a subject can indirectly experience visual sensation through tactile elements is also progressing in various fields. In this study, we analyzed color information by having subjects perceive sandpapers with different roughness through tactile sense, then having them choose a color that is reminiscent of the tactile sensation. Unlike existing tactile-visuality studies allowing the perception of indirect visual sense by using tactile sense, this study shows that it is possible to analyze with quantitative value by representing visual image perceived by tactile sense as a color. This study will contribute to emotional evaluation research that combines two or more of the senses felt by humans, and especially is considered to be useful as basic data when conducting research about tactile visuality or auditory tactile sense.

• 한국HCI학회:학술대회논문집
• /
• 2007.02a
• /
• pp.1069-1074
• /
• 2007

청각장애인이 PC환경에서 영화, 방송, 애니메이션 등의 동영상 콘텐츠를 이용할 때 장애의 정도에 따라 콘텐츠의 접근성에 있어서 시각적 수용 이외의 부분적 장애가 발생한다. 이러한 장애의 극복을 위해 수화 애니메이션이나 독화 교육과 같은 청각장애인의 정보 접근성 향상을 위한 콘텐츠와 기술이 개발된 사례가 있었으나 다소 한계점을 가지고 있다. 따라서 본 논문에서는 현대 뉴미디어 예술 작품의 예술적 표현 방법을 구성요소로서 추출하여, 기술과 감성의 조화가 어우러진 독창적인 콘텐츠를 생산할 수 있는 기술을 개발함으로써 PC환경에서 청각장애인의 동영상 콘텐츠에 대한 접근성 향상 방법을 추출하고, 실질적으로 청각적 효과의 시각적 변환 인터페이스 개발 및 이미지 캡션 생성 소프트웨어 개발을 통해 청각장애인의 동영상 콘텐츠 사용성을 극대화시킬 수 있는 방법론을 제시하고자 한다. 본 논문에서는 첫째, 청각장애인의 동영상 콘텐츠 접근성 분석, 둘째, 미디어아트 작품의 선별적 분석 및 유동요소 추출, 셋째, 인터페이스 및 콘텐츠 제작의 순서로 단계별 방법론을 제시하고 있다. 이 세번 째 단계에서 이미지 캡션 생성 소프트웨어가 개발되고, 비트맵 아이콘 형태의 이미지 캡션 콘텐츠가 생성된다. 개발한 이미지 캡션 생성 소프트웨어는 사용성에 입각한 일상의 언어적 요소와 예술 작품으로부터 추출한 청각 요소의 시각적요소로의 전환을 위한 인터페이스인 것이다. 이러한 기술의 개발은 기술적 측면으로는 청각장애인의 다양한 웹콘텐츠 접근 장애를 개선하는 독창적인 인터페이스 추출 환경을 확립하여 응용영역을 확대하고, 공학적으로 단언된 기술 영역을 콘텐츠 개발 기술이라는 새로운 영역으로 확장함으로써 간학제적 시도를 통한 기술영역을 유기적으로 확대하며, 문자와 오디오를 이미지와 시각적 효과로 전환하여 다각적인 미디어의 교차 활용 방안을 제시하여 콘텐츠를 형상화시키는 기술을 활성화 시키는 효과를 거둘 수 있다. 또한 청각장애인의 접근성 개선이라는 한정된 영역을 뛰어넘어 국가간 언어적인 장벽을 초월할 수 있는 다각적인 부가 동영상 콘텐츠에 대한 시도, 접근, 생산을 통해 글로벌 시대에 부응하는 새로운 방법론으로 발전 할 수 있다.

• The Journal of the Acoustical Society of Korea
• /
• v.20 no.3
• /
• pp.98-103
• /
• 2001

The binaural auditory system of human has the capability of differentiating the direction and distance of sound sources. This feature is well characterised in terms of the inter-aural intensity difference (IID), the inter-aural time difference (ITD) and/or the spectral shape difference (SSD) arising from the acoustic transfer of a sound source to the outer ears. This paper proposes an effective way of extracting the three sound perception factors (IID, ITD, SSD) from the head-related transfer functions (HRTF's) that depends on the direction and distance of the acoustic source from the listener. It includes the estimation method of the equivalent ITD and 1/3-octave band-based IID factors and their usage to locate a sound source in space. Subjective and objective tests were carried out to examine the effectiveness of the proposed methodology and its applicability to real sound systems. Those experimental results are illustrated in this paper.

• Journal of Broadcast Engineering
• /
• v.23 no.2
• /
• pp.197-205
• /
• 2018

Panoramic image is one of the technologies that are commonly used today. However, technical difficulties still exist in panoramic video production. Without a special camera such as a 360-degree camera, making panoramic video becomes more difficult. In order to make a panoramic video, it is necessary to synchronize the timeline of multiple videos shot at multiple locations. However, the timeline synchronization method using the internal clock of the camera may cause an error due to the difference of the internal hardware. In order to solve this problem, timeline synchronization between multiple videos using visual information or auditory information has been studied. However, there is a problem in accuracy and processing time when using video information, and there is a problem in that, when using audio information, there is no synchronization when there is sensitivity to noise or there is no melody. Therefore, in this paper, we propose a timeline synchronization method between multiple video using audio waveform. It shows higher synchronization accuracy and temporal efficiency than the video information based time synchronization method.

• Journal of Korea Entertainment Industry Association
• /
• v.15 no.1
• /
• pp.39-51
• /
• 2021

This study is based on literature review and theoretical background, we will explore the interrelationship between music and meditation and meditation image production through music, discuss the relationship between theremin instruments and musical meditation. It also describes whether the musical direction through an emotional approach meets the purpose of music meditation, focusing on the creative process and analysis of the work. In this study, the emotional aspect of music was developed, centering on the auditory characteristics of music and the inner element of meditation, to find the relationship between each other, and to prepare a specific plan for music directing to induce the inner emotion of meditation. This study deduced a way to apply music meditation with an emotional approach centering on the melody through the use of the Theremin instrument, and tried to approach the inner meaning and methodology of the work academically. It is hoped that these studies will contribute to the development of music meditation programs and the expansion of music meditation.

• Physical Therapy Korea
• /
• v.30 no.3
• /
• pp.221-229
• /
• 2023

Background: In modern society, the use of computers accounts for a large proportion of our daily lives. Although substantial research is being actively conducted on musculoskeletal diseases resulting from computer use, there has been a recent surge in interest in improving the working environment for prevention. Objects: This study aimed to examine the effects of posture correction feedback (PCF) on changes in neck posture and muscle activation during computer typing. Methods: The participants performed a computer typing task in two sessions, each lasting 16 minutes. The participant's dominant side was photographed and analyzed using ImageJ software to verify neck posture. Surface electromyography (EMG) was used to confirm the participant's cervical erector spinae (CES) and upper trapezius muscle activities. The EMG signal was analyzed using the percentage of reference voluntary contraction and amplitude probability distribution function (APDF). In the second session, visual and auditory feedback for posture correction was provided if the neck was flexed by more than 15° in the initial position during computer typing. A 20-minute rest period was provided between the two sessions. Results: The neck angle (p = 0.014), CES muscle activity (p = 0.008), and APDF (p = 0.015) showed significant differences depending on the presence of the PCF. Furthermore, significant differences were observed regarding the CES muscle activity (p = 0.001) and APDF (p = 0.002) over time. Conclusion: Our study showed that the feedback system can correct poor posture and reduces unnecessary muscle activation during computer work. The improved neck posture and reduced CES muscle activity observed in this study suggest that neck pain can be prevented. Based on these results, we suggest that the PCF system can be used to prevent neck pain.

• The Journal of the Convergence on Culture Technology
• /
• v.10 no.3
• /
• pp.953-958
• /
• 2024

Recently, there has been growing interest in the Fourth Industrial Revolution, with a particular focus on the advancement of augmented reality (AR) devices. However, there is a shortage of AR content. Augmented reality operates through marker-based and markerless methods. The marker-based approach involves using a camera to capture images that serve as markers, enhancing them through AR principles. To address the scarcity of AR content and improve the quality of character goods, this study proposes integrating AR technology into character goods. The character industry is expanding each year, leading to a diverse range of character goods. Character acrylic stands, among these goods, leverage game, webtoon, and animation character IPs for sales. To enhance the design process, we utilized the character image as a marker, allowing for the creation of content that aligns with the characteristics of the character IP. We selected a webtoon character and developed AR content, incorporating features such as voice, speech bubbles, and an introduction to the webtoon, tailored to the webtoon's characteristics. This study demonstrates the potential of AR to present visual and auditory information, paving the way for a variety of products, including diverse content. We anticipate that utilizing this research will lead to the emergence of products encompassing various contents.

• Journal of Broadcast Engineering
• /
• v.13 no.5
• /
• pp.602-611
• /
• 2008

The sound design performed in the production of media contents, such as TV, movie, and CF, have been conducted through the experienced feeling of some experts in the aspect of auditory effects that communicates stories. Also, there have been few studies of the quantitative approach and verification to apply visual and auditory effects felt by users. This study is a non-equivalent control group pretest-posttest design and investigates the difference in communication effects in which the difference in a sound design in the production of media contents that affects users. This study analyzed the brain quotient (BQ) obtained by the measurement of brain waves during the watching of an experiment image (track A) designed by using a 60-second TV CF only and an experiment image (track B) designed by sound effects and music and investigated which sound design represents differences in communication effects for users. The results of this investigation can be summarized as follows: First, in the results of the comparison of the attention quotient (ATQ), which is the BQ of recognition effects, between A and B tracks, the track A showed a higher difference in activation than the track B. It can be analyzed that the sound design based on music showed higher levels in attention and concentration than that of the sound effect design. Second, in the results of the comparison of the emotional quotient (EQ), which is emotional effects, between A and B tracks, the track A represented a higher difference than the track B. It means that the sound design based on music showed higher contribution levels in emotional effects than that of the design based on sound effects. Third, in the results of the comparison of the left and right brain equivalent quotient (ACQ), which is memory activation effects, between A and B tracks, there were no significant differences. In the results of the experiments, although there are some constraints in TV CF based on the conventional theories in which sound effects based design affects strong concentration, and music based design affects emotional feeling, the music based design may present more effects in continued concentration. In addition, it was evident that the music based design showed higher effects in emotional aspects. However, it is necessary to continue the study by increasing the number of subjects for improving the little differences in ACQ. This study is useful to investigate the communication effects of the sound based design in media contents as a quantitative manner through measuring brain waves and expect the results of this study as the basic materials in the fields of sound production.

• Progress in Medical Physics
• /
• v.25 no.4
• /
• pp.264-270
• /
• 2014

This study developed a portable respiratory training device to improve breathing stability, which is an important element in using the CyberKnife Synchrony respiratory tracking device, one of the typical Stereotactic Radiation Therapy (SRT) devices. It produced an interface for users to be able to select one of two displays, a graph type and a bar type, supported an auditory system that helps them expect next respiration by improving a sense of rhythm of their respiratory period, and provided comfortable respiratory inducement. By targeting 5 applicants and applying individual respiratory period detected through a self-developed program, it acquired signal data of 'guide respiration' that induces breathing through signal data gained from 'free respiration' and an auditory system, and evaluated the usability by comparing deviation average values of respiratory period and respiratory amplitude. It could be identified that respiratory period decreased $55.74{\pm}0.14%$ compared to free respiration, and respiratory amplitude decreased $28.12{\pm}0.10%$ compared to free respiration, which confirmed the consistency and stability of respiratory. SBRT, developed based on these results, using the portable respiratory training device, for liver cancer or lung cancer, is evaluated to be able to help reduce delayed treatment time due to respiratory instability and improve treatment accuracy, and if it could be applied to developing respiratory training applications targeting an android-based portable device in the future, even use convenience and economic efficiency are expected.

• Archives of design research
• /
• v.18 no.2 s.60
• /
• pp.143-154
• /
• 2005

Typography in visual communication design is 'potential form' hidden within a space. Showing rhythm in typography is making 'aesthetic sense' in a graphic which has formative characteristics, the way of expression is very important. When the rhythm is recognized through visual stream, Rhythmic Sense is formed. The research will present a new form of the Visual Rhythmic Sense by analyzing typography works out positively. First of all, I researched works done by Fillippo Marinetti, Robert Massin, Wolfgang Weingart, and David Carson for their vigorous experimentalism in typography in forming visual rhythm. I used S.D. Scale method to analyze characteristics of visual image and VARIMAX for factor analysis reaching types of visual rhythm, which could be classified as following. (1) Synesthesia Rhythmic Sense (R-synesthesia) means that the senses are conveyed through 'visualization of auditory sense' and 'visualization of touch' (2) Simultaneous Rhythmic Sense (R-simultaneity) means that the time and space co-exist in one plane. (3) Connective Rhythmic Sense(R-connection) means that different factors (Within one plane) co-exist interacting with one another and creating a unified impression through such a process. (4) Artist Oriented Rhythmic Sense ($-artist) means that the artist interprets the content subjectively and expresses his/her impression, thereby, attracting a gaze of audience systematically and arbitrarily. (5) Reader Oriented Rhythmic Sense(R-reader) avoids the existing legibility formed through aggressive engagement of the reader.