• Journal of Digital Convergence
• /
• v.14 no.7
• /
• pp.331-337
• /
• 2016

The purpose of this study is to provide a method to visualize the sound data to the three-dimensional image. The visualization of the sound data is performed according to the algorithm set after production of the text-based script that form the channel range of the sound data. The algorithm consists of a total of five levels, including setting sound channel range, setting picture frame for sound visualization, setting 3D image unit's property, extracting channel range of sound data and sound visualization, 3D visualization is performed with at least an operation signal input by the input device such as a mouse. With the sound files with the amount an animator can not finish in the normal way, 3D visualization method proposed in this study was highlighted that the low-cost, highly efficient way to produce creative artistic image by comparing the working time the animator with a study presented method and time for work. Future research will be the real-time visualization method of the sound data in a way that is going through a rendering process in the game engine.

• Cartoon and Animation Studies
• /
• s.36
• /
• pp.469-491
• /
• 2014

Webtoon has developed the method that makes it possible to express sound visually. Also we can also hear sound in webtoon through the development of web technology. It is natural that we analyze the sound that we can hear, but we can also analyze the sound that we can not hear. This study is based on 'dual code' in cognitive psychology. Cartoonists can make visual expression on the basis of auditive impression and memory, and readers can recall the sound through the process of memory and memory-retrieval. This study analyzes both audible sound and inaudable sound. Concise analysis owes the method to film sound theory. Three main factor, Volume, pitch, and tone are recognized by frequency in acoustics. On the other hand they are expressed by the thickness and site of line and image of sound source. The visual expression of in screen sound and off screen sound is related to the frame of comics. Generally the outside of frame means off sound, but some off sound is in the frame. In addition, horror comics use much sound for the effect of genre like horror film. When analyzing comics sound using this kinds of the method film sound analysis, we can find that webtoon has developed creative expression method comparing with simple ones of early comics. Especially arranging frames and expressing sound following and vertical moving are new ones in webtoon. Also types and arrangement of frame has been varied. BGM is the first in using audible sound and recently BGM composed mixing sound effect is being used. In addition, the program which makes it possible for readers to hear sound according to scroll moving. Especially horror genre raise the genre effects using this technology. Various methods of visualizing sound are being created, and the change shows that webtoon could be the model of convergence in contents.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2018.10a
• /
• pp.656-659
• /
• 2018

통계적으로 일반인보다 청각장애인의 교통 사고율이 높은 것으로 나타나는데, 이는 청각 장애로 대표되는 차량을 포함한 위험 요소를 인식하기 힘든 상태나 조건에서 기인한다. 자동차가 접근하는 등의 소리를 듣지 못한다는 것은 결국 어떠한 위치에 위험요소가 존재하는지 인지하지 못함에 따라 사고로 이어질 가능성이 존재함을 의미하는데 이러한 문제점을 개선함과 동시에 대화중인 사람의 목소리를 시각화하여 정보를 제공함으로써 청각장애인으로 하여금 더 안전하고 쾌적한 삶을 누리게 하는 것이 청각장애인을 위한 사운드 정보 시각화 안경의 개발 목적이다. 위와 같은 배경을 통해 딥 러닝 기술에 기반하여 분류 과정을 거친 소리 정보의 판별을 통해 위험 요소를 인식한 후 시각화 하여 정보를 제공하는 디바이스를 제안한다.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2013.07a
• /
• pp.379-380
• /
• 2013

본 논문은 중국전통문화 오행문무(五行文武)와 인터랙티브 미디어 아트 개념을 결합한다. 중국 전통악기 고금(古琴, Gu Qui)을 레이저 다이오드와 빛감지센서를 이용하여 현을 하드웨어적으로 구현하고, VVVV를 활용하여 센서 인식, 음향재생, 프로젝션 화면 영상 시각화에 해당하는 소프트웨어를 구현한다.

• 한국HCI학회:학술대회논문집
• /
• 2008.02a
• /
• pp.184-189
• /
• 2008

In this paper, the sound data either from the sampled or streamed source are utilized for generating a map in the video game play for the dynamiccal use of sound data and synesthesia to users. When users can generate sound in real-time or put the sampled source, it is analyzed and re-processed through Fourier transformation to show the 3D map in dynamic shape over time. We interpolate the generated data to enable the game agents and objects to move.

• The Journal of the Convergence on Culture Technology
• /
• v.8 no.5
• /
• pp.171-176
• /
• 2022

This paper examines the historical meaning and value of sound art curating as a key type of interdisciplinary and convergence art practice that has been unfolding since the mid-20th century. Accordingly, this paper summarizes the developmental process from the beginning of 'sound art' to the present, but examines the context of visual art in which the material 'sound' functioned in chronological order, and focuses on curating cases of major sound art exhibitions. The purpose of this study is to analyze the impact and contemporary significance of the provided aesthetic experience. To this end, the text is divided into three sections and developed. The first section recognizes that the late 19th century futurist and Dadaist sound poetry, followed by Marcel Duchamp's 1913 attempt to combine musical score with visual art, had a profound influence on the visual music of avant-garde composer John Cage. This explains why this background caused the emergence of exhibitions dealing with 'sound' as a new medium. The second section explains that in the 1970s, sound as an artistic medium played a role in reflecting the critical relationship with the exhibition space dominated by visuality. In the third section, we analyze the curatorial methodology that allows the audience to experience sound as if it were a visual object within the organization of the exhibition hall from the 1980s to the present. Through this process, this paper critically treats the historical practice of customizing the perceptual structure in the exhibition hall, and considers the meaningful methodology of sound art curating considering the role of sound full of vitality in the contemporary art scene.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2017.07a
• /
• pp.257-258
• /
• 2017

본 논문에서는 청각 장애인들은 시각에 의존하지 않고는 소리를 인지할 수 없다는 문제를 해결하기 위해 사운드를 시각화하는 웨어러블 시스템을 구현하였다. 시스템의 음성 인식 센서가 음성을 인식해 웨어러블 디스플레이에 전송된 메시지를 확인하고, 기상 재난 메시지를 웨어러블에서 실시간으로 확인하여 안전사고를 예방할 수 있게 하여 청각장애인의 어려움을 해결하였다.

• Proceedings of the Korea Society of Design Studies Conference
• /
• 2005.05a
• /
• pp.160-161
• /
• 2005

• Journal of Digital Convergence
• /
• v.18 no.7
• /
• pp.369-374
• /
• 2020

A variety of sensory elements are used in video advertisements promoting products. Video advertising using visual and auditory elements is a representative means of marketing. The advertising video that promotes the product by using such a sensory element is imprinted on viewers by continuously or repeatedly exposing visual elements such as a logo or a specific image or phrase. Such visual images are used as an effective way to symbolize brand image effectively. If the visual elements were symbolized in the advertising images of most car brands, Kia's K5's advertising images symbolized auditory elements, or sounds, to produce K5's unique advertising images. In this paper, we compared Kia's K5 advertisement image symbolizing auditory elements with other brands' advertisement image of other companies, and studied the techniques and effects used in advertisement image production.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.1075-1080
• /
• 2009

이 글은 Music Information Retrieval(MIR) 기법을 사용하여 오디오 콘텐츠의 리듬 정보를 자동으로 분석하고 이를 시각화하는 방법에 대해 다룬다. 특히 MIR을 활용한 간단한 시각화(sound visualization) 어플리케이션을 소개함으로써 음악 정보 분석이 디자인, 시각 예술에서 다양하게 활용될 수 있음을 보이고자 한다. 음악적 정보를 시각 예술로 담아내려는 시도는 20세기 초 아방가르드 화가들에 의해 본격적으로 시작되었다. 80년대 이후에는 컴퓨터 기술의 급속한 발전으로 사운드와 이미지를 디지털 영역에서 쉽게 하나로 다룰 수 있게 되었고, 이에 따라 다양한 오디오 비주얼 예술작품들이 등장하였다. MIR은 오디오 콘텐츠로부터 음악적 정보를 분석하는 DSP(Digital Signal Processing) 기술로 최근 디지털 콘텐츠 시장의 확장과 더불어 연구가 활발히 진행되고 있다. 특히 웹이나 모바일에서는 이미 다양한 상용 어플리케이션이 적용되고 있는데 query-by-humming과 같은 음악 인식 어플리케이션이 대표적인 경우이다. 이 글에서는 onset 검출(onset detection)을 중심으로 음악적 리듬을 분석하는 알고리즘을 살펴보고 기본적인 조형원리에 따라 이를 시각화하는 어플리케이션의 예를 소개한다.