Journal of Digital Convergence (디지털융복합연구)

The Society of Digital Policy and Management (한국디지털정책학회)
권호 표지
DOI QR코드

DOI QR Code

Method for 3D Visualization of Sound Data

사운드 데이터의 3D 시각화 방법

  • Ko, Jae-Hyuk (Division of Digital Contents, Dongseo University)
  • 고재혁 (동서대학교 디지털콘텐츠학부)
  • Received : 2016.05.02
  • Accepted : 2016.07.20
  • Published : 2016.07.28
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study is to provide a method to visualize the sound data to the three-dimensional image. The visualization of the sound data is performed according to the algorithm set after production of the text-based script that form the channel range of the sound data. The algorithm consists of a total of five levels, including setting sound channel range, setting picture frame for sound visualization, setting 3D image unit's property, extracting channel range of sound data and sound visualization, 3D visualization is performed with at least an operation signal input by the input device such as a mouse. With the sound files with the amount an animator can not finish in the normal way, 3D visualization method proposed in this study was highlighted that the low-cost, highly efficient way to produce creative artistic image by comparing the working time the animator with a study presented method and time for work. Future research will be the real-time visualization method of the sound data in a way that is going through a rendering process in the game engine.

본 연구의 목적은 사운드 데이터를 3차원 입체 이미지로 시각화하는 방법을 제공하는 것이다. 사운드 데이터의 시각화는 사운드데이터의 음역채널을 텍스트베이스형태의 스크립트 제작한 후 설정된 알고리즘에 따라 수행한다. 알고리즘은 음역 채널 설정단계, 사운드 시각화용 화면프레임 설정단계, 단위 입체이미지 구현체 특성정보 설정단계, 사운드 데이터 음역 채널 검출단계, 사운드 시각화단계등 총 5단계로 이루어지며, 마우스등의 입력장치로 최소한된 입력신호조작으로 3D 시각화를 수행한다. 일반적인 방법으로 애니메이터가 할 수 없는 양을 가진 사운드 파일을 이용해, 애니메이터가 작업하는 시간과 제시한 연구방법을 이용한 작업시간을 비교하여, 본 연구에서 제시한 3D 시각화 방법이 창의적 예술적 이미지를 제작에 저비용, 고효율 방법임을 부각하였다. 향후, 게임엔진에서 렌더링 과정을 거치지 않는 방법으로 사운드 데이터의 실시간 시각화 방법을 연구할 예정이다.

Keywords

Acknowledgement

Supported by : 미래창조과학부

References

  1. Min Jeong Song,"A Study on the Idea of Materiality of New Media Art through Rethinking Kinetic Art", Journal of Digital Convergence v.13, no.3, p263-270, 2015
  2. Jong-Nam Sohn, Tae-Woo Han, "Texture mapping of 3D game graphics-characteristics of hand painted texture", Journal of Digital Convergence v.13, n.11, p331-336, 2015
  3. Lee, Su Jin, "Study on Diversity of Data Visualization - Artworks Analysis by The State-of-the-art in Data Visualization", Journal of Digital Design 14(4), p.887-894, Oct, 2014
  4. Yoon-Su Jeong, Yong-Tae Kim, Gil-Cheol Park, "Subnet Selection Scheme based on probability to enhance process speed of Big Data", Journal of Digital Convergence v.13, no.9, p201-208, 2015
  5. Gwang-Seon Choe, Yeong-Gyeong Ham, Seon-Ho Kim, " Visualization of Big Data", KSCI Review 21(1), June, 2013
  6. In-Kyoo Park,"Clustering Algorithm for Data Mining using Posterior Probability-based Information Entropy", Journal of Digital Convergence v.12, no.12, p293-301, 2014 https://doi.org/10.14400/JDC.2014.12.12.293
  7. Seung-Eun Jang, Sang-Wook Kim, Jung-Eun Lee, "An Interactive Art Based on Sound Spectrum", Korea Multimedia Society, p129-132, Nov, 2009
  8. Jong-Hun Park, Gang-Seong Lee, Sang-Hun Lee, "A Study on the Convergence Technique enhanced GrabCut Algorithm Using Color Histogram and modified Sharpening filter", Journal of the Korea Convergence Society, Vol. 6, No. 6, pp. 1-8, 2015 https://doi.org/10.15207/JKCS.2015.6.6.001
  9. Kyoo-Sung Noh, "Convergence Study on Big Data Competency Reference Model", Journal of Digital Convergence v.13, no.3, p55-63, 2015 https://doi.org/10.14400/JDC.2015.13.3.55
  10. Kyoung-Nam Kim, Myoun-Jae Lee, "Artistic Emotional expression of Image distortion based on the magnetic force and user Immersion Through the Convergence of Art and Science Technology", Journal of Digital Convergence v.13, no.8, p457-463, 2015 https://doi.org/10.14400/JDC.2015.13.8.457
  11. sung-min Kim, Myoun-Jae Lee, "A study on the development of cultural industries craft", Journal of Digital Convergence v.11, no.10, p389-694, 2013 https://doi.org/10.14400/JDPM.2013.11.11.389
  12. Souhwan Choe, "A Study on Sound Visualization Based on Music Information Retrieval", Emille(8), p33-58, Dec, 2010
  13. Dae-Hwan Park, Dong Lyor Lee, Wan Bok Lee, "Reactive sound system suitable for platform genre games", Journal of the Korea Convergence Society, Vol. 4, No. 4, pp. 7-12, 2013.
  14. DOI: http://forums.winamp.com/showthread.php?t=379933
  15. DOI: http://infovis.tistory.com/5
  16. DOI: https://namu.wiki/w/%EB%A7%88%EC%9D%B4%ED%81%AC%EB%A1%9C%EC%86%8C%ED%94%84%ED%8A%B8%20%ED%99%80%EB%A1%9C%EB%A0%8C%EC%A6%88
  17. DOI: http://www.animationarena.com/working-for-pixar.html