• The Journal of the Convergence on Culture Technology
• /
• v.2 no.2
• /
• pp.23-27
• /
• 2016

'Colored hearing' occurs to those who caused confusion in the visual, auditory path to brain because pruning had not normally done in the growth phase. It is called as 'colored hearing'. 'Colored hearing' is a phenomenon which some people can see colors when they hear sounds. In the interview of video, art experts say that the phenomenon is a natural talents, however professionals in the medical field say that the disorder may be causing a major disruption to daily life. Usually people are unknowingly suffering from synesthesia phenomenon. In this paper, based on the video, we show the phenomenon of 'colored hearing' based on the results of scientific research and on the daily life, and also analyze the video from the viewpoint of the editors and the audience.

• The Journal of the Korea Contents Association
• /
• v.15 no.12
• /
• pp.8-17
• /
• 2015

This paper presents a sound into color signal conversion using a colored-hearing synesthesia. The aim of the present paper is to implement a real-time conversion system which focuses on both hearing and sight which account for a great part of bodily senses. The proposed method of the real-time conversion of color into sound, in this paper, was simple and intuitive where scale, octave and velocity were extracted from MIDI input signals, which were converted into hue, intensity and saturation, respectively, as basic elements of HSI color model. In experiments, we implemented both the hardware system for delivering MIDI signals to PC and the VC++ based software system for monitoring both input and output signals, so we made certain that the conversion was correctly performed by the proposed method.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.8 no.2
• /
• pp.49-58
• /
• 2012

This paper is on an improved orthogonal projection method which can cancel the acoustic feedback signals in the digital hearing aids. Comparing with the NLMS algorithm which is widely used for simplicity and stability, it shows that this method has the improvement of the convergence performances, and has small computational quantities, for signals with the large auto-correlation as speech signals. This uses the improved orthogonal projection algorithm which reduces the correlation of signals. To verify the convergence characteristics of the proposed algorithm, we simulated about various input signals. The acoustic feedback canceller has a 12-bit resolution with 64-tap adaptive FIR filter. And we compared the results of simulation for this algorithm with the ones for the NLMS algorithm. By these works, it is proved that the feedback canceller adopting the proposed algorithm shows about 3.5dB more high SNR than the NLMS algorithm in the colored input signals.

• Journal of Korea Multimedia Society
• /
• v.8 no.6
• /
• pp.768-775
• /
• 2005

For sign languages are main communication means among hearing-impaired people, there are communication difficulties between speaking-oriented people and sign-language-oriented people. Automated sign-language recognition may resolve these communication problems. In sign languages, finger spelling is used to spell names and words that are not listed in the dictionary. There have been research activities for gesture and posture recognition using glove-based devices. However, these devices are often expensive, cumbersome, and inadequate for recognizing elaborate finger spelling. Use of colored patches or gloves also cause uneasiness. In this paper, a vision-based finger spelling recognition system is introduced. In our method, captured hand region images were separated from the background using a skin detection algorithm assuming that there are no skin-colored objects in the background. Then, hand postures were recognized using a two-dimensional grid analysis method. Our recognition system is not sensitive to the size or the rotation of the input posture images. By optimizing the weights of the posture features using a genetic algorithm, our system achieved high accuracy that matches other systems using devices or colored gloves. We applied our posture recognition system for detecting Korean Sign Language, achieving better than $93\%$ accuracy.

• Journal of the Korea Society of Computer and Information
• /
• v.13 no.2
• /
• pp.135-141
• /
• 2008

In this paper, we propose colored-hear recognition that distinguishing feature of synesthesia for human sensing by shared vision and specific sense of hearing. We perceived what potential influence of human's structured object recognition by visual analysis through the camera, So we've studied how to make blind persons can feel similar vision of real object. First of all, object boundaries are detected in the image data representing a specific scene. Then, four specific features such as object location in the image focus, feeling of average color, distance information of each object, and object area are extracted from picture. Finally, mapping these features to the audition factors. The audition factors are used to recognize vision for blind persons. Proposed colored-hear transformation for recognition can get fast and detail perception, and can be transmit information for sense at the same time. Thus, we were get a food result when applied this concepts to blind person's case of image recognition.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.12 no.5
• /
• pp.887-892
• /
• 2008

This paper is on a new adaptive algorithm which can cancel the acoustic feedback signals in the digital hearing aids. The proposed algorithm uses the normalized LMS algorithm with decorrelators. By doing so, it can be reduced the autocorrelation for the voice signals. To analyze the convergence characteristics of the proposed algorithm, the simulations were carried out about various input signals. And we had compared the performances of convergence for this algorithm with the ones for the NLMS algorithm. As the results of simulations, it is proved that the feedback canceller adopting this algorithm shows about 5-10 dB more high SNR than the NLMS algorithm for the colored inputs.

• The Journal of the Korea Contents Association
• /
• v.16 no.8
• /
• pp.484-492
• /
• 2016

Role of music in an image can be divided into a supplementary function to express narrative of image and an independent function to become the subject of music and to lead the image. To perceive sound through hearing and then, to make it visualized is called visual music. Since the 19th century, image synchronization of music through colored hearing has been continuously attempted by artists in their works. Also in the 20th century, many artists could attempt time-wise concept of movement passing the bounds of three-dimensional expression due to development of cinema. In such a process, artists with strong experimental spirits inferred correlation between sound and image and then, pioneered new genre of visual music. As a result, the times are being changed from those of listening to those of watching, and various works are being produced by experimental attempt of various music and images. This thesis aims to investigate aesthetic characteristics of modern visual music and then, to conduct comparative analysis on how visual music using colors are utilized in diversified fields such as movie, animation, music video and media art.