• The Journal of the Acoustical Society of Korea
• /
• v.30 no.3
• /
• pp.142-148
• /
• 2011

The final aim of the present study is to develop the intelligent robot, emulating human synesthetic skills which make it possible to associate a color image with a specific sound. This can be done on the basis of the mutual conversion between color image and sound. As a first step of the final goal, this study focused on a basic system using a conversion of color image into sound. This study describes a proposed method to convert color image into sound, based on the likelihood in the physical frequency information between light and sound. The method of converting color image into sound was implemented by using HSI histograms through RGB-to-HSI color model conversion, which was done by Microsoft Visual C++ (ver. 6.0). Two different color images were used on the simulation experiments, and the results revealed that the hue, saturation and intensity elements of each input color image were converted into fundamental frequency, harmonic and octave elements of a sound, respectively. Through the proposed system, the converted sound elements were then synthesized to automatically generate a sound source with wav file format, using Csound.

• Journal of Korean Society for Geospatial Information Science
• /
• v.21 no.4
• /
• pp.151-159
• /
• 2013

The building information should be up-to-date information and propagated rapidly for urban modeling, terrain analysis, life information, navigational system, and location-based services(LBS), hence the most recent and updated data of the building information have been required of researchers. This paper presents the developed system to extract the 3-dimension spatial information from aerial orthoimage and LiDAR data of HSI color model. In particular, this paper presents the image processing algorithm to extract the outline of specific buildings and generate the building polygon from the image using HIS color model, recursive backtracking algorithm and the search maze algorithm. Also, this paper shows the effectivity of the HIS color model in the image segmentation.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.26 no.5
• /
• pp.455-463
• /
• 2008

The shadows, which is generated when acquiring data using optical sensor, mutilates consistency of brightness for same objects in the images. Hence, it makes a trouble to interpret the ground information. This study is focused on detecting the shadowing area in the images. And only single image is used without any other data which is acquired from different source. Also, This study presents the method using HSI color model, especially, using I(intensity) information, and the intensity clustering algorithm. Then, we illuminate the effects of shadow by FFT(Fast Fourier Transform).

• Journal of the Korean Institute of Intelligent Systems
• /
• v.24 no.5
• /
• pp.462-469
• /
• 2014

As a basic study on both engineering applications and representation methods of synesthesia, this paper aims at building basic system which converts a muscular sense into both visual and auditory elements. As for the building method, data of the muscular sense can be acquired through roll and pitch signals which are calculated from both three-axis acceleration sensor and the two-axis gyro sensor. The roll and pitch signals are then converted into both visual and auditory information as outputs. The roll signals are converted into both intensity elements of the HSI color model and octaves as one of auditory elements. In addition, the pitch signals are converted into both hue elements of the HSI color model and scales as another one of auditory elements. Each of the extracted elements of the HSI color model is converted into each of the three elements of the RGB color model respectively, so that the real-time output color signals can be obtained. Octaves and scales are also converted and synthesized into MIDI signals, so that the real-time sound signals can be obtained as anther one of output signals. In experiments, the results revealed that normal color and sound output signals were successfully obtained from roll and pitch values that represent muscular senses or physical movements, depending on the conversion relationship based on the similarity between color and sound.

• Proceedings of the Korean Information Science Society Conference
• /
• 1999.10b
• /
• pp.524-526
• /
• 1999

본 논문은 환경에 독립적인 자동차 영상에서 자동차 번호판 영역을 추출하는 방법을 제안하고 실험 결과를 기술한다. 번호판 주위환경에는 다양한 조건이 존재하며 이에 적응성을 가지고 빠른 추출을 수행하는 것은 매우 중요한 문제이다. 본 논문은 이러한 문제를 해결하기 위해 HSI 컬러 모델에 기반하여 번호판을 면밀히 분석하여 번호판을 유형별로 그룹화하고, 지역 분할 및 병합을 통해 빠른 시간안에 번호판 후보 영역을 검색한다. 그리고 번호판이 갖는 특성을 이용하여 후보 영역에서 번호판 영역임을 검증함으로써 자동차 번호판 영역을 찾는다.

• Science of Emotion and Sensibility
• /
• v.15 no.2
• /
• pp.231-238
• /
• 2012

This study aims for building an application system of converting sound into color image based on synesthetic perception. As the major features of input sound, both scale and octave elements extracted from F0(fundamental frequency) were converted into both hue and intensity elements of HSI color model, respectively. In this paper, we used the fixed saturation value as 0.5. On the basis of color model conversion theory, the HSI color model was then converted into the RGB model, so that a color image of the BMP format was finally created. In experiments, the basic system was implemented on both software and hardware(TMS320C6713 DSP) platforms based on the proposed sound-color image conversion method. The results revealed that diverse color images with different hues and intensities were created depending on scales and octaves extracted from the F0 of input sound signals. The outputs on the hardware platform were also identical to those on the software platform.

• Science of Emotion and Sensibility
• /
• v.16 no.2
• /
• pp.187-194
• /
• 2013

The final aim of the present study is to build a system of converting a color image into musical elements based on a synesthetic perception, emulating human synesthetic skills, which make it possible to associate a color image with a specific sound. This can be done on the basis of the similarities between physical frequency information of both light and sound. As a first step, an input true color image is converted into hue, saturation, and intensity domains based on a color model conversion theory. In the next step, musical elements including note, octave, loudness, and duration are extracted from each domain of the HSI color model. A fundamental frequency (F0) is then extracted from both hue and intensity histograms. The loudness and duration are extracted from both intensity and saturation histograms, respectively. In experiments, the proposed system on the conversion of a color image into musical elements was implemented using standard C and Microsoft Visual C++(ver. 6.0). Through the proposed system, the extracted musical elements were synthesized to finally generate a sound source in a WAV file format. The simulation results revealed that the musical elements, which were extracted from an input RGB color image, reflected in its output sound signals.

• The Journal of the Korea Contents Association
• /
• v.15 no.12
• /
• pp.8-17
• /
• 2015

This paper presents a sound into color signal conversion using a colored-hearing synesthesia. The aim of the present paper is to implement a real-time conversion system which focuses on both hearing and sight which account for a great part of bodily senses. The proposed method of the real-time conversion of color into sound, in this paper, was simple and intuitive where scale, octave and velocity were extracted from MIDI input signals, which were converted into hue, intensity and saturation, respectively, as basic elements of HSI color model. In experiments, we implemented both the hardware system for delivering MIDI signals to PC and the VC++ based software system for monitoring both input and output signals, so we made certain that the conversion was correctly performed by the proposed method.

• The Journal of the Korea Contents Association
• /
• v.16 no.8
• /
• pp.427-434
• /
• 2016

This paper focuses on a real-time hardware processing by implementing the ARM Cortex-M4 based embedded system, using a conversion algorithm from a muscular sense to both visual and auditory elements, which recognizes rotations of a human body, directional changes and motion amounts out of human senses. As an input method of muscular sense, AHRS(Attitude Heading Reference System) was used to acquire roll, pitch and yaw values in real time. These three input values were converted into three elements of HSI color model such as intensity, hue and saturation, respectively. Final color signals were acquired by converting HSI into RGB color model. In addition, Three input values of muscular sense were converted into three elements of sound such as octave, scale and velocity, which were synthesized to give an output sound using MIDI(Musical Instrument Digital Interface). The analysis results of both output color and sound signals revealed that input signals of muscular sense were correctly converted into both color and sound in real time by the proposed conversion method.

• The Transactions of the Korea Information Processing Society
• /
• v.7 no.12
• /
• pp.3995-4003
• /
• 2000

This paper describes a method that extracts the region of car-licence plates in color images of private and commercial cars. To extract car-licence plates, we use the feature that car-licence plate regions have regular colors according to the kinds of cars. In this paper, we propose the method that combines H component of HSI color model and Q component of YIQ color model. To improve efficiency of the process, we cxplore lines ill a car image by a regular interval in a bottom-up style. As a result, the extraction rates by only H-component. only by Q- component. and by combined Hand Q, are 53.6%, 82.1%, and 94.6% respectively.