• Journal of KIISE
• /
• v.43 no.7
• /
• pp.795-800
• /
• 2016

In image classification, recent CNNs compete with human performance. However, there are limitations in more general recognition. Herein we deal with indoor images that contain too much information to be directly processed and require information reduction before recognition. To reduce the amount of data processing, typically variational inference or variational Bayesian methods are suggested for object detection. However, these methods suffer from the difficulty of marginalizing over the given space. In this study, we propose an image-text integrated recognition system using active vision based on Spatial Transformer Networks. The system attempts to efficiently sample a partial region of a given image for a given language information. Our experimental results demonstrate a significant improvement over traditional approaches. We also discuss the results of qualitative analysis of sampled images, model characteristics, and its limitations.

• The Journal of the Korea Contents Association
• /
• v.6 no.9
• /
• pp.124-131
• /
• 2006

Motion graphic is also developing into its own genre in graphic design by establishing individual industrial fields. images and graphics but also recognize even motions and sounds as communication elements delivering a message. Nevertheless, web communication designers have yet to experimentally test the visual motion priniciples or the audio sound expressions in terms of technology. If the dance are used, they may be new communication approaches in the age of multi-media, which allows for communication of visual and audio information or images. With such conceptions in mind, this study was aimed at reviewing the structural relationship between visual motion principles of the kinetic and the sound images to combine the audio and video effects. To this end, the basic structure of dance and music were substituted into the dance to determine their relevancy, and thereupon, examine the effective sound expression methods and techniques depending on movements of the objects in the monitor. Thus, this study, by inquiring into the uniqueness of choreography in motion graphic, presents the possibility of limitless expression of designer creation and inner world, and the ultimate goal lies in assuring the artistic value of motion graphic and its position as a synthetic art.

• Journal of Digital Convergence
• /
• v.14 no.8
• /
• pp.233-243
• /
• 2016

Due to speech recognition problems in noisy environment, Audio Visual Speech Recognition (AVSR) system, which combines speech information and visual information, has been proposed since the mid-1990s,. and lip reading have played significant role in the AVSR System. This study aims to enhance recognition rate of utterance word using only lip shape detection for efficient AVSR system. After preprocessing for lip region detection, Convolution Neural Network (CNN) techniques are applied for utterance period detection and lip shape feature vector extraction, and Hidden Markov Models (HMMs) are then used for the recognition. As a result, the utterance period detection results show 91% of success rates, which are higher performance than general threshold methods. In the lip reading recognition, while user-dependent experiment records 88.5%, user-independent experiment shows 80.2% of recognition rates, which are improved results compared to the previous studies.

• Journal of the Korea Computer Graphics Society
• /
• v.26 no.3
• /
• pp.9-19
• /
• 2020

With the recent development of various kinds of virtual reality devices, there has been an active research effort to increase the sense of reality by recognizing the physical behavior of users rather than by classical user input methods. Among such devices, the Leap Motion controller recognizes the user's hand gestures and can realistically trace the user's hand in a virtual reality environment. However, manipulating an object in virtual reality using a recognized user's hand often causes the hand to pass through the object, which should not occur in the real world. This study presents a way to build a visual feedback system for enhancing the user's sense of interaction between hands and objects in virtual reality. In virtual reality, the user's hands are examined precisely by using a ray tracing method to see if the virtual object collides with the user's hand, and when any collision occurs, visual feedback is given through the process of reconstructing the user's hand by moving the position of the end of the user's fingers that enter the object through sign distance field and reverse mechanics. This enables realistic interaction in virtual reality in real time.

• The KIPS Transactions:PartB
• /
• v.19B no.4
• /
• pp.225-230
• /
• 2012

In this paper, a blind person using a white cane as an adjunct of the things available sensing technology has been implemented. Sensing technology to implement things ultrasonic sensors and a webcam was used to process the data from the server computer. Ultrasonic sensors detect objects within 4meter people distinguish between those things that if the results based on the results will sound off. In this study, ultrasonic sensors, object recognition and human perception with the introduction of techniques and technologies developed for detecting objects in the lives of the visually impaired is expected to be greater usability.

• Proceedings of the Korean Information Science Society Conference
• /
• 2002.10d
• /
• pp.148-150
• /
• 2002

본 논문은 모바일 핸드셋이라는 제한적인 디스플레이 환경과 입력환경에서 필요한 라우트맵의 시각화에 따른 문제점과 그 해결방안을 제시한 논문이다. 자동차 네비게이션 시스템에서 널리 사용되는 경로표시 방법은 일반적으로 노트북이나, PDA, 전용 디스플레이 시스템등에서 구현되어 있으나, 모바일 핸드셋과 같이 제한된 디스플레이 환경에서의 경로표시 방법은 현재까지 많은 연구가 이루어지지 않고 있다. 본 논문은 인간의 인식능력이 임의의 경로를 회전방향점(turning point)의 연속으로 인식한다는 점에 착안하여 원래의 경로가 가진 축적을 변형하여 선분과 회전방향점으로 경로를 표시하는 라인 드라이브 시스템을 모바일 환경의 경로표시 방법으로 사용하였다. 본 논문에서 구현한 시스템은 GIS의 벡터 정보를 가지고 있는 서버와 Brew 플랫폼을 지원하는 모바일 핸드셋으로 구성된다. GIS 서버는 프로토타입 정보를 추출하여 모바일 핸드셋으로 전송하고, 이러한 정보는 모바일 핸드셋의 Brew 플랫폼에서 간략화, 도식화 과정을 거쳐서 시각화된다. 본 논문은 제한된 디스플레이 환경의 경로 확대표시를 위하여 계층별 경로 시각화 방법을 사용하여 가독성을 높이고 사용상의 편리함을 추구한다.

• Journal of The Korean Association For Science Education
• /
• v.39 no.5
• /
• pp.625-635
• /
• 2019

Students are exposed to many visual representations in various visual cultures. Infographics combining visual representations and writing can effectively convey information. Also it can be efficient ways for teachers to focus on important contents. Students can use infographics as a method directly to organize information. Therefore, the infographics that students use both writings and images directly and visually will be more effective on elementary school science classes than the workbook. Classes are guided with the same scientific inquiry and experiment written on the science textbook. The experimental group students organized scientific inquiry by infographics, while the comparison group students still used the workbook. First, the types of infographics are determined by what students want to explain. Based on learning objectives, students used the right type of infographics to effectively convey their focus on information. Second, the infographics organizing activities used in the classes had a significant effect on students' academic achievement. Also, the infographics organizing classes are positively associated to science-related attitudes, including such+ as 'Leisure Interest in Science', 'Adoption of Scientific Attitudes', and 'Attitude to Scientific Inquiry'. Third, visual tendency and classroom treatments had no interactions, but the experimental group had a positive impact regardless of student's characteristics. Fourth, experimental group showed positive attitudes toward to students' perception of infographics. Since some of students had difficulties organizing information in infographics, further research is required to enable students to reduce their burden in application of infographics.

• 한국HCI학회:학술대회논문집
• /
• 2007.02a
• /
• pp.447-454
• /
• 2007

본 논문에서는 사용자의 가상환경 내의 위치 정보에 대한 감각을 향상시키는 방법론으로서 햅틱 피드백(haptic feedback)과 사운드 피드백(sound feedback)의 모달리티를 활용한 그리드(grid)를 제안한다. 제안된 그리드는 사용자의 3차원 공간 내의 움직임(explorative procedure)에 추가적인 비 시각적인(non-visual) 위치정보 피드백을 부여하는데 그 목적을 두고 있다. 햅틱 모달리티를 활용한 3차원 그리드는 SensAble사의 PHANTOM(R) Omni$^{TM}$ 를 활용하여 설계되었으며, 사운드 모달리티를 활용한 경우 저주파 배경음의 주파수 특성(frequency characteristics of sound source)을 사용자 손의 공간 좌표값에 근거하여 재생 시의 표본 추출 비율(sampling rate)를 연속적으로 바꾸는 방식으로 설계되었다. 이러한 공간 그리드는 두 모달리티 각각의 독립적인 제시 및 동시 제시/제거를 통해 평가되었으며, 동시 제시의 경우 두 모달리티간의 어긋남(cross-modal asynchrony)이 없도록 설계되어 사용자의 공간 작업 시 모달리티간의 조화 (manipulating congruency)를 확보할 수 있도록 하였다. 실험을 통해 얻어진 결과는 그것의 통계적 유의미성을 분석하기 위해 다원변량분석과 사후검증(Turkey. HSD)을 거쳐 해석이 되었다. 공간 내 특정 좌표 선택을 기준으로 하는 그리드의 사용자 평과 결과, 3차원 내의 움직임에 대해 햅틱 및 사운드 피드백의 비 시각적 피드백은 사용자의 공간 작업의 오차를 줄여 주고 있음이 확인되었다. 특히 시각적인 정보만으로 확인하기 어려운 Z축 상의 움직임은 그리드의 도움으로 그 오차정도가 50% 이상 줄어 드는 것으로 확인되었다(F=19.82, p<0.01). 이러한 시각적 정보를 보존하는 햅틱, 사운드 피드백 방식을 HCI의 중요한 요소인 사용성과 유용성과 연관시켜 MMHCI(multimodal human-computer interaction) 방법론으로의 적용 가능성을 검토해 본다.

• Journal of the Korea Convergence Society
• /
• v.9 no.6
• /
• pp.155-162
• /
• 2018

A case study was conducted to investigate the characteristics of the visual components affecting the integrated identity design of Winter Olympics for its establishment. The targets of the investigation were limited to the Winter Olympics held after 2010, including the Vancouver, Sochi, and Pyeongchang Winter Olympics. The first survey investigated the characteristics of the visual components, and the second survey analyzed the design characteristics, including connectivity, variability, expandability, and connectivity and could draw the following results. The integrated identity of Winter Olympics maintained the connectivity, providing the integrated recognition of visual components, and there was a variability according to its use. In addition, connective images were maintained with each other. However, it was noted that there was little expandability utilized flexibly according to the applied media in the emblem and slogan even in the various changes. Hopefully, these results will be utilized as the basic data for the development of integrated identity strategies, effective for the production of the design of the emblem of the Olympics in the future.

• The Korean Journal of Archival Studies
• /
• no.33
• /
• pp.155-206
• /
• 2012

Interests in archives management are getting expanded from the public sector into the cultural and artistic field for the ten years after legislation of "Act on the Management of Public Archives" in 1999. However, due to lack of recognition on the importance of archives in the cultural and artistic field, it is rather frequent that information is kept scattered or archives are lost. As an example, absence of precise contract documents or notes of bestowal keeps people from locating great amount of cultural properties, and because of it these creative properties are in the risk of thefts, the closed-door auctioning, or trades in unofficial channels. As how a nation manages cultural and artistic creation inside the nation reflects its cultural level, it can be said that one of the indexes to notice the extent of a nation's cultural level is to take a look at how they are circulated. This study started from this point. Growing economy and rising interests in culture and art made the society more cognizant of the importance and value that visual artworks have, but the archives and information which are showing the context of these artworks and are produced in the course of social interaction are relatively disregarded because too much emphasis lies on the work itself. It is harder to find archives or documentations in Korea than in other advanced countries about the artists themselves or philosophical discourse on the background of the artworks. There is not so much interest to preserve the archives and information produced after the exhibition also, and they are used for no more than promotion or reference. Hereupon, the researcher recognized the importance of visual arts archives and believed that systemic management on them are high in need. And metadata is an essential way for the systemic management, as recently management on artworks or their archives are conducted using the system of the agencies even though they are not produced electronically. The objective of this study is to manage visual arts archives systematically by designing a data model reflecting traits of visual arts archives. Metadata are needed in the every course of archives from acquisition to management, preservation and application. Visual arts archives find its rich value only when a systemic relationship is established among information on artist, artwork and events including exhibition. By establishing a Multiple Entity Data Model, in which artworks, artists and events (exhibitions) make relationship all together, metadata for management on visual arts archive gets more efficiency and at the same time explanatory trait of the archive gets higher. For this reason we, in the study, tried to design a data model by setting each as an independent entities and designating relations between them, in order to find a way to manage visual arts archives more systematically.