• 전자통신동향분석
• /
• 제38권6호
• /
• pp.12-21
• /
• 2023

Visual relationship understanding in computer vision allows to recognize meaningful relationships between objects in a scene. This technology enables the extraction of representative information within visual content. We discuss the technology of visual relationship understanding, specifically focusing on videos. We first introduce visual relationship understanding concepts in videos and then explore the latest existing techniques. Next, we present benchmark datasets commonly used in video visual relationship understanding. Finally, we discuss future research directions in video visual relationship understanding.

• ETRI Journal
• /
• 제42권3호
• /
• pp.399-410
• /
• 2020

Detecting visual relationships in an image is important in an image understanding task. It enables higher image understanding tasks, that is, predicting the next scene and understanding what occurs in an image. A visual relationship comprises of a subject, a predicate, and an object, and is related to visual, language, and spatial cues. The predicate explains the relationship between the subject and object and can be categorized into different categories such as prepositions and verbs. A large visual gap exists although the visual relationship is included in the same predicate. This study improves upon a previous study (that uses language cues using two losses) and a spatial cue (that only includes individual information) by adding relative information on the subject and object of the extant study. The architectural limitation is demonstrated and is overcome to detect all zero-shot visual relationships. A new problem is discovered, and an explanation of how it decreases performance is provided. The experiment is conducted on the VRD and VG datasets and a significant improvement over previous results is obtained.

• Journal of Information Processing Systems
• /
• 제15권5호
• /
• pp.1171-1178
• /
• 2019

This study proposes a deep neural network model based on an encoder-decoder structure for visual dialogs. Ongoing linguistic understanding of the dialog history and context is important to generate correct answers to questions in visual dialogs followed by questions and answers regarding images. Nevertheless, in many cases, a visual understanding that can identify scenes or object attributes contained in images is beneficial. Hence, in the proposed model, by employing a separate person detector and an attribute recognizer in addition to visual features extracted from the entire input image at the encoding stage using a convolutional neural network, we emphasize attributes, such as gender, age, and dress concept of the people in the corresponding image and use them to generate answers. The results of the experiments conducted using VisDial v0.9, a large benchmark dataset, confirmed that the proposed model performed well.

• 한국실내디자인학회논문집
• /
• 제20권4호
• /
• pp.101-108
• /
• 2011

When observing an object in a space, a part of it is remembered into our perception in the time for paying attention or conscious observation and it reaches to our visual understanding. In this study, it examined characteristics by each subject through the process of visual understanding by changes in such observation time. The results from this study are summarized as belows: First, through analysis of the observation data focused on the distance between the observed points, it was able to apply those visual theories organized before to the analysis of characteristics of the time for understanding by each subject. Second, there showed big differences in the time for visual understanding by each subject according to changes in the observation time so that it was found that there were big differences according to the characteristics of subject's intention or purpose of the observation of a space. Third, as the number of continuous observation gives an important clue in judgement of how well the space was understood, it was able to compare and organize the mutual characteristics of the time the attention was concentrated, the time observed intentionally and the time understood visually. Fourth, it was found that the shorter subjects gave the intentional observation in observing a space, the longer they spent the time for paying attention, while the less they could understand it visually.

• 한국차세대컴퓨팅학회논문지
• /
• 제14권5호
• /
• pp.19-30
• /
• 2018

영상 데이터에 대한 시맨틱 정보를 정확하게 이해하는 것은 인공지능 및 기계학습 분야에서 가장 어려운 도전과제의 하나로 알려져 있다. 본 논문에서는 동영상 시맨틱 이해를 위한 시각 동사 도출과 이를 바탕으로 하는 동영상 데이터베이스인 액션넷 데이터베이스 구축에 관해 제안하고 있다. 오늘날 인공지능 기술의 눈부신 발달에는 인공지능 알고리즘의 발전이 크게 기여하였지만 알고리즘의 학습과 성능 평가를 위한 방대한 데이터베이스의 제공도 기여한 바가 매우 크다고 할 수 있다. 인공지능이 도전하기 어려운 분야였던 시각 정보 처리에 있어서도 정지 영상 내의 객체인식에 있어서는 인간의 수준을 능가하기 시작하면서 점차 동영상에서의 내용에 대한 시맨틱 이해 기술 개발로 발전하고 있다. 본 논문에서는 이러한 동영상 이해를 위한 학습 및 테스트 데이터베이스로서 액션넷 구축에 요구되는 시각 동사의 후보를 도출한다. 이를 위해 언어학 기반의 동사 분류체계를 살펴보고, 영상에서의 시각 정보를 명세한 데이터 및 언어학에서의 시각 동사 빈도 등으로부터 시각 동사의 후보를 도출한다. 시각 동사 분류체계와 시각 동사후보를 바탕으로 액션넷 데이터베이스 스키마를 정의하고 구축한다. 본 논문에서 제안하는 시각 동사 및 스키마와 이를 바탕으로 하는 액션넷 데이터베이스를 개방형 환경에서 확장하고 활용성을 제고함으로써 동영상 이해 기술 발전에 기여할 수 있을 것으로 기대한다.

• 한국초등과학교육학회지:초등과학교육
• /
• 제40권1호
• /
• pp.100-112
• /
• 2021

Based on the importance of visual representation for scientific understanding, this study applied visual thinking in elementary science classes. This study analyzed elementary students' visual thinking and investigated the instructional influences. Students' perceptions on the class applying visual thinking were also investigated. The subject were 38 fourth grade students, 18 in experimental group and 20 in control group. For the unit of 'Shadow and mirror', on-line and off-line blended classes were applied in both group because of COVID-19. The experimental group student were asked to construct their own visual thinking, while the control group students used traditional workbook. The results were as follows. First, students' visual thinking can be classified into three different types, which are 'activity recall type', 'result summary type', and 'core concept representation type' based on what they represent rather than how they represent. Second, applying visual thinking in science class showed significant effects on science academic achievement, science related attitude, and creative academic efficacy. Third, students' perceptions on applying visual thinking in science classes were very positive. Students perceived visual thinking activities were interesting and helpful for understanding science. Educational implications of applying visual thinking in elementary science classes were discussed.

• 한국초등과학교육학회지:초등과학교육
• /
• 제37권2호
• /
• pp.219-231
• /
• 2018

This study surveyed the elementary school teachers' use of visual representations and their perceptions of the functions of visual representations in the teaching of electricity unit. A total of 110 elementary teachers who have experiences in teaching electricity unit responded to online survey. The result showed firstly that most of the teachers use visual representations in their teaching and it is mostly limited to those presented in textbooks or images that they can get easily from internet search. Secondly, elementary teachers thought that they have high ability in using visual representations and low ability in understanding students' visual presentation ability. Thirdly, visual representations are more often preferred to be used as teacher-centered ways than student-centered ways for motivating students and conceptual understanding. However, in case of scientific inquiry, both teacher-centered and student-centered ways were equally preferred. Lastly, the teachers' perceptions of the functions of visual representations were categorized into 'teaching-instrumental function', 'learning-instrumental function', 'communicative-instrumental function' and 8 subcategories were found. The most frequent function was the 'information delivery function' in the 'teaching-instrumental function' category. Implications for teacher education and further studies were discussed.

• 한국융합학회논문지
• /
• 제13권5호
• /
• pp.145-154
• /
• 2022

본 연구는 사용자의 민감성과 공감적 이해 수준에 따른 페이스북 광고의 시각적 수사유형에 대한 효과를 분석하는데 그 목적이 있다. 피험자간 요인설계(시각적 수사유형)×2(브랜드 민감성)×2(공감적 이해도)로 설계하였다. 페이스북 광고의 광고효과를 실험을 통해 분석한 결과는 다음과 같다. 페이스 북 광고의 두 가지 유형에서 동일하게 시각적 수사, 브랜드 민감도, 공감적 이해에서 3원 상호작용 효과가 나타났다. 시각적 수사 유형의 경우, 시각적 직유 광고에 대한 브랜드 민감도와 공감적 이해도 간에 상호작용 효과가 나타나지 않았다. 그러나 시각적 은유 광고의 경우 브랜드 민감도와 공감적 이해도가 모든 종속변수에서 상호작용 효과가 있는 것으로 나타났다.

• 한국수학교육학회지시리즈A:수학교육
• /
• 제57권1호
• /
• pp.37-54
• /
• 2018

Despite the significance of fraction in elementary mathematics education, it is not easy to teach it meaningfully in connection with real life in Korea. This study aims to investigate and analyze 3rd grade students' understanding on unit fraction concepts and on comparison of unit fractions and to identify the parts which need to be supplemented in relation to unit fraction. For these purposes, I reviewed previous studies and extracted chapters which cover unit fractions in elementary mathematics textbooks based on 2009 revised curriculums and analyzed teaching contexts and visual representations of unit fractions. From this point of view, I constructed a test which consists of three problems based on Chval et al(2013) to investigate students' understanding on unit fraction. To apply this test, I selected forty-one 3rd grade students and examined that students' aspects of understanding on unit fraction. The results were analyzed both qualitatively and quantitatively. In this study, I present the analysis results and provide implications and some didactical suggestions for teaching contexts and visual representations of unit fraction based on the discussion.

• 한국감성과학회:학술대회논문집
• /
• 한국감성과학회 1998년도 추계학술발표 논문집
• /
• pp.235-249
• /
• 1998

The purpose of this study is to provide an understanding of the designs that aid in the production or selection of clothing that generally corresponds with the contours of the human body. The study looks at effective and attractive clothing design used in various situations with the goal of gaining understanding of the nuances of women's jackets. To achieve the goals of this jacket study, a sensuous test was employed and several horizontal sections, based on silhouette appearance, were compared and then analysed. The sensuous test was aimed at understanding the visual effects of the silhouette of the jacket.