• Title/Summary/Keyword: visual words

Search Result 333, Processing Time 0.023 seconds

Lexico-semantic interactions during the visual and spoken recognition of homonymous Korean Eojeols (한국어 시·청각 동음동철이의 어절 재인에 나타나는 어휘-의미 상호작용)

  • Kim, Joonwoo;Kang, Kathleen Gwi-Young;Yoo, Doyoung;Jeon, Inseo;Kim, Hyun Kyung;Nam, Hyeomin;Shin, Jiyoung;Nam, Kichun
    • Phonetics and Speech Sciences
    • /
    • v.13 no.1
    • /
    • pp.1-15
    • /
    • 2021
  • The present study investigated the mental representation and processing of an ambiguous word in the bimodal processing system by manipulating the lexical ambiguity of a visually or auditorily presented word. Homonyms (e.g., '물었다') with more than two meanings and control words (e.g., '고통을') with a single meaning were used in the experiments. The lemma frequency of words was manipulated while the relative frequency of multiple meanings of each homonym was balanced. In both experiments using the lexical decision task, a robust frequency effect and a critical interaction of word type by frequency were found. In Experiment 1, spoken homonyms yielded faster latencies relative to control words (i.e., ambiguity advantage) in the low frequency condition, while ambiguity disadvantage was found in the high frequency condition. A similar interactive pattern was found in visually presented homonyms in the subsequent Experiment 2. Taken together, the first key finding is that interdependent lexico-semantic processing can be found both in the visual and auditory processing system, which in turn suggests that semantic processing is not modality dependent, but rather takes place on the basis of general lexical knowledge. The second is that multiple semantic candidates provide facilitative feedback only when the lemma frequency of the word is relatively low.

The effects of visual and auditory information as A tool of emotional value assessment (감성 가치 평가를 위한 시각적, 청각적 매체의 효용)

  • Kim Myung-Suk;Lee Eun-Chang
    • Journal of Science of Art and Design
    • /
    • v.1
    • /
    • pp.95-123
    • /
    • 1999
  • The goal of this research is a visual and auditory tool development enabling designers to have the same emotional value with users in the process of user centered design. Through the research, we intend to show the aid measure for making cognitive gaps narrow between users and designer in the process of transforming and understanding the emotional needs as a verbal image. because In the business practice of design, most of tools and techniques for assessment and analysis of emotional needs are those used usually in the marketing fields. So the information generated and transformed from users to designers have a form of physical words. When the designer's understanding of the emotional needs is considered as a product mediated communication process, the morphologic and cognitive information gaps become obvious. This difference could be a false basis in designing with emotional user needs. So the alternative needs assessment sub-tools of visual and auditory information form was embodied mainly for designer's cognitive gaps and inter-cultural emotional needs assessment. As the method of embodiment, Firstly, adjectives related to emotion were classified in their cognitive dimension. Secondly, visual and auditory data were extracted, and then the relativity verified. Finally, the practicality and effectiveness were tested through the database generation. In view of the results so far achieved, 1. We could find being of the big information cognitive gaps in the verbal assessment of emotional needs between designers and users. 2. With the visual and auditory assessment tool, we could make the big cognitive gaps narrower than we expected. 3. Also, we could find the chance that the fidelity, recognition, and friendliness of design for emotional user needs would become better.

  • PDF

Different of Physical Activity Using Visual Stimulation Smart Device on Children's Athletic Ability and Attention Concentration (시각자극 스마트기기를 활용한 체육활동에 따른 유아의 운동능력과 주의 집중력의 차이)

  • Lim, DONG-HO;LEE, SO-MI
    • Journal of Digital Convergence
    • /
    • v.16 no.2
    • /
    • pp.415-420
    • /
    • 2018
  • The purpose of this study was to examine the effects of physical activity using visual stimulation smart devices on the athletic performance and attention - The conclusion is as follows. The physical activity using visual stimulation smart device was applied to the infant. The pre - and post - experiment results showed that the infants of the experimental group were higher than those of the control group. Specifically, the ability of the infant to participate in physical activity using the visual stimulation smart device was improved by sit-up bending and centering ability. Also, physical activity using visual stimulation smart device helped to improve attention of infants. In other words, it was confirmed that information and communication technology (ICT) and physical activity affect both physical and cognitive development of infants. Therefore, in order to improve the athletic ability and concentration of children more effectively, it is possible to maximize the educational effect by teaching the contents using various contents that can motivate the infant rather than the same teaching method.

A Visualization of the Solution of Truncated Series (절적(截積) 해법의 시각화)

  • Lee, Kyung Eon
    • Journal for History of Mathematics
    • /
    • v.28 no.4
    • /
    • pp.167-179
    • /
    • 2015
  • We study the solution of truncated series of Lee Sang-hyeog with the aspect of visualization. Lee Sang-hyeog solved a problem of truncated series by 4 ways: Shen Kuo' series method, splitting method, difference sequence method, and Ban Chu Cha method. As the structure and solution of truncated series in tertiary number is already clarified with algebraic symbols in some previous research, we express and explain it by visual representation. The explanation and proof of algebraic symbols about truncated series is clear in mathematical aspects; however, it has a lot of difficulties in the aspects of understanding. In other words, it is more effective in the educational situations to provide algebraic symbols after the intuitive understanding of structure and solution of truncated series with visual representation.

VISUAL AND COLOR ANALYSIS ON PRINT ADVERTISEMENTS IN KOREAN DAILY NEWSPAPER (한국신문의 칼라광고에 나타난 비주얼과 인쇄색상에 관한 연구)

  • 이광숙;강영립
    • Journal of the Korean Graphic Arts Communication Society
    • /
    • v.19 no.2
    • /
    • pp.38-48
    • /
    • 2001
  • Visual and color in Korean newspaper advertisements appeared in transformational advertising (21cm$\times$30.4cm) were analyzed. Data were gathered from 191 advertisements shown on major four daily newspaper; Dong-a, Joong-ang, Chosun and Hanguk from October to December in 2000. From the results of this research, both type of layout and color are proposed more variety by this researcher. Mixed production techniques are used in newspaper advertising. Also, more foreign advertising model are expected near future. Finally, product life cycle have relationship with each layout elements. In other words, based on the stage of product life cycle layout elements are changed respectively.

  • PDF

Lipreading using The Fuzzy Degree of Simuliarity

  • Kurosu, Kenji;Furuya, Tadayoshi;Takeuchi, Shigeru;Soeda, Mitsuru
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1993.06a
    • /
    • pp.903-906
    • /
    • 1993
  • Lipreading through visual processing techniques help provide some useful systems for the hearing impaired to learn communication assistance. This paper proposes a method to understand spoken words by using visual images taken by a camera with a video-digitizer. The image is processed to obtain the contours of lip, which is approximated into a hexagon. The pattern lists, consisting of lengths and angles of hexagon, are compared and computed to get the fuzzy similarity between two lists. By similarity matching, the mouth shape is recognized as the one which has the pronounced voice. Some experiments, exemplified by recognition of the Japanese vowels, are given to show feasibilities of this method.

  • PDF

A Visual Study of the Quality of English Pronunciation Using the Praat Program (Praat을 활용한 영어발음특성의 시각적 연구)

  • Park, Heesuk
    • Journal of Digital Contents Society
    • /
    • v.14 no.3
    • /
    • pp.323-331
    • /
    • 2013
  • This study aims at investigating and comparing the diphthongs, words, and sentences between two Korean highschool students groups using the Praat program. To do this English words and sentences were uttered and recorded by twenty Korean subjects; each group has ten subjects. All the subjects are female and their grades range from freshman to sophomore. Acoustic features were measured from a sound spectrogram with the help of the Praat software program and analyzed through statistical analysis. Results showed that the lengths of diphthongs and words were different between two groups, but the difference was not significant. However, in the lengths of sentence utterance, the group of 5 to 6 grade students in the current grading system pronounced longer than that of 1 to 2 grade students. Especially in the pronunciation of the first two sentences with more than five words, the difference was significant. From the data of the overall sum of words between the two subject groups, we were able to find out that the differences of the lengths of the words with the diphthongs were not significant, but those of the sentences with more than five words were significant. In the pronunciation of the words between coat and code, the length of the diphthong in coat was smaller than that of in code.

Robust Feature Extraction Based on Image-based Approach for Visual Speech Recognition (시각 음성인식을 위한 영상 기반 접근방법에 기반한 강인한 시각 특징 파라미터의 추출 방법)

  • Gyu, Song-Min;Pham, Thanh Trung;Min, So-Hee;Kim, Jing-Young;Na, Seung-You;Hwang, Sung-Taek
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.20 no.3
    • /
    • pp.348-355
    • /
    • 2010
  • In spite of development in speech recognition technology, speech recognition under noisy environment is still a difficult task. To solve this problem, Researchers has been proposed different methods where they have been used visual information except audio information for visual speech recognition. However, visual information also has visual noises as well as the noises of audio information, and this visual noises cause degradation in visual speech recognition. Therefore, it is one the field of interest how to extract visual features parameter for enhancing visual speech recognition performance. In this paper, we propose a method for visual feature parameter extraction based on image-base approach for enhancing recognition performance of the HMM based visual speech recognizer. For experiments, we have constructed Audio-visual database which is consisted with 105 speackers and each speaker has uttered 62 words. We have applied histogram matching, lip folding, RASTA filtering, Liner Mask, DCT and PCA. The experimental results show that the recognition performance of our proposed method enhanced at about 21% than the baseline method.

An Analysis on Appropriateness of Environmental Education Materials (환경교육 교재의 적합성 분석)

  • Yang, Jae-Sik;Nam, Sang-Joon
    • Hwankyungkyoyuk
    • /
    • v.16 no.2
    • /
    • pp.65-73
    • /
    • 2003
  • This study has an aim to construct a reference frame to analyze the appropriateness of environmental education(EE) materials of elementary schools, and to search the basic direction of the scheme for analysis. In addition, this study has an aim to induce what the results of this analysis suggests for the development and reconstruction of EE materials. It was analyzed how truly EE materials reflected contents selected as an analysis scheme, after grasping practical use and features of textbooks, audio-visual materials, and a web-site that are typical materials in EE of elementary schools. The results in textbook analysis were that there were a human-centered environmentalism in the EE unit ("Environmentally Sound National Development", 5th Grade) of Social Studies. The result in analysis of audio-visual materials "Environmental Warrior, Zentaforce" of EBS, were that there are unhealthy environmentalism in that material. In other words, technology itself is considered as a almighty means to solve environmental problems. Finally, the result in web-site analysis were that the "Environmental Class" of Ministry of Environment did not have sound environmentalism. The above result of study shows us that the most important thing in developing and using the environmental education materials is to have sound environmental values and EE perspective, to evaluate EE material with various point of view, to judge its result, and to use it.

  • PDF

The Effects of Visual Stimulation and Body Gesture on Language Learning Achievement and Course Interest

  • CHOI, Dongyeon;KIM, Minjeong
    • Educational Technology International
    • /
    • v.16 no.2
    • /
    • pp.141-166
    • /
    • 2015
  • The purpose of this study was to examine the effects of using visual stimulation and gesture, namely embodied language learning, on learning achievement and learner's course interest in the EFL classroom. To investigate the effectiveness of the proposed purpose, thirty two third-grade elementary school students participated and were assigned into four English learning class conditions (i.e., using animated graphic and gestures condition, using only animated graphic condition, using still pictures and gesture condition, and control condition). The research questions for this study are addressed below: (1) What differences are there in post and delayed learning achievement between imitating gesture group and non-imitating one and between animated graphic group and still picture one? (2) What differences are there in course interest between imitating gesture group and non-imitating one and between animated graphic group and still picture one? The Embodiment-based English learning system for this study was designed by using Microsoft's Kinect sensing devices. The results of this study revealed that students of imitating gesture group memorized and retained better words and sentence structure than those of the other groups. As for learner's course interest measurement, imitating gesture group showed a highly positive response to attention, relevance, and satisfaction for curriculum and using animated graphic influenced satisfaction as well. This finding can be attributed to the embodied cognition, which proposes that the body and the mind are inseparable in the constitution of cognition and thus students using visual simulation and imitating related gesture regard the embodied language learning approach more satisfactory and acceptable than the conventional ones.