• Title/Summary/Keyword: Vision-language analysis

Search Result 38, Processing Time 0.025 seconds

Comparative Analysis of Written Language and Colloquial Language for Information Communication of Multi-Modal Interface Environment (다중 인터페이스 환경에서의 문자언어와 음성언어의 차이에 관한 비교 연구)

  • Choi, In-Hwan;Lee, Kun-Pyo
    • Archives of design research
    • /
    • v.19 no.2 s.64
    • /
    • pp.91-98
    • /
    • 2006
  • The product convergence and complex application environment raise the need of multi-modal interface which enables us to interact products through various human senses. The sense of vision has been used predominantly more than any other senses for the traditional and general information gathering situation, but in the future which will be developed based on the digital network technology, the practical use of the various senses will be desired for more convenient and rational usage of the information appliances. The sense of auditory which possibility of practical use is becoming higher than ever with the sense of vision, the possible usage will be developed broader and in the various ways in the future. Based on this situation, the characteristics of the written language and the colloquial language and the comparative analysis of the difference between male and female's reaction for each language were examined through this study. To achieve this purpose, the literature research about the diverse components of the language system was peformed. Then, some peculiar characters of the sense of vision and auditory were reviewed and the appropriate experimentation was planned and carried out. The result of the accomplished experimentation was examined by the objective analysis method. The main results of this study are as follows: first, the reaction time for written language is shorter than colloquial language, second, there is a partial difference between the male's and female's reaction for those two stimuli, third, there is no selection bias between the sense of sight and the sense of hearing. I think the continuous development of the broad and diverse ways of study for various senses is needed based on this study.

  • PDF

Vision- Based Finger Spelling Recognition for Korean Sign Language

  • Park Jun;Lee Dae-hyun
    • Journal of Korea Multimedia Society
    • /
    • v.8 no.6
    • /
    • pp.768-775
    • /
    • 2005
  • For sign languages are main communication means among hearing-impaired people, there are communication difficulties between speaking-oriented people and sign-language-oriented people. Automated sign-language recognition may resolve these communication problems. In sign languages, finger spelling is used to spell names and words that are not listed in the dictionary. There have been research activities for gesture and posture recognition using glove-based devices. However, these devices are often expensive, cumbersome, and inadequate for recognizing elaborate finger spelling. Use of colored patches or gloves also cause uneasiness. In this paper, a vision-based finger spelling recognition system is introduced. In our method, captured hand region images were separated from the background using a skin detection algorithm assuming that there are no skin-colored objects in the background. Then, hand postures were recognized using a two-dimensional grid analysis method. Our recognition system is not sensitive to the size or the rotation of the input posture images. By optimizing the weights of the posture features using a genetic algorithm, our system achieved high accuracy that matches other systems using devices or colored gloves. We applied our posture recognition system for detecting Korean Sign Language, achieving better than $93\%$ accuracy.

  • PDF

The Search for Development of Education in Japanese, through analysis of Korean and Japanese Education Policy (한·일 교육정책 분석을 통한 일본어교육 발전방향 모색)

  • An, Ji-Young
    • Journal of North-East Asian Cultures
    • /
    • v.39
    • /
    • pp.347-360
    • /
    • 2014
  • This research, with the recent change in the paradigm of education, has its purpose on suggesting the direction of Japanese education that best suits the environment in Korea, by analyzing the education and information policy in Korea and Japan. As it is shown in Mackey's model, policy in language and education cannot be separated, and the 'smart education' policy as well as 'Education and Information Vision' that is implemented in Korea and Japan is likely to be connected with policies in language in the near future. Both of these policies has its goals on the spreading of information in education, and is predicted to lead to development in contents in regard to education of foreign language. When looking at recently developed smart-learning programs, it can be found that the credibility and authenticity is weak because in most of those programs, there was no participation of experts in Japanese education. Thus there is a need for expertise in Japanese education for development of these contents and also many attempts with application of 'smart-learning' collaboration of technology and academic knowledge in humanities and education is needed. At the same time, various support from the government is essential so that these policies can simultaneously work together, along with the field of foreign language education.

Extraction Analysis for Crossmodal Association Information using Hypernetwork Models (하이퍼네트워크 모델을 이용한 비전-언어 크로스모달 연관정보 추출)

  • Heo, Min-Oh;Ha, Jung-Woo;Zhang, Byoung-Tak
    • 한국HCI학회:학술대회논문집
    • /
    • 2009.02a
    • /
    • pp.278-284
    • /
    • 2009
  • Multimodal data to have several modalities such as videos, images, sounds and texts for one contents is increasing. Since this type of data has ill-defined format, it is not easy to represent the crossmodal information for them explicitly. So, we proposed new method to extract and analyze vision-language crossmodal association information using the documentaries video data about the nature. We collected pairs of images and captions from 3 genres of documentaries such as jungle, ocean and universe, and extracted a set of visual words and that of text words from them. We found out that two modal data have semantic association on crossmodal association information from this analysis.

  • PDF

The Effects of Social Capital and Individual Motivations on Information Sharing and Community Promotion: Focused on a Chinese Virtual Community (사회적 자본과 개인 동기가 정보공유와 커뮤니티 촉진에 미치는 영향: 중국의 가상커뮤니티를 중심으로)

  • Kim, Jongki;Dai, Shuang;Kim, Jeahyun
    • The Journal of Information Systems
    • /
    • v.25 no.1
    • /
    • pp.135-158
    • /
    • 2016
  • Purpose Virtual communities change the way people communicate and share information. The purpose of this paper is to find how internet social capital and individual motivations influence the information sharing in virtual communities. This study considers the social capital theory, individual motivations, information sharing, and community promotion to construct a theoretical model. Design/methodology/approach Social capital focuses on three dimensions that include 6 factors: social interaction ties, centrality, shared language, shared vision, trust and reciprocity. Individual motivations include 2 factors: reputation and enjoy helping. To confirm the research model and the hypotheses, 426 effective questionnaires were used for the final analysis. Findings The result of data analysis demonstrates that social interaction ties, centrality, shared language, trust, and reciprocity were significant in affecting information sharing behaviors. However, reputation, enjoy helping, and shared vision does not appear to have a significant influence on information sharing behaviors. The information sharing was positively related to community promotion.

The Cinema of Poetry

  • Sbragia, Albert
    • Lingua Humanitatis
    • /
    • v.2 no.2
    • /
    • pp.143-161
    • /
    • 2002
  • This essay explores the theories of Italian poet and filmmaker Pier Paolo Pasolini on the language of cinema. In essays such as "The Cinema of Poetry" and "The Written Language of Reality" composed during the 1960s, Pasolini argues for the special status of film language as "pre-grammatical" and links it to visual signifying processes such as dreams and memories. He also views cinema as the inroads towards a general semiotics of reality since, for him, the basic unit of film language is not the shot but those objects of reality that constitute the mise-en-scene of the shot, hence cinema is posited as the written language of reality whose minimal units of articulation are the very objects of reality itself. Accused by semioticians such as Umberto Eco of semiotic ingenuousness in trying to reduce the facts of culture to nature, Pasolini responded by arguing that he was trying to do the opposite, that is to say, to culturalize nature by examining it as a language. Against the constructed naturalism of both commercial and neorealist films, Pasolini argued for the creation of a poetic cinema able to exploit its constitutional pre grammatical, oneiric and sacred relationship with the world. The essay concludes with an analysis of the film Medea in which Pasolini′s attempt to restore a sacred vision of reality merges with his concerns over the cultural genocide of traditional and emarginated peoples at the hands of neocapitalist homologation.

  • PDF

PCB Defects Detection using Connected Component Classification (연결 성분 분류를 이용한 PCB 결함 검출)

  • Jung, Min-Chul
    • Journal of the Semiconductor & Display Technology
    • /
    • v.10 no.1
    • /
    • pp.113-118
    • /
    • 2011
  • This paper proposes computer visual inspection algorithms for PCB defects which are found in a manufacturing process. The proposed method can detect open circuit and short circuit on bare PCB without using any reference images. It performs adaptive threshold processing for the ROI (Region of Interest) of a target image, median filtering to remove noises, and then analyzes connected components of the binary image. In this paper, the connected components of circuit pattern are defined as 6 types. The proposed method classifies the connected components of the target image into 6 types, and determines an unclassified component as a defect of the circuit. The analysis of the original target image detects open circuits, while the analysis of the complement image finds short circuits. The machine vision inspection system is implemented using C language in an embedded Linux system for a high-speed real-time image processing. Experiment results show that the proposed algorithms are quite successful.

Associative Interactive play Contents for Infant Imagination

  • Jang, Eun-Jung;Lee, Chankyu;Lim, Chan
    • International journal of advanced smart convergence
    • /
    • v.8 no.1
    • /
    • pp.126-132
    • /
    • 2019
  • Creative thinking appears even before it is expressed in language, and its existence is revealed through emotion, intuition, image and body feeling before logic or linguistics rules work. In this study, Lego is intended to present experimental child interactive content that is applied with a computer vision based on image processing techniques. In the case of infants, the main purpose of this content is the development of hand muscles and the ability to implement imagination. The purpose of the analysis algorithm of the OpenCV library and the image processing using the 'VVVV' that is implemented as a 'Node' in the midst of perceptual changes in image processing technology that are representative of object recognition, and the objective is to use a webcam to film, recognize, derive results that match the analysis and produce interactive content that is completed by the user participating. Research shows what Lego children have made, and children can create things themselves and develop creativity. Furthermore, we expect to be able to infer a diverse and individualistic person's thinking based on more data.

Hand Motion Design for Performance Enhancement of Vision Based Hand Signal Recognizer (영상기반의 안정적 수신호 인식기를 위한 손동작 패턴 설계 방법)

  • Shon, Su-Won;Beh, Joung-Hoon;Yang, Cheol-Jong;Wang, Han;Ko, Han-Seok
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.4
    • /
    • pp.30-37
    • /
    • 2011
  • This paper proposes a language set of hand motions for enhancing the performance of vision-based hand signal recognizer. Based on the statistical analysis of the angular tendency of hand movements in sign language and the hand motions in practical use, we construct four motion primitives as building blocks for basic hand motions. By combining these motion primitives, we design a discernable 'fundamental hand motion set' toward increasing the hand signal recognition. To demonstrate the validity of proposed designing method, we develop a 'fundamental hand motion set' recognizer based on hidden Markov model (HMM). The recognition system showed 99.01% recognition rate on the proposed language set. This result validates that the proposed language set enhances discernaility among the hand motions such that the performance of hand signal recognizer is improved.

The influence of social capital on knowledge sharing behavior of mobile learners (사회적 자본이 이동학습자의 지식공유행위에 미치는 영향)

  • Qin, Ying;Lee, Kyeong-Rak;Lee, Sang-Joon
    • Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
    • /
    • v.8 no.9
    • /
    • pp.647-658
    • /
    • 2018
  • Modern society is complex and rapidly changing, and knowledge sharing is needed to acquire and create knowledge. Knowledge sharing is the act of providing information knowledge and know-how of their own in order to cooperate with or help their colleagues. This study presents a research model using social capital theory to explain the mobile knowledge sharing behavior of virtual community members. Based on previous studies, social capital theory is divided into structural, relational, and cognitive aspects. It was composed of social interaction ties as a measure of structural aspect, trust as a measure of cognitive aspect, shared language, shared vision and relational aspect. After collecting survey data, factor analysis and regression analysis were performed using SPSS 22. In this way, we examined how the detailed factors of social capital affect information sharing behavior and how the level of knowledge sharing affects community promotion. The results showed that social interaction ties, shared language, shared vision, and trust affect knowledge sharing. Knowledge sharing has had a positive impact on community promotion.