• Title/Summary/Keyword: Machine-vision

Search Result 883, Processing Time 0.028 seconds

Development of a Ream-time Facial Expression Recognition Model using Transfer Learning with MobileNet and TensorFlow.js (MobileNet과 TensorFlow.js를 활용한 전이 학습 기반 실시간 얼굴 표정 인식 모델 개발)

  • Cha Jooho
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.19 no.3
    • /
    • pp.245-251
    • /
    • 2023
  • Facial expression recognition plays a significant role in understanding human emotional states. With the advancement of AI and computer vision technologies, extensive research has been conducted in various fields, including improving customer service, medical diagnosis, and assessing learners' understanding in education. In this study, we develop a model that can infer emotions in real-time from a webcam using transfer learning with TensorFlow.js and MobileNet. While existing studies focus on achieving high accuracy using deep learning models, these models often require substantial resources due to their complex structure and computational demands. Consequently, there is a growing interest in developing lightweight deep learning models and transfer learning methods for restricted environments such as web browsers and edge devices. By employing MobileNet as the base model and performing transfer learning, our study develops a deep learning transfer model utilizing JavaScript-based TensorFlow.js, which can predict emotions in real-time using facial input from a webcam. This transfer model provides a foundation for implementing facial expression recognition in resource-constrained environments such as web and mobile applications, enabling its application in various industries.

A machine-vision based inspection system for non-transparent and high-reflectance substrate (머신 비전을 이용한 불투명/고반사율 기판 검사 시스템)

  • Yeo, Kyeong-Min;Seo, Jung-Woo;Lee, Suk-Won;Yi, June-Ho
    • Annual Conference of KIPS
    • /
    • 2010.04a
    • /
    • pp.369-372
    • /
    • 2010
  • 평판 디스플레이(flat panel display)의 크기가 커짐에 따라 다양한 기판을 이용한 제조 방법이 개발되고 있다. 디스플레이 제조 공정 중 기판의 결함을 찾아서 분류하는 검사 시스템은 최종 제품의 품질을 결정하는 매우 중요한 부분이다. 본 연구는 머신비전 기술을 이용하여 불투명하고 반사율이 높은 기판 표면의 결함을 찾아내고, 이 결함을 스크래치(scratch), 흑결함(dark defect), 백결함(white defect)으로 분류하는 장치를 구현하는데 목적이 있다. 이를 구현하기 위해 본 논문에서는 정밀 스테이지(stage)와 라인 카메라(line CCD camera)을 이용한 광학계를 활용하여 검사 시스템을 구현하였다. 구축된 시스템을 이용하여 취득한 이미지를 12 개의 영역으로 등분하여 각각의 국부 영역에 대한 문턱값 연산(thresholding)을 적용함으로써 조명의 불균일을 의한 검출 에러율을 획기적으로 낮추었다. 간단한 컴퓨터비전 알고리듬의 채용으로도 검사 시스템의 구현이 가능함을 보였다.

DEVELOPMENT OF AN INTEGRATED GRADER FOR APPLES

  • Park, K. H.;Lee, K. J.;Park, D. S.;Y. S. Han
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 2000.11c
    • /
    • pp.513-520
    • /
    • 2000
  • An integrated grader which measures soluble solid content, color and weight of fresh apples was developed by NAMRI. The prototype grader consists of the near infrared spectroscopy and machine vision system. Image processing system and an algorithm to evaluate color were developed to speed up the color evaluation of apples. To avoid the light glare and specular reflection, an half-spherical illumination chamber was designed and fabricated to detect the color images of spherical-shaped apples more precisely. A color revision model based on neural network was developed. Near-infrared(NIR) spectroscopy system using NIR reflectance method developed by Lee et al(1998) of NAMRI was used to evaluate soluble solid content. In order to observe the performance of the grader, tests were conducted on conditions that there are 3 classes in weight sorting, 4 classes in combination of color and soluble solid content, and thus 12 classes in combined sorting. The average accuracy in weight, color and soluble solid content is more than about 90 % with the capacity of 3 fruits per second.

  • PDF

Algorithm for Discrimination of Brown Rice Kernels Using Machine Vision

  • C.S. Hwang;Noh, S.H.;Lee, J.W.
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 1996.06c
    • /
    • pp.823-833
    • /
    • 1996
  • An ultimate purpose of this study is to develop an automatic brown rice quality inspection system using image processing technique. In this study emphasis was put on developing an algorithm for discriminating the brown rice kernels depending on their external quality with a color image processing system equipped with an adaptor for magnifying the input image and optical fiber for oblique illumination. Primarily , geometrical and optical features of sample images were analyzed with unhulled paddy and various brown rice kernel samples such as sound, cracked, green-transparent , green-opaque, colored, white-opaque and brokens. Secondary, an algorithm for discrimination of the rice kernels in static state was developed on the basis of the geometrical and optical parameters screened by a statistical analysis(STEPWISE and DISCRIM Procedure, SAS ver.6). Brown rice samples could be discriminated by the algorithm developed in this study with an accuracy of 90% to 96% for the sound , cracked, colored, broken and unhulled , about 81% for the green-transparent and the white-opaque and about 75% for the green-opaque, respectively. A total computing time required for classification was about 100 seconds/1000 kernels with the PC 80486-DX2, 66MHz.

  • PDF

Deep learning of sweep signal for damage detection on the surface of concrete

  • Gao Shanga;Jun Chen
    • Computers and Concrete
    • /
    • v.32 no.5
    • /
    • pp.475-486
    • /
    • 2023
  • Nondestructive evaluation (NDE) is an important task of civil engineering structure monitoring and inspection, but minor damage such as small cracks in local structure is difficult to observe. If cracks continued expansion may cause partial or even overall damage to the structure. Therefore, monitoring and detecting the structure in the early stage of crack propagation is important. The crack detection technology based on machine vision has been widely studied, but there are still some problems such as bad recognition effect for small cracks. In this paper, we proposed a deep learning method based on sweep signals to evaluate concrete surface crack with a width less than 1 mm. Two convolutional neural networks (CNNs) are used to analyze the one-dimensional (1D) frequency sweep signal and the two-dimensional (2D) time-frequency image, respectively, and the probability value of average damage (ADPV) is proposed to evaluate the minor damage of structural. Finally, we use the standard deviation of energy ratio change (ERVSD) and infrared thermography (IRT) to compare with ADPV to verify the effectiveness of the method proposed in this paper. The experiment results show that the method proposed in this paper can effectively predict whether the concrete surface is damaged and the severity of damage.

UAV-based bridge crack discovery via deep learning and tensor voting

  • Xiong Peng;Bingxu Duan;Kun Zhou;Xingu Zhong;Qianxi Li;Chao Zhao
    • Smart Structures and Systems
    • /
    • v.33 no.2
    • /
    • pp.105-118
    • /
    • 2024
  • In order to realize tiny bridge crack discovery by UAV-based machine vision, a novel method combining deep learning and tensor voting is proposed. Firstly, the grid images of crack are detected and descripted based on SE-ResNet50 to generate feature points. Then, the probability significance map of crack image is calculated by tensor voting with feature points, which can define the direction and region of crack. Further, the crack detection anchor box is formed by non-maximum suppression from the probability significance map, which can improve the robustness of tiny crack detection. Finally, a case study is carried out to demonstrate the effectiveness of the proposed method in the Xiangjiang-River bridge inspection. Compared with the original tensor voting algorithm, the proposed method has higher accuracy in the situation of only 1-2 pixels width crack and the existence of edge blur, crack discontinuity, which is suitable for UAV-based bridge crack discovery.

Artificial Intelligence Plant Doctor: Plant Disease Diagnosis Using GPT4-vision

  • Yoeguang Hue;Jea Hyeoung Kim;Gang Lee;Byungheon Choi;Hyun Sim;Jongbum Jeon;Mun-Il Ahn;Yong Kyu Han;Ki-Tae Kim
    • Research in Plant Disease
    • /
    • v.30 no.1
    • /
    • pp.99-102
    • /
    • 2024
  • Integrated pest management is essential for controlling plant diseases that reduce crop yields. Rapid diagnosis is crucial for effective management in the event of an outbreak to identify the cause and minimize damage. Diagnosis methods range from indirect visual observation, which can be subjective and inaccurate, to machine learning and deep learning predictions that may suffer from biased data. Direct molecular-based methods, while accurate, are complex and time-consuming. However, the development of large multimodal models, like GPT-4, combines image recognition with natural language processing for more accurate diagnostic information. This study introduces GPT-4-based system for diagnosing plant diseases utilizing a detailed knowledge base with 1,420 host plants, 2,462 pathogens, and 37,467 pesticide instances from the official plant disease and pesticide registries of Korea. The AI plant doctor offers interactive advice on diagnosis, control methods, and pesticide use for diseases in Korea and is accessible at https://pdoc.scnu.ac.kr/.

Magical Realism of Korean Independent Animation (한국독립애니메이션 <무림일검의 사생활>에 나타난 마술적 사실주의)

  • Cho, Young-Eun;Seo, Chae-Hwan
    • Cartoon and Animation Studies
    • /
    • s.39
    • /
    • pp.59-83
    • /
    • 2015
  • Magical realism, blooming and improving in Latin America, opened the new vision about reality and rationalism, coming out from the out-styled frame of past. While having common points with unrealistic literature, which uses fantastical components, magical realism is different from Surrealism and fantasy literature that is focusing on reality and realizing reality intensely. In the early stage of this research, magical realism was restricted by the characteristics of literature of Latin America, but the research of magical realism is expanding in planning Post-Modernism nowadays. Lately, the influence of magical realism is identified in literatures, arts, films, and animations over the world; according to the research, however, research about magical realism in animations was not done in Korea before. A Korean independent animation "A coffee vending machine and its sword" was evaluated positively in many international film festivals is valuable as the research of magical realism. Throughout this study, this animation "A coffee vending machine and its sword" was analyzed by its narrative and images. The analysis of narrative consists two parts. One is about the form of narrative and the other is about contents through the story. Analysis of Image is also divided into two parts: background image and character image. In this animation, the protagonist is narrating about the fantastic accidents in his life and his own feelings towards it. The narration leads audience to understand his situation and feelings in meta-fiction. On the surface, audience watches the love story of a normal girl and coffee vending machine in this artwork, but deep inside the animation, it is visible that the directors tried to make audiences think about the life of 880,000-won Generation in Korea. The background image was represented as real places in Seoul including the landmark of Seoul, making mimesis of reality in Korea. The character image has two conflicting aspects with reincarnated warrior, Jinyoungyoung and a coffee vending machine. It is a hybrid-character transmogrifying between two characters. Likewise, "A coffee vending machine and its sword" has the characteristics of Korean magical realism through form, content and image. Through analyzing the Korean independent animation "A coffee vending machine and its sword", this research tried to find a way of using factors of fantasy, of representing reality as a dramatic device and of using magical realism of Korean animation for bond of sympathy with audience.

A Study on the Reliability of Corrected Diopter according to Subjective refraction instrument (자각식굴절검사기기에 따른 교정굴절력의 신뢰도에 관한 연구)

  • Lee, Hark-Jun;Kim, Jung-Hee;Ryu, Kyung-Ho
    • Journal of Korean Ophthalmic Optics Society
    • /
    • v.15 no.3
    • /
    • pp.281-286
    • /
    • 2010
  • Purpose: This research provided basic data for refraction by comparing the corrected diopter of trial lens and phoropter. Methods: We compared the corrected diopter of trial lens and phoropter, and analyzed statistical significance and relations of the spherical lens corrected diopter and cylindrical lens corrected diopter according to the types (trial lens and phoropter) of subjective refractive instruments. Also we analyzed statistical significance and relations between cylindrical lens corrected diopter at the astigmatism and the types (trial lens and phoropter) of subjective refractory instruments. Results: When we measured the corrected diopter of simple myopia, the mean value for corrected diopter was S-2.74D using the trial lens and S-2.65D using the phoropter. So the corrected diopter was 0.09D smaller when measured by phoropter. The degree of astigmatism was measured C-0.81D using the trial lens and C-0.77D using the phoropter which showed that the measured value was 0.04D smaller using the phoropter. On correlation analysis between the refractive instruments (trial lens and phoropter) and the corrected diopter, there was significant (p<0.01) strong correlation between refractory machine and corrected spherical diopter (r=0.996) and the correlation between refractory machine and corrected cylindrical diopter was r=0.986 and was also significant (p<0.01). Conclusions: The use of phoropter than trial lens was more desirable when performing refraction on high myopia (simple refractive error, high astigmatism), and when using trial lens, you should consider the vertex distance and the gap between overlapped lenses before prescription.

A Robust Method for Automatic Generation of Moire Reference Phase from Noisy Image (노이즈 영상으로부터 모아레 기준 위상의 강인 자동 생성 방법)

  • Kim, Kuk-Won;Kim, Min-Young
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.10 no.5
    • /
    • pp.909-916
    • /
    • 2009
  • This paper presents the automatic vision algorithm to generate and calibrate reference phase plane to improve the accuracy of 3D measuring machine of using phase shifting projection moire method, which is not traditional N-bucket method, but is based on direct image processing method to the pattern projection image. Generally, to acquire accurate reference phase plane, the calibration specimen with well treated surface is needed, and detailed calibration method should be performed. For the cost reduction of specimen manufacturing and the calibration time reduction, on the specimen, not specially designed, with general accuracy level, an efficient calibration procedure for the reference phase generation is proposed. The proposed vision algorithm is developed to extract the line center points of the projected line pattern from acquired images, derive the line feature information consisting of its slope and intercept by using sampled feature points, and finally generate the related reference phase between line pairs. Experimental results show that the proposed method make reference phase plane with a good accuracy under noisy environment and the proposed algorithm can reduce the total cost to make high accurate calibration specimen, also increase the accuracy of reference phase plane, and reduce the complex calibration procedure to move grid via N-bucket algorithm precisely.