• Smart Structures and Systems
• /
• 제23권4호
• /
• pp.359-371
• /
• 2019

As part of a structural health monitoring system, the relative geometric relationship between a ship and bridge has been recognized as important for bridge authorities and ship owners to avoid ship-bridge collision. This study proposes a novel computer vision method for the real-time geometric parameter identification of moving ships based on a single shot multibox detector (SSD) by using transfer learning techniques and monocular vision. The identification framework consists of ship detection (coarse scale) and geometric parameter calculation (fine scale) modules. For the ship detection, the SSD, which is a deep learning algorithm, was employed and fine-tuned by ship image samples downloaded from the Internet to obtain the rectangle regions of interest in the coarse scale. Subsequently, for the geometric parameter calculation, an accurate ship contour is created using morphological operations within the saturation channel in hue, saturation, and value color space. Furthermore, a local coordinate system was constructed using projective geometry transformation to calculate the geometric parameters of ships, such as width, length, height, localization, and velocity. The application of the proposed method to in situ video images, obtained from cameras set on the girder of the Wuhan Yangtze River Bridge above the shipping channel, confirmed the efficiency, accuracy, and effectiveness of the proposed method.

• Journal of Information Processing Systems
• /
• 제19권6호
• /
• pp.745-755
• /
• 2023

The wire rope is an indispensable production machinery in coal mines. It is the main force-bearing equipment of the underground traction system. Accurate detection of wire rope defects and positions exerts an exceedingly crucial role in safe production. The existing defect detection solutions exhibit some deficiencies pertaining to the flexibility, accuracy and real-time performance of wire rope defect detection. To solve the aforementioned problems, this study utilizes the camera to sample the wire rope before the well entry, and proposes an object based on YOLOv5. The surface small-defect detection model realizes the accurate detection of small defects outside the wire rope. The transfer learning method is also introduced to enhance the model accuracy of small sample training. Herein, the enhanced YOLOv5 algorithm effectively enhances the accuracy of target detection and solves the defect detection problem of wire rope utilized in mine, and somewhat avoids accidents occasioned by wire rope damage. After a large number of experiments, it is revealed that in the task of wire rope defect detection, the average correctness rate and the average accuracy rate of the model are significantly enhanced with those before the modification, and that the detection speed can be maintained at a real-time level.

• International Journal of Computer Science & Network Security
• /
• 제23권9호
• /
• pp.186-191
• /
• 2023

Neural Networks are widely used for huge variety of tasks solution. Machine Learning methods are used also for signal and time series analysis, including electrocardiograms. Contemporary wearable devices, both medical and non-medical type like smart watch, allow to gather the data in real time uninterruptedly. This allows us to transfer these data for analysis or make an analysis on the device, and thus provide preliminary diagnosis, or at least fix some serious deviations. Different methods are being used for this kind of analysis, ranging from medical-oriented using distinctive features of the signal to machine learning and deep learning approaches. Here we will demonstrate a neural network-based approach to this task by building an ensemble of 1D CNN classifiers and a final classifier of selection using logistic regression, random forest or support vector machine, and make the conclusions of the comparison with other approaches.

• 방송공학회논문지
• /
• 제27권2호
• /
• pp.228-239
• /
• 2022

본 논문에서는 카셰어링 서비스(car sharing service)에서 차량 상태 무인 검수를 위한 흠집 탐지 딥 러닝 모델을 제안한다. 기존의 차량 상태 검수 시스템은 대여 전, 후 사진에서 각각 흠집을 탐지하는 딥 러닝 모델과 탐지된 두 흠집 영상을 수작업으로 대조하여 새롭게 발생한 흠집을 탐색하는 두 단계로 구성되어 있다. 따라서 수동작업이 필요한 두 단계 모델을 한 단계로 줄이는 무인 흠집 탐지 모델을 위성영상에서 변화를 탐지하는 딥 러닝 모델에 전이 학습을 적용하여 구축한다. 그리고 광택 처리된 자동차 표면의 휘도가 비등방성이고 비전문가인 이용자가 일반 카메라로 촬영하기 때문에 정반사(specular reflection)가 흠집 탐지 성능에 크게 영향을 미친다. 따라서 정반사광으로 발생하는 오탐지를 감소시키기 위하여 정반사광 성분을 제거하는 전처리 과정을 적용한다. 이용자가 휴대폰 카메라로 촬영한 데이터에 대해 제안하는 시스템은 주관적인 측면과 정밀도(precision), 재현율(recall), F1, Kappa 척도면에서 각각 67.90%, 74.56%, 71.08%, 70.18%로서 높은 일치도를 보인다.

• 스마트미디어저널
• /
• 제9권3호
• /
• pp.41-45
• /
• 2020

최근 4차 산업혁명 관련 IT기술 중에서 머신러닝과 딥러닝으로 대표되는 인공지능과 사물인터넷은 다양한 연구를 통해 여러 분야에서 우리 실생활에 적용되고 있다. 본 논문에서는 사물인터넷과 객체인식 기술을 활용한 인공지능을 적용하여 의류를 분류하고자 한다. 이를 위해 이미지 데이터셋은 웹캠과 라즈베리파이를 이용하여 의류를 촬영하고, 촬영된 이미지 데이터를 전이학습된 컨벌루션 뉴럴 네트워크 인공지능망인 구글넷에 적용하였다. 의류 이미지 데이터셋은 온전한 이미지 900개와 손상이 있는 이미지 900 그리고 총 1800개를 가지고 상하의 2개의 카테고리로 분류하였다. 분류 측정 결과는 온전한 의류 이미지에서는 약 97.78%의 정확도를 보였다. 결론적으로 이러한 측정결과와 향후 더 많은 이미지 데이터의 보완을 통해 사물인터넷 기반 플랫폼상에서 인공지능망을 활용한 여타 사물들의 객체 인식에 대한 적용 가능성을 확인하였다.

• Journal of Platform Technology
• /
• 제9권3호
• /
• pp.44-51
• /
• 2021

일반적으로 골든 타임은 인명 구조나 화재 진압 등의 사고 초기대응에 있어서 가장 중요한 시간을 의미한다. 골든 타임은 재난 상황별로 다르지만 화재나 구급에 있어서는 5분을 목표로 하고 있다. 하지만 실제 현장의 경우 구급차의 평균 출동 시간은 9분, 평균 이송 시간은 17.6분으로 골든 타임과 비교하여 상당히 큰 지연시간이 존재한다. 이러한 지연시간에는 다양한 원인이 존재하지만 가장 큰 원인은 교통체증이다. 해당 문제를 해결하기 위해 정부에서는 긴급 자동차 양보의무법 제정, 사고 발생률이 가장 높은 장소에 구급차 우선 배치 등을 골든 타임을 확보하고 있지만, 교통량이 빠른 속도로 증가하는 출퇴근 상황에서는 해결책이 되지 못하고 있다. 따라서 본 논문에서는 신호등에 사운드 센서를 설치하여 수집된 소리 데이터를 활용한 딥러닝 기반 긴급차량 우선 신호 시스템을 제안하고 긴급차량의 주파수 대역을 추출하고 거리에 따라 다르게 나타나는 진폭 신호를 분류하는 실험을 진행하였다.

• Journal of Platform Technology
• /
• 제11권4호
• /
• pp.3-12
• /
• 2023

포스트-코로나 시대에는 방역 조치의 중요성이 크게 강조되고 있으며, 이에 맞춰 딥러닝을 이용한 마스크 착용 상태 검출 및 다른 전염병 예방에 관련된 연구가 진행되고 있다. 그러나 질병 확산 방지를 위한 문화시설 관람객 탐지 및 추적 연구도 마찬가지로 중요하므로 이에 대한 연구가 진행되어야 한다. 본 논문에서는 사전 수집된 데이터 셋을 이용하여 컨볼루션 신경망 기반 객체 탐지 모델을 전이 학습시키고, 학습된 탐지 모델의 가중치를 다중 객체 추적 모델에 적용하여 방문객을 모니터링 한다. 방문객 탐지 모델은 Precision 96.3%, Recall 85.2% F1-Score 90.4%의 결과를 보여주었다. 추적 모델의 정량적 결과로 MOTA 65.6%, IDF1 68.3%. HOTA 57.2%의 결과를 보여주었으며, 본 논문의 모델과 다른 다중 객체 추적 모델 간의 정성적 비교에서 우수한 결과를 보여주었다. 본 논문의 연구는 포스트-코로나 시대의 문화시설 내 방역 시스템에 적용될 수 있을 것이다.

• 한국수자원학회:학술대회논문집
• /
• 한국수자원학회 2022년도 학술발표회
• /
• pp.145-145
• /
• 2022

Availability of abundant water resources data in developing countries is a great concern that has hindered the adoption of deep learning techniques (DL) for disaster prevention and mitigation. On the contrary, over the last two decades, a sizeable amount of DL publication in disaster management emanated from developed countries with efficient data management systems. To understand the current state of DL adoption for solving water-related disaster management in developing countries, an extensive bibliometric review coupled with a theory-based analysis of related research documents is conducted from 2003 - 2022 using Web of Science, Scopus, VOSviewer software and PRISMA model. Results show that four major disasters - pluvial / fluvial flooding, land subsidence, drought and snow avalanche are the most prevalent. Also, recurrent flash floods and landslides caused by irregular rainfall pattern, abundant freshwater and mountainous terrains made India the only developing country with an impressive DL adoption rate of 50% publication count, thereby setting the pace for other developing countries. Further analysis indicates that economically-disadvantaged countries will experience a delay in DL implementation based on their Human Development Index (HDI) because DL implementation is capital-intensive. COVID-19 among other factors is identified as a driver of DL. Although, the Long Short Term Model (LSTM) model is the most frequently used, but optimal model performance is not limited to a certain model. Each DL model performs based on defined modelling objectives. Furthermore, effect of input data size shows no clear relationship with model performance while final model deployment in solving disaster problems in real-life scenarios is lacking. Therefore, data augmentation and transfer learning are recommended to solve data management problems. Intensive research, training, innovation, deployment using cheap web-based servers, APIs and nature-based solutions are encouraged to enhance disaster preparedness.

• 한국작물학회:학술대회논문집
• /
• 한국작물학회 2022년도 추계학술대회
• /
• pp.80-80
• /
• 2022

Estimation of heading date of paddy rice is laborious and time consuming. Therefore, automatic estimation of heading date of paddy rice is highly essential. In this experiment, deep learning classification models were used to classify two difference categories of rice (vegetative and reproductive stage) based on the panicle initiation of paddy field. Specifically, the dataset includes 444 slanted view images belonging to two categories and was then expanded to include 1,497 images via IMGAUG data augmentation technique. We adopt two transfer learning strategies: (First, used transferring model weights already trained on ImageNet to six classification network models: VGGNet, ResNet, DenseNet, InceptionV3, Xception and MobileNet, Second, fine-tuned some layers of the network according to our dataset). After training the CNN model, we used several evaluation metrics commonly used for classification tasks, including Accuracy, Precision, Recall, and F1-score. In addition, GradCAM was used to generate visual explanations for each image patch. Experimental results showed that the InceptionV3 is the best performing model in terms of the accuracy, average recall, precision, and F1-score. The fine-tuned InceptionV3 model achieved an overall classification accuracy of 0.95 with a high F1-score of 0.95. Our CNN model also represented the change of rice heading date under different date of transplanting. This study demonstrated that image based deep learning model can reliably be used as an automatic monitoring system to detect the heading date of rice crops using CCTV camera.

• Computers and Concrete
• /
• 제33권4호
• /
• pp.341-348
• /
• 2024

Ultra-high-performance concrete (UHPC) has received remarkable attentions in civil infrastructure due to its unique mechanical characteristics and durability. UHPC gains increasingly dominant in essential structural elements, while its unique properties pose challenges for traditional inspection methods, as damage may not always manifest visibly on the surface. As such, the need for robust inspection techniques for detecting cracks in UHPC members has become imperative as traditional methods often fall short in providing comprehensive and timely evaluations. In the era of artificial intelligence, computer vision has gained considerable interest as a powerful tool to enhance infrastructure condition assessment with image and video data collected from sensors, cameras, and unmanned aerial vehicles. This paper presents a computer vision-based approach employing deep learning to detect cracks in UHPC beams, with the aim of addressing the inherent limitations of traditional inspection methods. This work leverages computer vision to discern intricate patterns and anomalies. Particularly, a convolutional neural network architecture employing transfer learning is adopted to identify the presence of cracks in the beams. The proposed approach is evaluated with image data collected from full-scale experiments conducted on UHPC beams subjected to flexural and shear loadings. The results of this study indicate the applicability of computer vision and deep learning as intelligent methods to detect major and minor cracks and recognize various damage mechanisms in UHPC members with better efficiency compared to conventional monitoring methods. Findings from this work pave the way for the development of autonomous infrastructure health monitoring and condition assessment, ensuring early detection in response to evolving structural challenges. By leveraging computer vision, this paper contributes to usher in a new era of effectiveness in autonomous crack detection, enhancing the resilience and sustainability of UHPC civil infrastructure.