• Journal of the Korea Convergence Society
• /
• v.11 no.11
• /
• pp.9-17
• /
• 2020

In this paper, we proposed an SNS review analysis method based on deep learning for user tendency. The existing SNS review analysis method has a problem that does not reflect a variety of opinions on various interests because most are processed based on the highest weight. To solve this problem, the proposed method is to extract the user's personal tendency from the SNS review for food. It performs classification using the YOLOv3 model, and after performing a sentiment analysis through the BiLSTM model, it extracts various personal tendencies through a set algorithm. Experiments showed that the performance of Top-1 accuracy 88.61% and Top-5 90.13% for the YOLOv3 model, and 90.99% accuracy for the BiLSTM model. Also, it was shown that diversity of the individual tendencies in the SNS review classification through the heat map. In the future, it is expected to extract personal tendencies from various fields and be used for customized service or marketing.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2022.01a
• /
• pp.97-98
• /
• 2022

코로나바이러스-19 팬데믹 이후 매일 수만 명의 환자가 발생하고 있다. 보건당국은 사람들의 생활 안전을 보호하기 위해 공항, 정류장 등 공공장소에서는 반드시 마스크를 착용하라고 지시하고 있다. 마스크를 착용하는 목적은 감염으로부터 신체를 보호하고 바이러스 전파와 확산을 막기 위한 것이다. 공공장소에서는 많은 인원에 대한 일괄적인 마스크 착용 검사를 하기 어렵고, 육안으로 확인하는 마스크 착용 검사 방법은 인파가 몰리는 장소에서 검사 효율이 떨어지며 누락되는 경우도 많이 발생한다. 본 연구에서는 입력 이미지에 존재하는 얼굴 영역을 YOLOv4와 YOLOv5 모델을 통해 예측하여 마스크의 착용 여부를 판단하되, 앙상블 기법을 적용하여 보다 효과적인 BB(Bounding Box) 추출 및 마스크 착용 탐지 기법을 적용한다. 따라서 공공장소의 마스크 착용실태를 효과적으로 모니터링 할 수 있는 방법을 제안한다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2022.10a
• /
• pp.50-53
• /
• 2022

In order to detect an object in yolv5, a process of annotating location information on an existing image is required when learning an image. The most representative method is to draw a bounding box on an image to store location information as meta information. However, if the boundary of the object is ambiguous, it will be difficult to make a bounding box. A representative example would be to classify parts that are not fire and parts that are fire. Therefore, in this paper, images of 100 samples judged to have caught fire were learned by varying the number of boxes. The results showed better fire detection performance in the model where the bounding box was trained by annotating it with three boxes by segmenting it slightly more than annotating it with one box by holding the edge as large as possible during annotating it with one box.

• The Journal of the Convergence on Culture Technology
• /
• v.8 no.3
• /
• pp.571-580
• /
• 2022

Marine deposited waste is a major cause of problems such as a lot of damage and an increase in the estimated amount of garbage due to abandoned fishing grounds caused by ghost fishing. In this paper, we implement a real-time marine deposited waste detection artificial intelligence system to understand the actual conditions of waste fishing gear usage, distribution, loss, and recovery, and study methods for performance improvement. The system was implemented using the yolov5 model, which is an excellent performance model for real-time object detection, and the 'data screening process' and 'class segmentation' method of learning data were applied as performance improvement methods. In conclusion, the object detection results of datasets that do screen unnecessary data or do not subdivide similar items according to characteristics and uses are better than the object recognition results of unscreened datasets and datasets in which classes are subdivided.

• The Journal of The Korea Institute of Intelligent Transport Systems
• /
• v.21 no.3
• /
• pp.83-95
• /
• 2022

This paper proposes a system that performs object detection and distance estimation for application to autonomous vehicles. Object detection is performed by a network that adjusts the split grid to the input image ratio using the characteristics of the recently actively used deep learning model YOLOv4, and is trained to a custom dataset. The distance to the detected object is estimated using a bounding box and homography. As a result of the experiment, the proposed method improved in overall detection performance and processing speed close to real-time. Compared to the existing YOLOv4, the total mAP of the proposed method increased by 4.03%. The accuracy of object recognition such as pedestrians, vehicles, construction sites, and PE drums, which frequently occur when driving to the city center, has been improved. The processing speed is approximately 55 FPS. The average of the distance estimation error was 5.25m in the X coordinate and 0.97m in the Y coordinate.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2021.05a
• /
• pp.422-425
• /
• 2021

본 논문에서는 최근 다양한 분야에서 많이 활용되고 있는 YOLO와 EAST 신경망을 이미지 속 문자열 탐지문제에 적용해보고 이들의 성능을 비교분석 해 보았다. YOLO 신경망은 v3 이전 모델까지는 이미지 속 문자영역 탐지에 낮은 성능을 보인다고 알려졌으나, 최근 출시된 YOLOv4와 YOLOv5의 경우 다양한 형태의 이미지 속에 있는 한글과 영문 문자열 탐지에 뛰어난 성능을 보여줌을 확인하고 향후 문자 인식 분야에서 많이 활용될 것으로 기대된다.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.26 no.3
• /
• pp.355-366
• /
• 2022

This paper proposes a microcode-based neural network accelerator controller for artificial intelligence accelerators that can be reconstructed using a programmable architecture and provide the advantages of low-power and ultra-small chip size. In order for the target accelerator to support various neural network models, the neural network model can be converted into microcode through microcode compiler and mounted on accelerator to control the operators of the accelerator such as datapath and memory access. While the proposed controller and accelerator can run various CNN models, in this paper, we tested them using the YOLOv2-Tiny CNN model. Using a system clock of 200 MHz, the Controller and accelerator achieved an inference time of 137.9 ms/image for VOC 2012 dataset to detect object, 99.5ms/image for mask detection dataset to detect wearing mask. When implementing an accelerator equipped with the proposed controller as a silicon chip, the gate count is 618,388, which corresponds to 65.5% reduction in chip area compared with an accelerator employing a CPU-based controller (RISC-V).

• The Journal of the Convergence on Culture Technology
• /
• v.8 no.5
• /
• pp.735-740
• /
• 2022

The construction is the industry with the highest fatalities, and the fatalities has not decreased despite various institutional improvements. Accordingly, real-time safety management by applying artificial intelligence (AI) to CCTV images is emerging. Although some research on worker detection by applying AI to images of construction sites is being conducted, there are limitations in performance expression due to problems such as complex background due to the nature of the construction industry. In this study, the YOLO model and the OpenPose model were fused to improve the performance of worker detection and posture estimation to improve the detection performance of workers in various complex conditions. This is expected to be highly useful in terms of unsafe behavior and health management of workers in the future.

• Journal of Biomedical Engineering Research
• /
• v.43 no.3
• /
• pp.131-135
• /
• 2022

Due to COVID-19, Correct method of wearing mask is important to prevent COVID-19 and the other respiratory tract infections. And the deep learning technology in the image processing has been developed. The purpose of this study is to create the type of mask wearing dataset for deep learning models and select the deep learning model to detect the wearing mask correctly. The Image dataset is the 2,296 images acquired using a web crawler. Deep learning classification models provided by tensorflow are used to validate the dataset. And Object detection deep learning model YOLOs are used to select the detection deep learning model to detect the wearing mask correctly. In this process, this paper proposes to validate the type of mask wearing datasets and YOLOv5 is the effective model to detect the type of mask wearing. The experimental results show that reliable dataset is acquired and the YOLOv5 model effectively recognize type of mask wearing.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.17 no.6
• /
• pp.1249-1258
• /
• 2022

Marine debris is defined as a substance that is intentionally or inadvertently left on the shore or is introduced or discharged into the ocean, which has or is likely to have a harmful effect on the marine environments. In this study, the detection of marine debris and the analysis of the amount of change on marine debris were performed using the object detection method for an efficient method of identifying the quantity of marine debris and analyzing the amount of change. The study area is Yuho Mongdol Beach in the northeastern part of Geoje Island, and the amount of change was analyzed through images collected at 15-minute intervals for 32 days from September 12 to October 14, 2022. Marine debris detection using YOLOv5x, a one-stage object detection model, derived the performance of plastic bottles mAP 0.869 and styrofoam buoys mAP 0.862. As a result, marine debris showed a large decrease at 8-day intervals, and it was found that the quantity of Styrofoam buoys was about three times larger and the range of change was also larger.