• Journal of the Korean Society of Marine Environment & Safety
• /
• v.28 no.4
• /
• pp.499-506
• /
• 2022

For autonomous ships to be commercialized and be able to navigate in coastal water, they must be able to detect maritime obstacles. One of the most common obstacles seen in coastal area are the farm buoys. In this study, a maritime object detection system was developed that detects buoys using the YOLO algorithm and visualizes the distance and bearing between buoys and the ship through geometric interpretation of camera images. After training the maritime object detection model with 1,224 pictures of buoys, the precision of the model was 89.0%, the recall was 95.0%, and the F1-score was 92.0%. Camera calibration had been conducted to calculate the distance and bearing of an object away from the camera using the obtained image coordinates and Experiment A and B were designed to verify the performance of the maritime object detection system. As a result of verifying the performance of the maritime object detection system, it can be seen that the maritime object detection system is superior to radar in its short-distance detection capability, so that it can be used as a navigational aid along with the radar.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2014.01a
• /
• pp.251-252
• /
• 2014

본 논문에서는 차영상 기법을 이용하여 이동하는 객체를 탐지하고 계수하는 시스템을 제안한다. 제안된 시스템은 카메라를 통해 들어온 입력 영상과 배경의 차이를 통해 객체를 탐지하고 객체의 움직임을 분석하여 이동 객체를 계수한다. 실험 결과를 통해 물체의 이동 객체의 탐지 및 계수가 이루어짐을 확인 할 수 있다.

• Journal of the Society of Naval Architects of Korea
• /
• v.59 no.5
• /
• pp.330-337
• /
• 2022

Research on object detection algorithms using 2D data has already progressed to the level of commercialization and is being applied to various manufacturing industries. Object detection technology using 2D data has an effective advantage, there are technical limitations to accurate data generation and analysis. Since 2D data is two-axis data without a sense of depth, ambiguity arises when approached from a practical point of view. Advanced countries such as the United States are leading 3D data collection and research using 3D laser scanners. Existing processing and detection algorithms such as ICP and RANSAC show high accuracy, but are used as a processing speed problem in the processing of large-scale point cloud data. In this study, PointNet a representative technique for detecting objects using widely used 3D point cloud data is analyzed and described. And RandLA-Net, which overcomes the limitations of PointNet's performance and object prediction accuracy, is described a review of detection technology using point cloud data was conducted.

• Ocean Systems Engineering
• /
• v.10 no.4
• /
• pp.415-434
• /
• 2020

Detecting objects is important for the safe operation of ships, and enables collision avoidance, risk detection, and autonomous sailing. This study proposes a ship detection method from images and videos taken at sea using one of the state-of-the-art deep neural network-based object detection algorithms. A deep learning model is trained using a public maritime dataset, and results show it can detect all types of floating objects and classify them into ten specific classes that include a ship, speedboat, and buoy. The proposed deep learning model is compared to a universal trained model that detects and classifies objects into general classes, such as a person, dog, car, and boat, and results show that the proposed model outperforms the other in the detection of maritime objects. Different deep neural network structures are then compared to obtain the best detection performance. The proposed model also shows a real-time detection speed of approximately 30 frames per second. Hence, it is expected that the proposed model can be used to detect maritime objects and reduce risks while at sea.

• Journal of the Society of Naval Architects of Korea
• /
• v.58 no.5
• /
• pp.303-313
• /
• 2021

Recently, quality control of the Liquefied Natural Gas Carrier (LNGC) cargo hold and block-erection interference areas using 3D scanners have been performed, focusing on large shipyards and the international association of classification societies. In this study, as a part of the research on LNGC cargo hold quality management advancement, a study on deep-learning-based scaffolding system 3D point cloud object detection and post-processing were conducted using a LNGC cargo hold 3D point cloud. The scaffolding system point cloud object detection is based on the PointNet deep learning architecture that detects objects using point clouds, achieving 70% prediction accuracy. In addition, the possibility of improving the accuracy of object detection through parameter adjustment is confirmed, and the standard of Intersection over Union (IoU), an index for determining whether the object is the same, is achieved. To avoid the manual post-processing work, the object detection architecture allows automatic task performance and can achieve stable prediction accuracy through supplementation and improvement of learning data. In the future, an improved study will be conducted on not only the flat surface of the LNGC cargo hold but also complex systems such as curved surfaces, and the results are expected to be applicable in process progress automation rate monitoring and ship quality control.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2015.01a
• /
• pp.137-138
• /
• 2015

본 논문에서는 연속된 영상에서 다중해상도 에지정보의 차이를 이용하여 이동하는 물체를 탐지하고 계수하는 시스템을 제안한다. 연속적으로 입력되는 영상에 대하여 이산 웨이블릿 연산을 수행하여 다중해상도 에지를 추출하고, 인접한 프레임 사이의 다중해상도 에지 차이를 이용하여 이동물체를 추출한다. 가중치가 부여된 유클리디언 거리를 이용하여 물체를 추적한 다음, 칼만필터를 이용하여 물체 궤적의 위치 정보를 보정한다. 마지막으로, 관심영역에 대한 물체 궤적의 상대적인 위치를 고려하여 이동물체를 계수한다.

• Journal of the Korean Society of Marine Environment & Safety
• /
• v.29 no.2
• /
• pp.139-146
• /
• 2023

Maritime object detection systems, which detects small maritime obstacles such as fish farm buoys and visualizes distance and direction, is equipped with a 3-axis gimbal to compensate for errors caused by hull motion, but there is a limit to distance error corrections necessitated by the vertical movement of the camera and the maritime object due to wave motions. Therefore, in this study, the distance error of maritime object detection systems caused by the movement of the water surface according to the external environment is analyzed and corrected using average filter and moving average filter. Random numbers following a Gaussian standard normal distribution were added to or subtracted from the image coordinates to reproduce the rise or fall of the buoy under irregular waves. The distance calculated according to the change of image coordinates, the predicted distance through the average filter and the moving average filter, and the actual distance measured by laser distance meter were compared. In phases 1 and 2, the error rate increased to a maximum of 98.5% due to the changes of image coordinates due to irregular waves, but the error rate decreased to 16.3% with the moving average filter. This error correction capability was better than with the average filter, but there was a limit due to failure to respond to the distance change. Therefore, it is considered that use of the moving average filter to correct the distance error of the maritime object detection system will enhance responses to the real-time distance change and greatly improve the error rate.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.16 no.2
• /
• pp.692-712
• /
• 2022

Buoys used for Aid to Navigation systems are widely used to guide the sea paths and are powered by batteries, requiring continuous battery replacement. However, since human labor is required to replace the batteries, humans can be exposed to dangerous situation, including even collision with shipping vessels. In addition, Maritime sensors are installed on the route signs, so that these are often damaged by collisions with small and medium-sized ships, resulting in significant financial loss. In order to prevent these accidents, maritime object detection technology is essential to alert ships approaching buoys. Existing studies apply a number of filters to eliminate noise and to detect objects within the sea image. For this process, most studies directly access the pixels and process the images. However, this approach typically takes a long time to process because of its complexity and the requirements of significant amounts of computational power. In an emergent situation, it is important to alarm the vessel's rapid approach to buoys in real time to avoid collisions between vessels and route signs, therefore minimizing computation and speeding up processes are critical operations. Therefore, we propose Fast Connected Component Labeling (FCCL) which can reduce computation to minimize the processing time of filter applications, while maintaining the detection performance of existing methods. The results show that the detection performance of the FCCL is close to 30 FPS - approximately 2-5 times faster, when compared to the existing methods - while the average throughput is the same as existing methods.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.17 no.2
• /
• pp.77-83
• /
• 2022

In this paper, the two-stage object detection approach is proposed to implement a deep learning-based label inspection system on edge computing environments. Since the label printed on the products during the production process contains important information related to the product, it is significantly to check the label information is correct. The proposed system uses the lightweight deep learning model that able to employ in the low-performance edge computing devices, and the two-stage object detection approach is applied to compensate for the low accuracy relatively. The proposed Two-Stage object detection approach consists of two object detection networks, Label Area Detection Network and Character Detection Network. Label Area Detection Network finds the label area in the product image, and Character Detection Network detects the words in the label area. Using this approach, we can detect characters precise even with a lightweight deep learning models. The SF-YOLO model applied in the proposed system is the YOLO-based lightweight object detection network designed for edge computing devices. This model showed up to 2 times faster processing time and a considerable improvement in accuracy, compared to other YOLO-based lightweight models such as YOLOv3-tiny and YOLOv4-tiny. Also since the amount of computation is low, it can be easily applied in edge computing environments.

• Journal of the Korean Society of Marine Environment & Safety
• /
• v.28 no.7
• /
• pp.1120-1128
• /
• 2022

In the event of a marine accident, the longer the exposure time to the sea increases, the faster the chance of survival decreases. However, because the search area of the sea is extremely wide compared to that of land, marine object detection technology based on the sensor mounted on a satellite or an aircraft must be applied rather than ship for an efficient search. The purpose of this study was to rapidly detect an object in the ocean using a hyperspectral image sensor mounted on an aircraft. The image captured by this sensor has a spatial resolution of 8,241 × 1,024, and is a large-capacity data comprising 127 spectra and a resolution of 0.7 m per pixel. In this study, a marine object detection model was developed that combines a seawater identification algorithm using DBSCAN and a density-based land removal algorithm to rapidly analyze large data. When the developed detection model was applied to the hyperspectral image, the performance of analyzing a sea area of about 5 km² within 100 s was confirmed. In addition, to evaluate the detection accuracy of the developed model, hyperspectral images of the Mokpo, Gunsan, and Yeosu regions were taken using an aircraft. As a result, ships in the experimental image could be detected with an accuracy of 90 %. The technology developed in this study is expected to be utilized as important information to support the search and rescue activities of small ships and human life.