• Title/Summary/Keyword: Learning Navigation

Search Result 358, Processing Time 0.026 seconds

Deep Learning-based Depth Map Estimation: A Review

  • Abdullah, Jan;Safran, Khan;Suyoung, Seo
    • Korean Journal of Remote Sensing
    • /
    • v.39 no.1
    • /
    • pp.1-21
    • /
    • 2023
  • In this technically advanced era, we are surrounded by smartphones, computers, and cameras, which help us to store visual information in 2D image planes. However, such images lack 3D spatial information about the scene, which is very useful for scientists, surveyors, engineers, and even robots. To tackle such problems, depth maps are generated for respective image planes. Depth maps or depth images are single image metric which carries the information in three-dimensional axes, i.e., xyz coordinates, where z is the object's distance from camera axes. For many applications, including augmented reality, object tracking, segmentation, scene reconstruction, distance measurement, autonomous navigation, and autonomous driving, depth estimation is a fundamental task. Much of the work has been done to calculate depth maps. We reviewed the status of depth map estimation using different techniques from several papers, study areas, and models applied over the last 20 years. We surveyed different depth-mapping techniques based on traditional ways and newly developed deep-learning methods. The primary purpose of this study is to present a detailed review of the state-of-the-art traditional depth mapping techniques and recent deep learning methodologies. This study encompasses the critical points of each method from different perspectives, like datasets, procedures performed, types of algorithms, loss functions, and well-known evaluation metrics. Similarly, this paper also discusses the subdomains in each method, like supervised, unsupervised, and semi-supervised methods. We also elaborate on the challenges of different methods. At the conclusion of this study, we discussed new ideas for future research and studies in depth map research.

A Study on the Prediction of Fuel Consumption of a Ship Using the Principal Component Analysis (주성분 분석기법을 이용한 선박의 연료소비 예측에 관한 연구)

  • Kim, Young-Rong;Kim, Gujong;Park, Jun-Bum
    • Journal of Navigation and Port Research
    • /
    • v.43 no.6
    • /
    • pp.335-343
    • /
    • 2019
  • As the regulations of ship exhaust gas have been strengthened recently, many measures are under consideration to reduce fuel consumption. Among them, research has been performed actively to develop a machine-learning model that predicts fuel consumption by using data collected from ships. However, many studies have not considered the methodology of the main parameter selection for the model or the processing of the collected data sufficiently, and the reckless use of data may cause problems such as multicollinearity between variables. In this study, we propose a method to predict the fuel consumption of the ship by using the principal component analysis to solve these problems. The principal component analysis was performed on the operational data of the 13K TEU container ship and the fuel consumption prediction model was implemented by regression analysis with extracted components. As the R-squared value of the model for the test data was 82.99%, this model would be expected to support the decision-making of operators in the voyage planning and contribute to the monitoring of energy-efficient operation of ships during voyages.

A Study on the Development of an Efficient Training Education System for Merchant Marine Officers (효율적인 해기사 실습교육제도의 개발에 관한연구)

  • 정연철;박진수;김성규
    • Journal of the Korean Institute of Navigation
    • /
    • v.14 no.4
    • /
    • pp.53-70
    • /
    • 1990
  • Much efforts have been made to improve the training education system for last decades. however, it still leaves much room form improving the system. The reason for this is that the have been many changes in given educational conditions, national and international, and that there existed the lack of training facilities on shore and the limits of capacity on the training ship. The existing program adopts a straight-through system of which the course has to be completed at same time, and also forces students to study the course, disregarding their aptitude for sea life. Consequently, the program resulted in frustrating the learning desire of some students and, as a consequence, in deteriorating the quality of the entire training education. This paper aims to develop an efficient training program including curriculla by the literature survey and the teaching and sea experiences on the training ship "HANBADA" and merchant ships, where the authors have been for many years. Compared with the existing one, the new training model suggested in this paper has some advantages as follows : First, the new model adopts multi-state system which consists of various short-term training courses according to each purpose. This system will be helpful for student to find their aptitude for sea life earlier and to understand classes of major subjection shore. Second, the model includes new curriculla which consist of core subjects (for example, navigation, marine operation, marine transportation, watch keeping and nautical English for deck cadets and internal and external combustion engine, auxiliary machinery, electric and electronics and engine maintenance for engine cadets), by incorporating existing 20 subjects in 5 subjects. These curriculla may contribute to embodying the characteristics of training education where the above mentioned subjects must be linked with each other. In order to implement this new training model efficiently and effectively, the following prerequisties must be prepared : $\circled1$ The contents of each subject included in the new model should be systematically developed. $\circled2$ The educational schedule should be adjusted according to the new model.new model.

  • PDF

Performance Analysis of Vision-based Positioning Assistance Algorithm (비전 기반 측위 보조 알고리즘의 성능 분석)

  • Park, Jong Soo;Lee, Yong;Kwon, Jay Hyoun
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.37 no.3
    • /
    • pp.101-108
    • /
    • 2019
  • Due to recent improvements in computer processing speed and image processing technology, researches are being actively carried out to combine information from camera with existing GNSS (Global Navigation Satellite System) and dead reckoning. In this study, developed a vision-based positioning assistant algorithm to estimate the distance to the object from stereo images. In addition, GNSS/on-board vehicle sensor/vision based positioning algorithm is developed by combining vision based positioning algorithm with existing positioning algorithm. For the performance analysis, the velocity calculated from the actual driving test was used for the navigation solution correction, simulation tests were performed to analyse the effects of velocity precision. As a result of analysis, it is confirmed that about 4% of position accuracy is improved when vision information is added compared to existing GNSS/on-board based positioning algorithm.

Estimating the Behavior Path of Seafarer Involved in Marine Accidents by Hidden Markov Model (은닉 마르코프 모델을 이용한 해양사고에 개입된 선원의 행동경로 추정)

  • Yim, Jeong-Bin
    • Journal of Navigation and Port Research
    • /
    • v.43 no.3
    • /
    • pp.160-165
    • /
    • 2019
  • The conduct of seafarer is major cause of marine accidents. This study models the behavior of the seafarer based on the Hidden Markov Model (HMM). Additionally, through the path analysis of the behavior estimated by the model, the kind of situations, procedures and errors that may have caused the marine accidents were interpreted. To successfully implement the model, the seafarer behaviors were observed by means of the summarized verdict reports issued by the Korean Maritime Safety Tribunal, and the observed results converted into behavior data suitable for HMM learning through the behavior classification framework based on the SRKBB (Skill-, Rule-, and Knowledge-Based Behavior). As a result of modeling the seafarer behaviors by the type of vessels, it was established that there was a difference between the models, and the possibility of identifying the preferred path of the seafarer behaviors. Through these results, it is expected that the model implementation technique proposed in this study can be applied to the prediction of the behavior of the seafarer as well as contribute to the prioritization of the behavior correction among seafarers, which is necessary for the prevention of marine accidents.

Fundamental Research for Video-Integrated Collision Prediction and Fall Detection System to Support Navigation Safety of Vessels

  • Kim, Bae-Sung;Woo, Yun-Tae;Yu, Yung-Ho;Hwang, Hun-Gyu
    • Journal of Ocean Engineering and Technology
    • /
    • v.35 no.1
    • /
    • pp.91-97
    • /
    • 2021
  • Marine accidents caused by ships have brought about economic and social losses as well as human casualties. Most of these accidents are caused by small and medium-sized ships and are due to their poor conditions and insufficient equipment compared with larger vessels. Measures are quickly needed to improve the conditions. This paper discusses a video-integrated collision prediction and fall detection system to support the safe navigation of small- and medium-sized ships. The system predicts the collision of ships and detects falls by crew members using the CCTV, displays the analyzed integrated information using automatic identification system (AIS) messages, and provides alerts for the risks identified. The design consists of an object recognition algorithm, interface module, integrated display module, collision prediction and fall detection module, and an alarm management module. For the basic research, we implemented a deep learning algorithm to recognize the ship and crew from images, and an interface module to manage messages from AIS. To verify the implemented algorithm, we conducted tests using 120 images. Object recognition performance is calculated as mAP by comparing the pre-defined object with the object recognized through the algorithms. As results, the object recognition performance of the ship and the crew were approximately 50.44 mAP and 46.76 mAP each. The interface module showed that messages from the installed AIS were accurately converted according to the international standard. Therefore, we implemented an object recognition algorithm and interface module in the designed collision prediction and fall detection system and validated their usability with testing.

Development for Estimation Improvement Model of Wind Velocity using Deep Neural Network (심층신경망을 활용한 풍속 예측 개선 모델 개발)

  • Ku, SungKwan;Hong, SeokMin;Kim, Ki-Young;Kwon, Jaeil
    • Journal of Advanced Navigation Technology
    • /
    • v.23 no.6
    • /
    • pp.597-604
    • /
    • 2019
  • Artificial neural networks are algorithms that simulate learning through interaction and experience in neurons in the brain and that are a method that can be used to produce accurate results through learning that reflects the characteristics of data. In this study, a model using deep neural network was presented to improve the predicted wind speed values in the meteorological dynamic model. The wind speed prediction improvement model using the deep neural network presented in the study constructed a model to recalibrate the predicted values of the meteorological dynamics model and carried out the verification and testing process and Separate data confirm that the accuracy of the predictions can be increased. In order to improve the prediction of wind speed, an in-depth neural network was established using the predicted values of general weather data such as time, temperature, air pressure, humidity, atmospheric conditions, and wind speed. Some of the data in the entire data were divided into data for checking the adequacy of the model, and the separate accuracy was checked rather than being used for model building and learning to confirm the suitability of the methods presented in the study.

The Fault Diagnosis Model of Ship Fuel System Equipment Reflecting Time Dependency in Conv1D Algorithm Based on the Convolution Network (합성곱 네트워크 기반의 Conv1D 알고리즘에서 시간 종속성을 반영한 선박 연료계통 장비의 고장 진단 모델)

  • Kim, Hyung-Jin;Kim, Kwang-Sik;Hwang, Se-Yun;Lee, Jang Hyun
    • Journal of Navigation and Port Research
    • /
    • v.46 no.4
    • /
    • pp.367-374
    • /
    • 2022
  • The purpose of this study was to propose a deep learning algorithm that applies to the fault diagnosis of fuel pumps and purifiers of autonomous ships. A deep learning algorithm reflecting the time dependence of the measured signal was configured, and the failure pattern was trained using the vibration signal, measured in the equipment's regular operation and failure state. Considering the sequential time-dependence of deterioration implied in the vibration signal, this study adopts Conv1D with sliding window computation for fault detection. The time dependence was also reflected, by transferring the measured signal from two-dimensional to three-dimensional. Additionally, the optimal values of the hyper-parameters of the Conv1D model were determined, using the grid search technique. Finally, the results show that the proposed data preprocessing method as well as the Conv1D model, can reflect the sequential dependency between the fault and its effect on the measured signal, and appropriately perform anomaly as well as failure detection, of the equipment chosen for application.

Generative Adversarial Network Model for Generating Yard Stowage Situation in Container Terminal (컨테이너 터미널의 야드 장치 상태 생성을 위한 생성적 적대 신경망 모형)

  • Jae-Young Shin;Yeong-Il Kim;Hyun-Jun Cho
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • 2022.06a
    • /
    • pp.383-384
    • /
    • 2022
  • Following the development of technologies such as digital twin, IoT, and AI after the 4th industrial revolution, decision-making problems are being solved based on high-dimensional data analysis. This has recently been applied to the port logistics sector, and a number of studies on big data analysis, deep learning predictions, and simulations have been conducted on container terminals to improve port productivity. These high-dimensional data analysis techniques generally require a large number of data. However, the global port environment has changed due to the COVID-19 pandemic in 2020. It is not appropriate to apply data before the COVID-19 outbreak to the current port environment, and the data after the outbreak was not sufficiently collected to apply it to data analysis such as deep learning. Therefore, this study intends to present a port data augmentation method for data analysis as one of these problem-solving methods. To this end, we generate the container stowage situation of the yard through a generative adversarial neural network model in terms of container terminal operation, and verify similarity through statistical distribution verification between real and augmented data.

  • PDF

Study on Improving the Navigational Safety Evaluation Methodology based on Autonomous Operation Technology (자율운항기술 기반의 선박 통항 안전성 평가 방법론 개선 연구)

  • Jun-Mo Park
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.30 no.1
    • /
    • pp.74-81
    • /
    • 2024
  • In the near future, autonomous ships, ships controlled by shore remote control centers, and ships operated by navigators will coexist and operate the sea together. In the advent of this situation, a method is required to evaluate the safety of the maritime traffic environment. Therefore, in this study, a plan to evaluate the safety of navigation through ship control simulation was proposed in a maritime environment, where ships directly controlled by navigators and autonomous ships coexisted, using autonomous operation technology. Own ship was designed to have autonomous operational functions by learning the MMG model based on the six-DOF motion with the PPO algorithm, an in-depth reinforcement learning technique. The target ship constructed maritime traffic modeling data based on the maritime traffic data of the sea area to be evaluated and designed autonomous operational functions to be implemented in a simulation space. A numerical model was established by collecting date on tide, wave, current, and wind from the maritime meteorological database. A maritime meteorology model was created based on this and designed to reproduce maritime meteorology on the simulator. Finally, the safety evaluation proposed a system that enabled the risk of collision through vessel traffic flow simulation in ship control simulation while maintaining the existing evaluation method.