• Title/Summary/Keyword: prediction of anomaly

Search Result 108, Processing Time 0.021 seconds

Technical Trends of GNSS Clock Anomaly Detection and Resolution (항법위성시계 노후에 따른 이상 현상 감지 및 극복 기술현황)

  • Heo, Youn-Jeong;Cho, Jeong-Ho;Heo, Moon-Beom;Sim, Eun-Sup
    • Current Industrial and Technological Trends in Aerospace
    • /
    • v.8 no.1
    • /
    • pp.77-85
    • /
    • 2010
  • The current GPS constellation consists of 32 Block IIA/IIR/IIR-M satellites including 12 Block IIA satellites on service over 15 years. The satellites in poor space conditions may suffer from anomalies, especially influenced by aging atomic clocks which are of importance positioning and timing. Recently, the IGS Ultra-rapid predicted products have not shown acceptably high quality prediction performance because the Block IIA cesium clocks may be easily affected by various factors such as temperature and environment. The anomalies of aging clocks involve lower performance of positioning in the GPS applications. We, thus, describe satellite clock behaviors and anomalies induced by aging clocks and their detection technologies to avoid such anomalies.

  • PDF

Course Variance Clustering for Traffic Route Waypoint Extraction

  • Onyango Shem Otoi
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • 2022.06a
    • /
    • pp.277-279
    • /
    • 2022
  • Rapid Development and adoption of AIS as a survailance tool has resulted in widespread application of data analysis technology, in addition to AIS ship trajectory clustering. AIS data-based clustering has become an increasingly popular method for marine traffic pattern recognition, ship route prediction and anomaly detection in recent year. In this paper we propose a route waypoint extraction by clustering ships CoG variance trajectory using Density-Based Spatial Clustering of Application with Noise (DBSCAN) algorithm in both port approach channel and coastal waters. The algorithm discovers route waypoint effectively. The result of the study could be used in traffic route extraction, and more-so develop a maritime anomaly detection tool.

  • PDF

Reinforcement Data Mining Method for Anomaly&Misuse Detection (침입탐지시스템의 정확도 향상을 위한 개선된 데이터마이닝 방법론)

  • Choi, Yun Jeong
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.6 no.1
    • /
    • pp.1-12
    • /
    • 2010
  • Recently, large amount of information in IDS(Intrusion Detection System) can be un manageable and also be mixed with false prediction error. In this paper, we propose a data mining methodology for IDS, which contains uncertainty based on training process and post-processing analysis additionally. Our system is trained to classify the existing attack for misuse detection, to detect the new attack pattern for anomaly detection, and to define border patter between attack and normal pattern. In experimental results show that our approach improve the performance against existing attacks and new attacks,from 0.62 to 0.84 about 35%.

An Integrated Artificial Neural Network-based Precipitation Revision Model

  • Li, Tao;Xu, Wenduo;Wang, Li Na;Li, Ningpeng;Ren, Yongjun;Xia, Jinyue
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.5
    • /
    • pp.1690-1707
    • /
    • 2021
  • Precipitation prediction during flood season has been a key task of climate prediction for a long time. This type of prediction is linked with the national economy and people's livelihood, and is also one of the difficult problems in climatology. At present, there are some precipitation forecast models for the flood season, but there are also some deviations from these models, which makes it difficult to forecast accurately. In this paper, based on the measured precipitation data from the flood season from 1993 to 2019 and the precipitation return data of CWRF, ANN cycle modeling and a weighted integration method is used to correct the CWRF used in today's operational systems. The MAE and TCC of the precipitation forecast in the flood season are used to check the prediction performance of the proposed algorithm model. The results demonstrate a good correction effect for the proposed algorithm. In particular, the MAE error of the new algorithm is reduced by about 50%, while the time correlation TCC is improved by about 40%. Therefore, both the generalization of the correction results and the prediction performance are improved.

The Development of Ensemble Statistical Prediction Model for Changma Precipitation (장마 강수를 위한 앙상블 통계 예측 모델 개발)

  • Kim, Jin-Yong;Seo, Kyong-Hwan
    • Atmosphere
    • /
    • v.24 no.4
    • /
    • pp.533-540
    • /
    • 2014
  • Statistical forecast models for the prediction of the summertime Changma precipitation have been developed in this study. As effective predictors for the Changma precipitation, the springtime sea surface temperature (SST) anomalies over the North Atlantic (NA1), the North Pacific (NPC) and the tropical Pacific Ocean (CNINO) has been suggested in Lee and Seo (2013). To further improve the performance of the statistical prediction scheme, we select other potential predictors and construct 2 additional statistical models. The selected predictors are the Northern Indian Ocean (NIO) and the Bering Sea (BS) SST anomalies, and the spring Eurasian snow cover anomaly (EUSC). Then, using the total three statistical prediction models, a simple ensemble-mean prediction is performed. The resulting correlation skill score reaches as high as ~0.90 for the last 21 years, which is ~16% increase in the skill compared to the prediction model by Lee and Seo (2013). The EUSC and BS predictors are related to a strengthening of the Okhotsk high, leading to an enhancement of the Changma front. The NIO predictor induces the cyclonic anomalies to the southwest of the Korean peninsula and southeasterly flows toward the peninsula, giving rise to an increase in the Changma precipitation.

Assessment of Stratospheric Prediction Skill of the GloSea5 Hindcast Experiment (GloSea5 모형의 성층권 예측성 검증)

  • Jung, Myungil;Son, Seok-Woo;Lim, Yuna;Song, Kanghyun;Won, DukJin;Kang, Hyun-Suk
    • Atmosphere
    • /
    • v.26 no.1
    • /
    • pp.203-214
    • /
    • 2016
  • This study explores the 6-month lead prediction skill of stratospheric temperature and circulations in the Global Seasonal forecasting model version 5 (GloSea5) hindcast experiment over the period of 1996~2009. Both the tropical and extratropical circulations are considered by analyzing the Quasi-Biennial Oscillation (QBO) and Northern Hemisphere Polar Vortex (NHPV). Their prediction skills are quantitatively evaluated by computing the Anomaly Correlation Coefficient (ACC) and Mean Squared Skill Score (MSSS), and compared with those of El Nino-Southern Oscillation (ENSO) and Arctic Oscillation (AO). Stratospheric temperature is generally better predicted than tropospheric temperature. Such improved prediction skill, however, rapidly disappears in a month, and a reliable prediction skill is observed only in the tropics, indicating a higher prediction skill in the tropics than in the extratropics. Consistent with this finding, QBO is well predicted more than 6 months in advance. Its prediction skill is significant in all seasons although a relatively low prediction skill appears in the spring when QBO phase transition often takes place. This seasonality is qualitatively similar to the spring barrier of ENSO prediction skill. In contrast, NHPV exhibits no prediction skill beyond one month as in AO prediction skill. In terms of MSSS, both QBO and NHPV are better predicted than their counterparts in the troposphere, i.e., ENSO and AO, indicating that the GloSea5 has a higher prediction skill in the stratosphere than in the troposphere.

Enhancing machine learning-based anomaly detection for TBM penetration rate with imbalanced data manipulation (불균형 데이터 처리를 통한 머신러닝 기반 TBM 굴진율 이상탐지 개선)

  • Kibeom Kwon;Byeonghyun Hwang;Hyeontae Park;Ju-Young Oh;Hangseok Choi
    • Journal of Korean Tunnelling and Underground Space Association
    • /
    • v.26 no.5
    • /
    • pp.519-532
    • /
    • 2024
  • Anomaly detection for the penetration rate of tunnel boring machines (TBMs) is crucial for effective risk management in TBM tunnel projects. However, previous machine learning models for predicting the penetration rate have struggled with imbalanced data between normal and abnormal penetration rates. This study aims to enhance the performance of machine learning-based anomaly detection for the penetration rate by utilizing a data augmentation technique to address this data imbalance. Initially, six input features were selected through correlation analysis. The lowest and highest 10% of the penetration rates were designated as abnormal classes, while the remaining penetration rates were categorized as a normal class. Two prediction models were developed, each trained on an original training set and an oversampled training set constructed using SMOTE (synthetic minority oversampling technique): an XGB (extreme gradient boosting) model and an XGB-SMOTE model. The prediction results showed that the XGB model performed poorly for the abnormal classes, despite performing well for the normal class. In contrast, the XGB-SMOTE model consistently exhibited superior performance across all classes. These findings can be attributed to the data augmentation for the abnormal penetration rates using SMOTE, which enhances the model's ability to learn patterns between geological and operational factors that contribute to abnormal penetration rates. Consequently, this study demonstrates the effectiveness of employing data augmentation to manage imbalanced data in anomaly detection for TBM penetration rates.

Subseasonal-to-Seasonal (S2S) Prediction Skills of GloSea5 Model: Part 1. Geopotential Height in the Northern Hemisphere Extratropics (GloSea5 모형의 계절내-계절(S2S) 예측성 검정: Part 1. 북반구 중위도 지위고도)

  • Kim, Sang-Wook;Kim, Hera;Song, Kanghyun;Son, Seok-Woo;Lim, Yuna;Kang, Hyun-Suk;Hyun, Yu-Kyung
    • Atmosphere
    • /
    • v.28 no.3
    • /
    • pp.233-245
    • /
    • 2018
  • This study explores the Subseasonal-to-Seasonal (S2S) prediction skills of the Northern Hemisphere mid-latitude geopotential height in the Global Seasonal forecasting model version 5 (GloSea5) hindcast experiment. The prediction skills are quantitatively verified for the period of 1991~2010 by computing the Anomaly Correlation Coefficient (ACC) and Mean Square Skill Score (MSSS). GloSea5 model shows a higher prediction skill in winter than in summer at most levels regardless of verification methods. Quantitatively, the prediction limit diagnosed with ACC skill of 500 hPa geopotential height, averaged over $30^{\circ}N{\sim}90^{\circ}N$, is 11.0 days in winter, but only 9.1 days in summer. These prediction limits are primarily set by the planetary-scale eddy phase errors. The stratospheric prediction skills are typically higher than the tropospheric skills except in the summer upper-stratosphere where prediction skills are substantially lower than upper-troposphere. The lack of the summer upper-stratospheric prediction skill is caused by zonal mean error, perhaps strongly related to model mean bias in the stratosphere.

Comparison and Analysis of Anomaly Detection Methods for Detecting Data Exfiltration (데이터 유출 탐지를 위한 이상 행위 탐지 방법의 비교 및 분석)

  • Lim, Wongi;Kwon, Koohyung;Kim, Jung-Jae;Lee, Jong-Eon;Cha, Si-Ho
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.17 no.9
    • /
    • pp.440-446
    • /
    • 2016
  • Military secrets or confidential data of any organization are extremely important assets. They must be discluded from outside. To do this, methods for detecting anomalous attacks and intrusions inside the network have been proposed. However, most anomaly-detection methods only cover aspects of intrusion from outside and do not deal with internal leakage of data, inflicting greater damage than intrusions and attacks from outside. In addition, applying conventional anomaly-detection methods to data exfiltration creates many problems, because the methods do not consider a number of variables or the internal network environment. In this paper, we describe issues considered in data exfiltration detection for anomaly detection (DEDfAD) to improve the accuracy of the methods, classify the methods as profile-based detection or machine learning-based detection, and analyze their advantages and disadvantages. We also suggest future research challenges through comparative analysis of the issues with classification of the detection methods.

Development of Medical Cost Prediction Model Based on the Machine Learning Algorithm (머신러닝 알고리즘 기반의 의료비 예측 모델 개발)

  • Han Bi KIM;Dong Hoon HAN
    • Journal of Korea Artificial Intelligence Association
    • /
    • v.1 no.1
    • /
    • pp.11-16
    • /
    • 2023
  • Accurate hospital case modeling and prediction are crucial for efficient healthcare. In this study, we demonstrate the implementation of regression analysis methods in machine learning systems utilizing mathematical statics and machine learning techniques. The developed machine learning model includes Bayesian linear, artificial neural network, decision tree, decision forest, and linear regression analysis models. Through the application of these algorithms, corresponding regression models were constructed and analyzed. The results suggest the potential of leveraging machine learning systems for medical research. The experiment aimed to create an Azure Machine Learning Studio tool for the speedy evaluation of multiple regression models. The tool faciliates the comparision of 5 types of regression models in a unified experiment and presents assessment results with performance metrics. Evaluation of regression machine learning models highlighted the advantages of boosted decision tree regression, and decision forest regression in hospital case prediction. These findings could lay the groundwork for the deliberate development of new directions in medical data processing and decision making. Furthermore, potential avenues for future research may include exploring methods such as clustering, classification, and anomaly detection in healthcare systems.