• Title/Summary/Keyword: Outlier Analysis

Search Result 234, Processing Time 0.023 seconds

Extraction of water body in before and after images of flood using Mahalanobis distance-based spectral analysis

  • Ye, Chul-Soo
    • Korean Journal of Remote Sensing
    • /
    • v.31 no.4
    • /
    • pp.293-302
    • /
    • 2015
  • Water body extraction is significant for flood disaster monitoring using satellite imagery. Conventional methods have focused on finding an index, which highlights water body and suppresses non-water body such as vegetation or soil area. The Normalized Difference Water Index (NDWI) is typically used to extract water body from satellite images. The drawback of NDWI, however, is that some man-made objects in built-up areas have NDWI values similar to water body. The objective of this paper is to propose a new method that could extract correctly water body with built-up areas in before and after images of flood. We first create a two-element feature vector consisting of NDWI and a Near InfRared band (NIR) and then select a training site on water body area. After computing the mean vector and the covariance matrix of the training site, we classify each pixel into water body based on Mahalanobis distance. We also register before and after images of flood using outlier removal and triangulation-based local transformation. We finally create a change map by combining the before-flooding water body and after-flooding water body. The experimental results show that the overall accuracy and Kappa coefficient of the proposed method were 97.25% and 94.14%, respectively, while those of the NDWI method were 89.5% and 69.6%, respectively.

Estimation of Drought Rainfall According to Consecutive Duration and Return Period Using Probability Distribution (확률분포에 의한 지속기간 및 빈도별 가뭄우량 추정)

  • Lee, Soon Hyuk;Maeng, Sung Jin;Ryoo, Kyong Sik
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2004.05b
    • /
    • pp.1103-1106
    • /
    • 2004
  • The objective of this study is to induce the design drought rainfall by the methodology of L-moment including testing homogeneity, independence and outlier of the data of annual minimum monthly rainfall in 57 rainfall stations in Korea in terms of consecutive duration for 1, 2, 4, 6, 9 and 12 months. To select appropriate distribution of the data for annual minimum monthy rainfall by rainfall station, the distribution of generalized extreme value (GEV), generalized logistic (GLO) as well as that of generalized pareto (GPA) are applied and the appropriateness of the applied GEV, GLO, and GPA distribution is judged by L-moment ratio diagram and Kolmogorov-Smirnov (K-S) test. As for the annual minimum monthly rainfall measured by rainfall station and that stimulated by Monte Carlo techniques, the parameters of the appropriately selected GEV and GPA distributions are calculated by the methodology of L-moment and the design drought rainfall is induced. Through the comparative analysis of design drought rainfall induced by GEV and GPA distribution by rainfall station, the optimal design drought rainfall by rainfall station is provided.

  • PDF

A Study on Developing the Acquisition Unit Cost Estimating Model of the Guided Weapon System (유도무기 획득단가 추정 모델 개발에 관한 연구)

  • Kim, Yonghyun;Lee, Yongbok;Jung, Wonil;Kim, Dongkyu;Kang, Sungjin
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.15 no.5
    • /
    • pp.565-576
    • /
    • 2012
  • Cost estimates are necessary for government acquisition program to support decisions about funding, to develop annual budget requests and to validate resource requirements at key decision points. Many researches have been done about cost estimating technique recently. Parametric cost estimating models based on CERs(Cost Estimating Relationships) have been mainly used using regression method with historical data. However, there are many restrictions in developing Korean version CERs because the number of data points are too small. Specially, data collection and data management system are unstable in Korean defense environment, when developing CERs. In this research, we analyzed the historical data, and found some cost drivers in guided weapon system area. We developed the Acquisition Unit Cost CER using the regression to remove multicollinearity in the historical data. So we could overcome the restriction of the insufficient sample number. This research as a first attempt is meaningful in terms of obtaining our own Acquisition Unit Cost CER using historical cost and physical characteristic in Korean development environment.

Intelligent bolt-jointed system integrating piezoelectric sensors with shape memory alloys

  • Park, Jong Keun;Park, Seunghee
    • Smart Structures and Systems
    • /
    • v.17 no.1
    • /
    • pp.135-147
    • /
    • 2016
  • This paper describes a smart structural system, which uses smart materials for real-time monitoring and active control of bolted-joints in steel structures. The goal of this research is to reduce the possibility of failure and the cost of maintenance of steel structures such as bridges, electricity pylons, steel lattice towers and so on. The concept of the smart structural system combines impedance based health monitoring techniques with a shape memory alloy (SMA) washer to restore the tension of the loosened bolt. The impedance-based structural health monitoring (SHM) techniques were used to detect loosened bolts in bolted-joints. By comparing electrical impedance signatures measured from a potentially damage structure with baseline data obtained from the pristine structure, the bolt loosening damage could be detected. An outlier analysis, using generalized extreme value (GEV) distribution, providing optimal decision boundaries, has been carried out for more systematic damage detection. Once the loosening damage was detected in the bolted joint, the external heater, which was bonded to the SMA washer, actuated the washer. Then, the heated SMA washer expanded axially and adjusted the bolt tension to restore the lost torque. Additionally, temperature variation due to the heater was compensated by applying the effective frequency shift (EFS) algorithm to improve the performance of the diagnostic results. An experimental study was conducted by integrating the piezoelectric material based structural health monitoring and the SMA-based active control function on a bolted joint, after which the performance of the smart 'self-monitoring and self-healing bolted joint system' was demonstrated.

On the Use of Weighted k-Nearest Neighbors for Missing Value Imputation (Weighted k-Nearest Neighbors를 이용한 결측치 대치)

  • Lim, Chanhui;Kim, Dongjae
    • The Korean Journal of Applied Statistics
    • /
    • v.28 no.1
    • /
    • pp.23-31
    • /
    • 2015
  • A conventional missing value problem in the statistical analysis k-Nearest Neighbor(KNN) method are used for a simple imputation method. When one of the k-nearest neighbors is an extreme value or outlier, the KNN method can create a bias. In this paper, we propose a Weighted k-Nearest Neighbors(WKNN) imputation method that can supplement KNN's faults. A Monte-Carlo simulation study is also adapted to compare the WKNN method and KNN method using real data set.

Data anomaly detection for structural health monitoring using a combination network of GANomaly and CNN

  • Liu, Gaoyang;Niu, Yanbo;Zhao, Weijian;Duan, Yuanfeng;Shu, Jiangpeng
    • Smart Structures and Systems
    • /
    • v.29 no.1
    • /
    • pp.53-62
    • /
    • 2022
  • The deployment of advanced structural health monitoring (SHM) systems in large-scale civil structures collects large amounts of data. Note that these data may contain multiple types of anomalies (e.g., missing, minor, outlier, etc.) caused by harsh environment, sensor faults, transfer omission and other factors. These anomalies seriously affect the evaluation of structural performance. Therefore, the effective analysis and mining of SHM data is an extremely important task. Inspired by the deep learning paradigm, this study develops a novel generative adversarial network (GAN) and convolutional neural network (CNN)-based data anomaly detection approach for SHM. The framework of the proposed approach includes three modules : (a) A three-channel input is established based on fast Fourier transform (FFT) and Gramian angular field (GAF) method; (b) A GANomaly is introduced and trained to extract features from normal samples alone for class-imbalanced problems; (c) Based on the output of GANomaly, a CNN is employed to distinguish the types of anomalies. In addition, a dataset-oriented method (i.e., multistage sampling) is adopted to obtain the optimal sampling ratios between all different samples. The proposed approach is tested with acceleration data from an SHM system of a long-span bridge. The results show that the proposed approach has a higher accuracy in detecting the multi-pattern anomalies of SHM data.

Power Load Pattern Classification from AMR Data (AMR 데이터에서의 전력 부하 패턴 분류)

  • Piao, Minghao;Park, Jin-Hyung;Lee, Heon-Gyu;Shin, Jin-Ho;Ryu, Keun-Ho
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2008.05a
    • /
    • pp.231-234
    • /
    • 2008
  • Currently an automated methodology based on data mining techniques is presented for the prediction of customer load patterns in load demand data. The main aim of our work is to forecast customers' contract information from capacity of daily power consumption patterns. According to the result, we try to evaluate the contract information's suitability. The proposed our approach consists of three stages: (i) data preprocessing: noise or outlier is detected and removed (ii) cluster analysis: SOMs clustering is used to create load patterns and the representative load profiles and (iii) classification: we applied the K-NNs classifier in order to predict the customers' contract information base on power consumption patterns. According to the our proposed methodology, power load measured from AMR(automatic meter reading) system, as well as customer indexes, were used as inputs. The output was the classification of representative load profiles (or classes). Lastly, in order to evaluate KNN classification technique, the proposed methodology was applied on a set of high voltage customers of the Korea power system and the results of our experiments was presented.

Local Imbalance of Emergency Medical Services(EMS): Analyses on 119 EMS Activity Reports of Busan (구급서비스의 지역 불균형: 부산시 119 구급활동일지 분석)

  • Lee, Dalbyul
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.23 no.3
    • /
    • pp.161-173
    • /
    • 2020
  • This study analyzed local imbalances in the supply and demand of emergency medical services in Busan using the 119 emergency activity reports of the Busan Fire & Disaster Headquarters. The data for EMS activity reports in 2017 was converted into Jimgyegu units. The spatial distribution of the indicators representing the local imbalance of emergency demand and supply (number of reports, number of reports relative to the population, average coefficient of variation and outlier of on-site arrival time, and number of dispatches outside the jurisdiction) was analyzed using Hotspot analysis of GIS spatial statistics analysis. As a result of the analysis, the hot spot area and the cold spot area where both supply and demand of emergency services are concentrated were clearly distinguished. This means that the supply and demand of emergency services in Busan are locally unbalanced. In particular, there was a difference in the demand and supply of emergency services in the original downtown and its surrounding areas, and in the outskirts of Busan.

Pre-processing of load data of agricultural tractors during major field operations

  • Ryu, Myong-Jin;Kabir, Md. Shaha Nur;Choo, Youn-Kug;Chung, Sun-Ok;Kim, Yong-Joo;Ha, Jong-Kyou;Lee, Kyeong-Hwan
    • Korean Journal of Agricultural Science
    • /
    • v.42 no.1
    • /
    • pp.53-61
    • /
    • 2015
  • Development of highly efficient and energy-saving tractors has been one of the issues in agricultural machinery. For design of such tractors, measurement and analysis of load on major power transmission parts of the tractors are the most important pre-requisite tasks. Objective of this study was to perform pre-processing procedures before effective analysis of load data of agricultural tractors (30, 75, and 82 kW) during major field operations such as plow tillage, rotary tillage, baling, bale wrapping, and to select the suitable pre-processing method for the analysis. A load measurement systems, equipped in the tractors, were consisted of strain-gauge, encoder, hydraulic pressure, and radar speed sensors to measure torque and rotational speed levels of transmission input shaft, PTO shaft, and driving axle shafts, pressure of the hydraulic inlet line, and travel speed, respectively. The entire sensor data were collected at a 200-Hz rate. Plow tillage, rotary tillage, baling, wrapping, and loader operations were selected as major field operations of agricultural tractors. Same or different farm works and driving levels were set differently for each of the load measuring experiment. Before load data analysis, pre-processing procedures such as outlier removal, low-pass filtering, and data division were performed. Data beyond the scope of the measuring range of the sensors and the operating range of the power transmission parts were removed. Considering engine and PTO rotational speeds, frequency components greater than 90, 60, and 60 Hz cut off frequencies were low-pass filtered for plow tillage, rotary tillage, and baler operations, respectively. Measured load data were divided into five parts: driving, working, implement up, implement down, and turning. Results of the study would provide useful information for load characteristics of tractors on major field operations.

Results of a Round-Robin Test for the Draft International Standard on FT-IR Gas Analysis of Fire Effluents from a Cone Calorimeter (콘칼로리미터 연소가스 FT-IR 분석을 위한 국제표준 초안의 비교시험 결과분석)

  • Choi, Jung-Min;Park, Kye-Won;Jeong, Jae-Gun
    • Fire Science and Engineering
    • /
    • v.33 no.3
    • /
    • pp.1-8
    • /
    • 2019
  • The international standard for FT-IR gas analysis of fire effluents in ISO 5660-1 cone calorimeter has been being developed in ISO TC 92. A comparison of the round-robin test of WD 21397 was conducted with six participating laboratories in 2018. The test specimens were PMMA, rigid PU foam board, and PVC flooring. The measurement quantities were the time-to-ignition, peak heat release rate, total heat release, and effective heat of combustion for a cone calorimeter test and peak gas concentration, gas generation, and gas yield for FT-IR gas analysis. No outliers were identified. For the cone calorimeter quantities, the repeatability and reproducibility were 1.5% and 9.8%, respectively. For FT-IR gas analysis, the repeatability and reproducibility was 12.9% and 27.9%, respectively.