• 제목/요약/키워드: Outlier Analysis

검색결과 234건 처리시간 0.022초

자율주행을 위한 라이다 기반의 실시간 그라운드 세그멘테이션 알고리즘 (LiDAR based Real-time Ground Segmentation Algorithm for Autonomous Driving)

  • 이아영;이경수
    • 자동차안전학회지
    • /
    • 제14권2호
    • /
    • pp.51-56
    • /
    • 2022
  • This paper presents an Ground Segmentation algorithm to eliminate unnecessary Lidar Point Cloud Data (PCD) in an autonomous driving system. We consider Random Sample Consensus (Ransac) Algorithm to process lidar ground data. Ransac designates inlier and outlier to erase ground point cloud and classified PCD into two parts. Test results show removal of PCD from ground area by distinguishing inlier and outlier. The paper validates ground rejection algorithm in real time calculating the number of objects recognized by ground data compared to lidar raw data and ground segmented data based on the z-axis. Ground Segmentation is simulated by Robot Operating System (ROS) and an analysis of autonomous driving data is constructed by Matlab. The proposed algorithm can enhance performance of autonomous driving as misrecognizing circumstances are reduced.

Evolutionary Computing Driven Extreme Learning Machine for Objected Oriented Software Aging Prediction

  • Ahamad, Shahanawaj
    • International Journal of Computer Science & Network Security
    • /
    • 제22권2호
    • /
    • pp.232-240
    • /
    • 2022
  • To fulfill user expectations, the rapid evolution of software techniques and approaches has necessitated reliable and flawless software operations. Aging prediction in the software under operation is becoming a basic and unavoidable requirement for ensuring the systems' availability, reliability, and operations. In this paper, an improved evolutionary computing-driven extreme learning scheme (ECD-ELM) has been suggested for object-oriented software aging prediction. To perform aging prediction, we employed a variety of metrics, including program size, McCube complexity metrics, Halstead metrics, runtime failure event metrics, and some unique aging-related metrics (ARM). In our suggested paradigm, extracting OOP software metrics is done after pre-processing, which includes outlier detection and normalization. This technique improved our proposed system's ability to deal with instances with unbalanced biases and metrics. Further, different dimensional reduction and feature selection algorithms such as principal component analysis (PCA), linear discriminant analysis (LDA), and T-Test analysis have been applied. We have suggested a single hidden layer multi-feed forward neural network (SL-MFNN) based ELM, where an adaptive genetic algorithm (AGA) has been applied to estimate the weight and bias parameters for ELM learning. Unlike the traditional neural networks model, the implementation of GA-based ELM with LDA feature selection has outperformed other aging prediction approaches in terms of prediction accuracy, precision, recall, and F-measure. The results affirm that the implementation of outlier detection, normalization of imbalanced metrics, LDA-based feature selection, and GA-based ELM can be the reliable solution for object-oriented software aging prediction.

SOURCES OF HIGH LEVERAGE IN LINEAR REGRESSION MODEL

  • Kim, Myung-Geun
    • Journal of applied mathematics & informatics
    • /
    • 제16권1_2호
    • /
    • pp.509-513
    • /
    • 2004
  • Some reasons for high leverage are analytically investigated by decomposing leverage into meaningful components. The results in this work can be used for remedial action as a next step of data analysis.

Detecting Multiple Outliers Using the Gaps of Order Statistics

  • Kim, Hyun Chul
    • Communications for Statistical Applications and Methods
    • /
    • 제2권2호
    • /
    • pp.184-197
    • /
    • 1995
  • An objective and one-step detection procedure of multiple outliers is suggested by using the gaps of the order statistics. The detection procedure can be used as a routine outlier detection method of a statistical analysis computer program. The procedure is applied to some examples including the data selected by Kitagawa.

  • PDF

Chemometric Tool of Chromatographic Pattern Recognition for the Analysis of Complex Mixtures

  • Park, Man-Ki;Park, Jeong-Hill;Cho, Jung-Hwan;Kim, Na-Young;Kang, Jong-Seong
    • Archives of Pharmacal Research
    • /
    • 제15권4호
    • /
    • pp.376-378
    • /
    • 1992
  • A chemical tool was developed for the analysis of complex mixtures such as crude drugs by the method of pattern recognition. Pattern recognition was accomplished by a multiple reference peak identification method and three kinds of outlier statistics. This tool was tested on the analysis of synthetic mixtures.

  • PDF

A New Forest Fire Detection Algorithm using Outlier Detection Method on Regression Analysis between Surface temperature and NDVI

  • Huh, Yong;Byun, Young-Gi;Son, Jeong-Hoon;Yu, Ki-Yun;Kim, Yong-Il
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2006년도 Proceedings of ISRS 2006 PORSEC Volume II
    • /
    • pp.574-577
    • /
    • 2006
  • In this paper, we developed a forest fire detection algorithm which uses a regression function between NDVI and land surface temperature. Previous detection algorithms use the land surface temperature as a main factor to discriminate fire pixels from non-fire pixels. These algorithms assume that the surface temperatures of non-fire pixels are intrinsically analogous and obey Gaussian normal distribution, regardless of land surface types and conditions. And the temperature thresholds for detecting fire pixels are derived from the statistical distribution of non-fire pixels’ temperature using heuristic methods. This assumption makes the temperature distribution of non-fire pixels very diverse and sometimes slightly overlapped with that of fire pixel. So, sometimes there occur omission errors in the cases of small fires. To ease such problem somewhat, we separated non-fire pixels into each land cover type by clustering algorithm and calculated the residuals between the temperature of a pixel under examination whether fire pixel or not and estimated temperature of the pixel using the linear regression between surface temperature and NDVI. As a result, this algorithm could modify the temperature threshold considering land types and conditions and showed improved detection accuracy.

  • PDF

Analysis of Outlier Effects on Spatial Indices

  • Kim Si-Wan;Kim Kyoung-Sook;Li Ki-Joune
    • Spatial Information Research
    • /
    • 제12권4호
    • /
    • pp.339-349
    • /
    • 2004
  • 공간 데이터베이스에서 예외자는 R-tree 계열의 공간색인의 성능에 많은 영향을 미친다. 즉, 예외자로 인하여 R-tree 계열의 공간색인에서 최소경계사각형의 넓이가 불필요하게 넓어지고 겹침 현상이 심해지게 되고 이로 인해 질의처리 시 더 많은 디스크 접근을 필요하게 된다. 따라서, 본 논문에서는 예외자가 공간색인에 주는 영향을 분석하여, 예외자를 미리 처리할 경우, 얼마만큼의 성능을 향상시킬 수 있는지 비용모델과 적절한 예외자의 처리방법을 제안한다. 그리고 실험을 통해 예외자를 미리 처리함으로써 어느 정도의 공간색인의 질의처리 성능을 향상시킬 수 있는지 보여준다. 실험결과에 따르면, 본 논문에서 제안된 예외자의 처리방법이 기존의 공간색인의 성능을 평균 $15\%$정도 향상시킬 수 있음을 보여준다.

  • PDF

상시 온도변화 효과를 고려한 모드 유연도행렬 기반의 교량의 손상탐색기법 (Damage Detection in Bridges Using Modal Flexibility Matrices Under Temperature Variation)

  • 구기영;이종재;윤정방
    • 한국전산구조공학회:학술대회논문집
    • /
    • 한국전산구조공학회 2007년도 정기 학술대회 논문집
    • /
    • pp.651-656
    • /
    • 2007
  • Changes in measured structural responses induced by a damage could be significantly smaller than those by environmental effects such as temperature and temperature gradients. It is highly desirable to develop a methodology to distinguish the changes due to the structural damage from those by the environmental variations. In this study, a novel method to extract the damage-induced deflection under temperature variations is presented using the outlier analysis on the deflections obtained using the modal flexibility matrices. The main idea is that temperature change in a bridge would produce global increase or decrease in deflections over the whole bridge while structural damages may cause local variations in deflections near the damage locations. Hence, the correlation between the deflection measurements may show high abnormality near the damage locations. A series of laboratory tests were carried out on a bridge model with a steel box-girder for 14 days. It has been found that the damage existence assessment and localization can carried out for a case with relatively small damage under the temperature variations

  • PDF

A novel transmissibility concept based on wavelet transform for structural damage detection

  • Fan, Zhe;Feng, Xin;Zhou, Jing
    • Smart Structures and Systems
    • /
    • 제12권3_4호
    • /
    • pp.291-308
    • /
    • 2013
  • A novel concept of transmissibility based on a wavelet transform for structural damage detection is presented in this paper. The main objective of the research was the development of a method for detecting slight damage at the incipient stage. As a vibration-based approach, the concept of transmissibility has attracted considerable interest because of its advantages and effectiveness in damage detection. However, like other vibration-based methods, transmissibility-based approaches suffer from insensitivity to slight local damage because of the regularity of the traditional Fourier transform. Therefore, the powerful signal processing techniques must be found to solve this problem. Wavelet transform that is able to capture subtle information in measured signals has received extensive attention in the field of damage detection in recent decades. In this paper, we first propose a novel transmissibility concept based on the wavelet transform. Outlier analysis was adopted to construct a damage detection algorithm with wavelet-based transmissibility. The feasibility of the proposed method was numerically investigated with a typical six-degrees-of-freedom spring-mass system, and comparative investigations were performed with a conventional transmissibility approach. The results demonstrate that the proposed transmissibility is more sensitive than conventional transmissibility, and the former is a promising tool for structural damage detection at the incipient stage.

Laser based impedance measurement for pipe corrosion and bolt-loosening detection

  • Yang, Jinyeol;Liu, Peipei;Yang, Suyoung;Lee, Hyeonseok;Sohn, Hoon
    • Smart Structures and Systems
    • /
    • 제15권1호
    • /
    • pp.41-55
    • /
    • 2015
  • This study proposes a laser based impedance measurement system and impedance based pipe corrosion and bolt-loosening monitoring techniques under temperature variations. For impedance measurement, the laser based impedance measurement system is optimized and adopted in this paper. First, a modulated laser beam is radiated to a photodiode, converting the laser beam into an electric signal. Then, the electric signal is applied to a MFC transducer attached on a target structure for ultrasonic excitation. The corresponding impedance signals are measured, re-converted into a laser beam, and radiated back to the other photodiode located in a data interrogator. The transmitted impedance signals are treated with an outlier analysis using generalized extreme value (GEV) statistics to reliably signal off structural damage. Validation of the proposed technique is carried out to detect corrosion and bolt-loosening in lab-scale carbon steel elbow pipes under varying temperatures. It has been demonstrated that the proposed technique has a potential to be used for structural health monitoring (SHM) of pipe structures.