• 제목/요약/키워드: method: data analysis

검색결과 22,301건 처리시간 0.042초

Structural health monitoring data reconstruction of a concrete cable-stayed bridge based on wavelet multi-resolution analysis and support vector machine

  • Ye, X.W.;Su, Y.H.;Xi, P.S.;Liu, H.
    • Computers and Concrete
    • /
    • 제20권5호
    • /
    • pp.555-562
    • /
    • 2017
  • The accuracy and integrity of stress data acquired by bridge heath monitoring system is of significant importance for bridge safety assessment. However, the missing and abnormal data are inevitably existed in a realistic monitoring system. This paper presents a data reconstruction approach for bridge heath monitoring based on the wavelet multi-resolution analysis and support vector machine (SVM). The proposed method has been applied for data imputation based on the recorded data by the structural health monitoring (SHM) system instrumented on a prestressed concrete cable-stayed bridge. The effectiveness and accuracy of the proposed wavelet-based SVM prediction method is examined by comparing with the traditional autoregression moving average (ARMA) method and SVM prediction method without wavelet multi-resolution analysis in accordance with the prediction errors. The data reconstruction analysis based on 5-day and 1-day continuous stress history data with obvious preternatural signals is performed to examine the effect of sample size on the accuracy of data reconstruction. The results indicate that the proposed data reconstruction approach based on wavelet multi-resolution analysis and SVM is an effective tool for missing data imputation or preternatural signal replacement, which can serve as a solid foundation for the purpose of accurately evaluating the safety of bridge structures.

A Kernel Approach to Discriminant Analysis for Binary Classification

  • 신양규
    • Journal of the Korean Data and Information Science Society
    • /
    • 제12권2호
    • /
    • pp.83-93
    • /
    • 2001
  • We investigate a kernel approach to discriminant analysis for binary classification as a machine learning point of view. Our view of the kernel approach follows support vector method which is one of the most promising techniques in the area of machine learning. As usual discriminant analysis, the kernel method can discriminate an object most likely belongs to. Moreover, it has some advantage over discriminant analysis such as data compression and computing time.

  • PDF

시간의 흐름과 위치 변화에 따른 멀티 블록 스트림 데이터의 의미 있는 패턴 추출 방법 (The Method for Extracting Meaningful Patterns Over the Time of Multi Blocks Stream Data)

  • 조경래;김기영
    • 정보처리학회논문지:컴퓨터 및 통신 시스템
    • /
    • 제3권10호
    • /
    • pp.377-382
    • /
    • 2014
  • 모바일 통신과 사물 인터넷(IoT) 환경에서 시간에 따른 데이터의 분석 기술은 주로 의미 있는 정보를 찾기 위해 수집 된 데이터에서 의미있는 패턴을 추출하기 위해 사용된다. 기존의 데이터 마이닝을 이용한 분석 방법은 데이터 수집이 어렵고 시간의 경과와 관련된 시계열 데이터의 변경을 반영하기 위해 완료 상태에 기초하여 해석되어야 한다. 이러한 패턴의 다양성, 대용량성, 연속성 등의 여러 가지 특성을 가진 데이터 스트림의 분석을 위한 방법으로 멀티 블록 스트리밍 데이터 분석(AM-MBSD) 방법을 제안한다. 의미 있는 데이터 추출을 위해 멀티 블록 스트리밍 데이터의 패턴을 추출하고 추출된 연속적 데이터를 여러 개의 블록으로 정의하고 제안 방법의 검증을 위해 각 데이터 블록의 데이터 패턴 생성 시간, 주파수를 수집하고 시계열 데이터를 분석, 실험하였다.

공진주 실험의 이론적 모델링에 의한 자료분석 및 해석기법의 제안 (Data Reduction and Analysis Technique for the Resonant Column Testing by Its Theoretical Modeling)

  • 조성호;황선근;강태호;권병성
    • 한국지반공학회:학술대회논문집
    • /
    • 한국지반공학회 2003년도 봄 학술발표회 논문집
    • /
    • pp.291-298
    • /
    • 2003
  • The resonant column testing is a laboratory testing method to determine the shear modulus and the material damping factor of soils. The method has been widely used for many applications and its importance has been increased. Since the establishment of the testing method in 1963, the low-technology electronic devices for testing and data acquisition have limited the measurement to the amplitude of the linear spectrum. The limitations of the testing method were also attributed to the assumption of the linear-elastic material in the theory of the resonant column testing and to the use of the wave equation for the dynamic response of the specimen. For the better theoretical formulation of the resonant column testing, this study derived the equation of motion and provided its solution. This study also proposed the improved data reduction and analysis method for the resonant column testing, based on the advanced data acquisition system and the proposed theoretical solution for the resonant column testing system. For the verification of the proposed data reduction and analysis method, the numerical simulation of the resonant column testing was performed by the finite element analysis. Also, a series of resonant column testing were peformed for Joomunjin sand, which verified the feasibility, of the proposed method and showed the limitations of the conventional data reduction and analysis method.

  • PDF

GIS 공간분석에 있어 Fuzzy 함수의 적용에 관한 연구 -쓰레기 매립장 적지분석을 중심으로- (A Study on the Application of Fuzzy membership function in GIS Spatial Analysis - In the case of Evaluation of Waste Landfill -)

  • 임승현;황주태;박영기;이장춘
    • 대한공간정보학회지
    • /
    • 제15권2호통권40호
    • /
    • pp.43-49
    • /
    • 2007
  • 본 연구는 퍼지개념을 적용한 GIS 공간분석법을 도입하고 이를 통해 쓰레기 매립장 입지 평가를 수행하였다. 기존 연구는 GIS의 공간 중첩 분석법을 적용하여 입지분석이나 적지선정 등을 수행하였으나 공간 중첩분석은 보통집합의 불린 논리를 바탕으로 공간자료를 처리하였기 때문에 공간자료의 불확실성과 자료분류 기준의 부적합성을 고려하여 분석할 수 없었다. 그러므로 신뢰할 수 있는 분석결과를 제시할 수 없어 실제 문제에서 적극 활용되지 못하였다. 본 연구는 쓰레기 매립장을 대상 시설로 선정하고 객관적인 접근법으로 퍼지 공간분석 법을 적용하였으며, 구체적인 적용과정으로서 연속형 공간자료에 대한 소속함수의 정의방법과 퍼지분석을 위한 퍼지입력값의 생성, 그리고 쓰레기 매립장 입지평가를 위한 분석인자의 선정기준 및 자료분류기준을 검토하여 이것으로부터 소속함수를 결정하는 매개변수를 추출하는 방법을 제시하였다.

  • PDF

Saliency Score-Based Visualization for Data Quality Evaluation

  • Kim, Yong Ki;Lee, Keon Myung
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제15권4호
    • /
    • pp.289-294
    • /
    • 2015
  • Data analysts explore collections of data to search for valuable information using various techniques and tricks. Garbage in, garbage out is a well-recognized idiom that emphasizes the importance of the quality of data in data analysis. It is therefore crucial to validate the data quality in the early stage of data analysis, and an effective method of evaluating the quality of data is hence required. In this paper, a method to visually characterize the quality of data using the notion of a saliency score is introduced. The saliency score is a measure comprising five indexes that captures certain aspects of data quality. Some experiment results are presented to show the applicability of proposed method.

실선의 추진성능 해석기법에 관한 연구 (Analysis on the Propulsive Performance of Full Scale Ship)

  • 양승일;김은찬
    • 한국기계연구소 소보
    • /
    • 통권9호
    • /
    • pp.183-191
    • /
    • 1982
  • This report describes the analysis method of the full-scale propulsive performance by using the data of model test and the full-scale speed trial. The model test data were analyzed by the computer program "PPTT" based on "1978 ITTC Performance Prediction Method for Single Screw Ships." Also the full-scale speed trial data were analyzed by the computer program "SSTT" based on the newly proposed “SRS-KIMM Standard Method of Speed Trial Analysis." An analysis of model and full-scale test data was carried out for a 60.000 DWT Bulk Carrier and the correlation between model and full-scale ship was stuied.

  • PDF

An Automatic Urban Function District Division Method Based on Big Data Analysis of POI

  • Guo, Hao;Liu, Haiqing;Wang, Shengli;Zhang, Yu
    • Journal of Information Processing Systems
    • /
    • 제17권3호
    • /
    • pp.645-657
    • /
    • 2021
  • Along with the rapid development of the economy, the urban scale has extended rapidly, leading to the formation of different types of urban function districts (UFDs), such as central business, residential and industrial districts. Recognizing the spatial distributions of these districts is of great significance to manage the evolving role of urban planning and further help in developing reliable urban planning programs. In this paper, we propose an automatic UFD division method based on big data analysis of point of interest (POI) data. Considering that the distribution of POI data is unbalanced in a geographic space, a dichotomy-based data retrieval method was used to improve the efficiency of the data crawling process. Further, a POI spatial feature analysis method based on the mean shift algorithm is proposed, where data points with similar attributive characteristics are clustered to form the function districts. The proposed method was thoroughly tested in an actual urban case scenario and the results show its superior performance. Further, the suitability of fit to practical situations reaches 88.4%, demonstrating a reasonable UFD division result.

Technical efficiency of the coastal composite fishery in Korea: a comparison of data envelopment analysis and stochastic frontier analysis

  • Kim, Do-Hoon;Seo, Ju-Nam;Lee, Sang-Go
    • 수산경영론집
    • /
    • 제41권3호
    • /
    • pp.45-58
    • /
    • 2010
  • This study estimated the technical efficiency of coastal composite fishery in Korea by using the data envelopment analysis (DEA) and the stochastic frontier analysis (SFA) methods, and the results on the respective method were compared. In the DEA method, the constant returns to scale (CRS) and the variable returns to scale (VRS) output-oriented DEA models were separated and technical efficiencies were estimated, respectively. The average estimated value of technical efficiency by the SFA method (0.633) was found to be lower than that by the VRS-DEA method (0.738), while it was higher than that by the CRS-DEA method (0.479). It was found that strong correlation exists between the SFA method and the VRS-DEA method. The method which can utilize both methods in mutually complementing way for the estimation of technical efficiency was also considered.

Automatic Cross-calibration of Multispectral Imagery with Airborne Hyperspectral Imagery Using Spectral Mixture Analysis

  • Yeji, Kim;Jaewan, Choi;Anjin, Chang;Yongil, Kim
    • 한국측량학회지
    • /
    • 제33권3호
    • /
    • pp.211-218
    • /
    • 2015
  • The analysis of remote sensing data depends on sensor specifications that provide accurate and consistent measurements. However, it is not easy to establish confidence and consistency in data that are analyzed by different sensors using various radiometric scales. For this reason, the cross-calibration method is used to calibrate remote sensing data with reference image data. In this study, we used an airborne hyperspectral image in order to calibrate a multispectral image. We presented an automatic cross-calibration method to calibrate a multispectral image using hyperspectral data and spectral mixture analysis. The spectral characteristics of the multispectral image were adjusted by linear regression analysis. Optimal endmember sets between two images were estimated by spectral mixture analysis for the linear regression analysis, and bands of hyperspectral image were aggregated based on the spectral response function of the two images. The results were evaluated by comparing the Root Mean Square Error (RMSE), the Spectral Angle Mapper (SAM), and average percentage differences. The results of this study showed that the proposed method corrected the spectral information in the multispectral data by using hyperspectral data, and its performance was similar to the manual cross-calibration. The proposed method demonstrated the possibility of automatic cross-calibration based on spectral mixture analysis.