• Communications of the Korean Mathematical Society
• /
• v.31 no.1
• /
• pp.185-198
• /
• 2016

Regression analysis is an analyzing method of regression model to explain the statistical relationship between explanatory variable and response variables. This paper propose a fuzzy regression analysis applying Theils method which is not sensitive to outliers. This method use medians of rate of increment based on randomly chosen pairs of each components of ${\alpha}$-level sets of fuzzy data in order to estimate the coefficients of fuzzy regression model. An example and two simulation results are given to show fuzzy Theils estimator is more robust than the fuzzy least squares estimator.

• Journal of the Korean Data and Information Science Society
• /
• v.17 no.2
• /
• pp.609-617
• /
• 2006

A new fuzzy c-regression algorithm for switching regression analysis is presented, which combines fuzzy c-means clustering and least squares support vector machine. This algorithm can detect outliers in switching regression models while yielding the simultaneous estimates of the associated parameters together with a fuzzy c-partitions of data. It can be employed for the model-free nonlinear regression which does not assume the underlying form of the regression function. We illustrate the new approach with some numerical examples that show how it can be used to fit switching regression models to almost all types of mixed data.

• Proceedings of the Korean Society of Agricultural Engineers Conference
• /
• 2002.10a
• /
• pp.225-228
• /
• 2002

This research seeks to derive the design rainfalls through the L-moment with the test of homogeneity, independence and outlier of data on annual maximum daily rainfall in 38 Korean rainfall stations. To select the fit appropriate distribution of annual maximum daily rainfall data according to rainfall stations, applied were Generalized Extreme Value (GEV), Generalized Logistic (GLO) and Generalized Pareto (GPA) probability distributions were applied. and their aptness was judged Dusing an L-moment ratio diagram and the Kolmogorov-Smirnov (K-S) test, the aptitude was judged of applied distributions such as GEV, GLO and GPA. The GEV and GLO distributions were selected as the appropriate distributions. Their parameters were estimated Targetingfrom the observed and simulated annual maximum daily rainfalls and using Monte Carlo techniques, the parameters of GEV and GLO selected as suitable distributions were estimated and. dDesign rainfallss were then derived, using the L-moment. Appropriate design rainfalls were suggested by doing a comparative analysis of design rainfall from the GEV and GLO distributions according to rainfall stations.

• Asia pacific journal of information systems
• /
• v.16 no.1
• /
• pp.127-144
• /
• 2006

The K-means algorithm is widely used at the initial stage of data analysis in data mining process, partly because of its low time complexity and the simplicity of practical implementation. Cluster validity indices are used along with the algorithm in order to determine the number of clusters as well as the clustering results of datasets. In this paper, we present a performance comparison of sixteen indices, which are selected from forty indices in literature, while considering their applicability to nonhierarchical clustering algorithms. Data sets used in the experiment are generated based on multivariate normal distribution. In particular, four error types including standardization, outlier generation, error perturbation, and noise dimension addition are considered in the comparison. Through the experiment the effects of varying number of points, attributes, and clusters on the performance are analyzed. The result of the simulation experiment shows that Calinski and Harabasz index performs the best through the all datasets and that Davis and Bouldin index becomes a strong competitor as the number of points increases in dataset.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.15 no.10
• /
• pp.3482-3497
• /
• 2021

Artificial intelligence has emerged as the core of the 4th industrial revolution, and large amounts of data processing, such as big data technology and rapid data analysis, are inevitable. The most fundamental and universal data interpretation technique is an analysis of information through regression, which is also the basis of machine learning. Ridge regression is a technique of regression that decreases sensitivity to unique or outlier information. The time-consuming calculation portion of the matrix computation, however, basically includes the introduction of an inverse matrix. As the size of the matrix expands, the matrix solution method becomes a major challenge. In this paper, a new algorithm is introduced to enhance the speed of ridge regression estimator calculation through series expansion and computation recycle without adopting an inverse matrix in the calculation process or other factorization methods. In addition, the performances of the proposed algorithm and the existing algorithm were compared according to the matrix size. Overall, excellent speed-up of the proposed algorithm with good accuracy was demonstrated.

• KEPCO Journal on Electric Power and Energy
• /
• v.7 no.1
• /
• pp.73-77
• /
• 2021

As the big data analysis technologies has been developed worldwide, the importance of asset management for electric power facilities based data analysis is increasing. It is essential to secure quality of data that will determine the performance of the RISK evaluation algorithm for asset management. To improve reliability of asset management, asset data must be preprocessed. In particular, the process of cleaning dirty data is required, and it is also urgent to develop an algorithm to reduce time and improve accuracy for data treatment. In this paper, the result of the development of an automatic cleaning algorithm specialized in overhead transmission asset data is presented. A data cleaning algorithm was developed to enable data clean by analyzing quality and overall pattern of raw data.

• KIPS Transactions on Software and Data Engineering
• /
• v.6 no.10
• /
• pp.465-472
• /
• 2017

In the past, researchers mainly used the supervised learning technique of machine learning to analyze power data and investigated the identification of patterns through the data mining technique. Data analysis research, however, faces its limitations with the old data classification and analysis techniques today when the size of electric power data has increased with the possible real-time provision of data. This study thus set out to propose a clustering architecture to analyze large-sized electric power data. The clustering process proposed in the study supplements the K-means algorithm, an unsupervised learning technique, for its problems and is capable of automating the entire process from the collection of electric power data to their analysis. In the present study, power data were categorized and analyzed in total three levels, which include the row data level, clustering level, and user interface level. In addition, the investigator identified K, the ideal number of clusters, based on principal component analysis and normal distribution and proposed an altered K-means algorithm to reduce data that would be categorized as ideal points in order to increase the efficiency of clustering.

• Journal of Applied Reliability
• /
• v.17 no.3
• /
• pp.264-271
• /
• 2017

Purpose: Field operation data contains missing values or outliers due to various causes of the data collection process, so caution is required when utilizing RAM analysis results by field operation data. The purpose of this study is to present a method to minimize the RAM analysis error of the field data to improve the accuracy. Methods: Statistical methods are presented for processing of the outliers and the missing values of the field operating data, and after analyzing the RAM, the differences between before and after applying the technique are discussed. Results: The availability is estimated to be lower by 6.8 to 23.5% than that before processing, and it is judged that the processing of the missing values and outliers greatly affect the RAM analysis result. Conclusion: RAM analysis of OO weapon system was performed and suggestions for improvement of RAM analysis were presented through comparison with the new and current method. Data analysis results without appropriate treatment of error values may result in incorrect conclusions leading to inappropriate decisions and actions.

• The Journal of Bigdata
• /
• v.8 no.1
• /
• pp.35-47
• /
• 2023

It is crucial to develop effective and efficient big data analytics methods for problem-solving in the field of business in order to improve the performance of data analytics and reduce costs and risks in the analysis of customer data. In this study, a big data-driven data analysis system using artificial intelligence techniques is designed to increase the accuracy of big data analytics along with the rapid growth of the field of data science. We present a key direction for big data analysis systems through missing value imputation, outlier detection, feature extraction, utilization of explainable artificial intelligence techniques, and exploratory data analysis. Our objective is not only to develop big data analysis techniques with complex structures of business data but also to bridge the gap between the theoretical ideas in artificial intelligence methods and the analysis of real-world data in the field of business.

• Journal of the Korean GEO-environmental Society
• /
• v.15 no.3
• /
• pp.65-74
• /
• 2014

Borehole investigation which is mainly used to figure out geotechnical characterizations at construction work has the benefit that it provides a clear and convincing geotechnical information. But it has limitations to get the overall information of the construction site because it is performed at point location. In contrast, geophysical measurements like seismic survey has the advantage that the geological stratum information of a large area can be characterized in a continuous cross-section but the result from geophysics survey has wide range of values and is not suitable to determine the geotechnical design values directly. Therefore it is essential to combine borehole data and geophysics data complementally. Accordingly, in this study, a three-dimensional spatial interpolation of the cross-sectional distribution of seismic refraction was performed using digitizing and geostatistical method (krigring). In the process, digital map were used to increase the trustworthiness of method. Using this map, errors of ground height which are broken out in measurement from boring investigation and geophysical measurements can be revised. After that, average seismic velocity are derived by comparing borehole data with geophysical speed distribution data of each soil layer. During this process, outlier analysis is adapted. On the basis of the average seismic velocity, integrated analysis techniques to determine the three-dimensional geological stratum information is established. Finally, this analysis system is applied to dam construction field.