• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.35 no.2
• /
• pp.319-326
• /
• 2015

Rainfall data is necessary component for water resources design and flood warning system. Most analysis are used long-term hourly data of surface synoptic stations from the Meteorological Administration, Ministry of land, Infrastructure and Transport and others. However, It will be used minutely data of more high density automatic weather stations than surface synoptic stations expecting to increase the frequency of heavy precipitation. But minutely data has a problem about quality of rainfall data by auto observation. This study analyzed about quality control method using automatic weather station's minutely rainfall data of meteorological administration. It was performed assessment of the quality control that was classified quality control of miss Data, outlier data and rainfall interpolation. This method will be utilized when hydrological analysis uses minute rainfall data.

• Journal of the Economic Geographical Society of Korea
• /
• v.25 no.1
• /
• pp.171-181
• /
• 2022

The real estate price index plays key roles as quantitative data in real estate market analysis. International organizations including OECD publish the real estate price indexes by country, and the Korea Real Estate Board announces metropolitan-level and municipal-level indexes. However, when the index is set on the smaller spatial unit level than metropolitan and municipal-level, problems occur: missing values. As the spatial scope is narrowed down, there are cases where there are few or no transactions depending on the unit period, which lead index calculation difficult or even impossible. This study suggests a supervised learning-based machine learning model to compensate for missing values that may occur due to no transaction in a specific range and period. The models proposed in our research verify the accuracy of predicting the existing values and missing values.

• Journal of Korea Water Resources Association
• /
• v.53 no.11
• /
• pp.929-938
• /
• 2020

In this study, we estimated missing evapotranspiration (ET) data at a eddy-covariance flux tower in the Cheongmicheon farmland site using the Artificial Neural Network (ANN). The ANN showed excellent performance in numerical analysis and is expanding in various fields. To evaluate the performance the ANN-based gap-filling, ET was calculated using the existing gap-filling methods of Mean Diagnostic Variation (MDV) and Food and Aggregation Organization Penman-Monteith (FAO-PM). Then ET was evaluated by time series method and statistical analysis (coefficient of determination, index of agreement (IOA), root mean squared error (RMSE) and mean absolute error (MAE). For the validation of each gap-filling model, we used 30 minutes of data in 2015. Of the 121 missing values, the ANN method showed the best performance by supplementing 70, 53 and 84 missing values, respectively, in the order of MDV, FAO-PM, and ANN methods. Analysis of the coefficient of determination (MDV, FAO-PM, and ANN methods followed by 0.673, 0.784, and 0.841, respectively.) and the IOA (The MDV, FAO-PM, and ANN methods followed by 0.899, 0.890, and 0.951 respectively.) indicated that, all three methods were highly correlated and considered to be fully utilized, and among them, ANN models showed the highest performance and suitability. Based on this study, it could be used more appropriately in the study of gap-filling method of flux tower data using machine learning method.

• Journal of KIISE:Software and Applications
• /
• v.30 no.3_4
• /
• pp.316-325
• /
• 2003

A user preference prediction method using an exiting collaborative filtering technique has used the nearest-neighborhood method based on the user preference about items and has sought the user's similarity from the Pearson correlation coefficient. Therefore, it does not reflect any contents about items and also solve the problem of the sparsity. This study suggests the preference prediction system using the similarity weight granted Bayesian estimated value and the associative user clustering to complement problems of an exiting collaborative preference prediction method. This method suggested in this paper groups the user according to the Genre by using Association Rule Hypergraph Partitioning Algorithm and the new user is classified into one of these Genres by Naive Bayes classifier to slove the problem of sparsity in the collaborative filtering system. Besides, for get the similarity between users belonged to the classified genre and new users, this study allows the different estimated value to item which user vote through Naive Bayes learning. If the preference with estimated value is applied to the exiting Pearson correlation coefficient, it is able to promote the precision of the prediction by reducing the error of the prediction because of missing value. To estimate the performance of suggested method, the suggested method is compared with existing collaborative filtering techniques. As a result, the proposed method is efficient for improving the accuracy of prediction through solving problems of existing collaborative filtering techniques.

• Journal of Korea Water Resources Association
• /
• v.48 no.4
• /
• pp.245-255
• /
• 2015

This study used high density network of integrated meteorological sensor, which are operated by SK Planet, with KMA weather stations to estimate the quantitative precipitation field in Seoul area. We introduced SK Planet network and analyzed quality of the observed data for 3 months data from 1 July to 30 September 2013. As the quality analysis result, we checked most SK Planet stations observed similar with previous KMA stations. We developed the real-time quality check and adjustment method to reduce the error effect for hydrological application by missing and outlier value and we confirmed the developed method can be corrected the missing and outlier value. Through this method, we used the 190 stations(KMA 34 stations, SK Planet 156 stations) that missing ratio is less than 20% and the effect of the outlier was the smallest for quantitative precipitation estimation. Moreover, we evaluated reproducibility of rainfall field high density rain gauge network has $3km^2$/gauge. As the result, the spatial relative frequency of rainfall field using SK Planet and KMA stations is similar with radar rainfall field. And, it supplement the blank of KMA observation network. Especially, through this research we will take advantage of the density of the network to estimate rainfall field which can be considered as a very good approximation of the true value.

• The KIPS Transactions:PartB
• /
• v.10B no.3
• /
• pp.287-296
• /
• 2003

There has been much research focused on collaborative filtering technique in Recommender System. However, these studies have shown the First-Rater Problem and the Sparsity Problem. The main purpose of this Paper is to solve these Problems. In this Paper, we suggest the user's predicting preference method using Bayesian estimated value and the associative user clustering for the recalculation of preference. In addition to this method, to complement a shortcoming, which doesn't regard the attribution of item, we use Representative Attribute-Neighborhood method that is used for the prediction when we find the similar neighborhood through extracting the representative attribution, which most affect the preference. We improved the efficiency by using the associative user's clustering analysis in order to calculate the preference of specific item within the cluster item vector to the collaborative filtering algorithm. Besides, for the problem of the Sparsity and First-Rater, through using Association Rule Hypergraph Partitioning algorithm associative users are clustered according to the genre. New users are classified into one of these genres by Naive Bayes classifier. In addition, in order to get the similarity value between users belonged to the classified genre and new users, and this paper allows the different estimated value to item which user evaluated through Naive Bayes learning. As applying the preference granted the estimated value to Pearson correlation coefficient, it can make the higher accuracy because the errors that cause the missing value come less. We evaluate our method on a large collaborative filtering database of user rating and it significantly outperforms previous proposed method.