• Title/Summary/Keyword: Normalized input data

Search Result 112, Processing Time 0.018 seconds

Comparison between Solar Radiation Estimates Based on GK-2A and Himawari 8 Satellite and Observed Solar Radiation at Synoptic Weather Stations (천리안 2A호와 히마와리 8호 기반 일사량 추정값과 종관기상관측망 일사량 관측값 간의 비교)

  • Dae Gyoon Kang;Young Sang Joh;Shinwoo Hyun;Kwang Soo Kim
    • Korean Journal of Agricultural and Forest Meteorology
    • /
    • v.25 no.1
    • /
    • pp.28-36
    • /
    • 2023
  • Solar radiation that is measured at relatively small number of weather stations is one of key inputs to crop models for estimation of crop productivity. Solar radiation products derived from GK-2A and Himawari 8 satellite data have become available, which would allow for preparation of input data to crop models, especially for assessment of crop productivity under an agrivoltaic system where crop and power can be produced at the same time. The objective of this study was to compare the degree of agreement between the solar radiation products obtained from those satellite data. The sub hourly products for solar radiation were collected to prepare their daily summary for the period from May to October in 2020 during which both satellite products for solar radiation were available. Root mean square error (RMSE) and its normalized error (NRMSE) were determined for daily sum of solar radiation. The cumulative values of solar radiation for the study period were also compared to represent the impact of the errors for those products on crop growth simulations. It was found that the data product from the Himawari 8 satellite tended to have smaller values of RMSE and NRMSE than that from the GK-2A satellite. The Himawari 8 satellite product had smaller errors at a large number of weather stations when the cumulative solar radiation was compared with the measurements. This suggests that the use of Himawari 8 satellite products would cause less uncertainty than that of GK2-A products for estimation of crop yield. This merits further studies to apply the Himawari 8 satellites to estimation of solar power generation as well as crop yield under an agrivoltaic system.

Scalable Collaborative Filtering Technique based on Adaptive Clustering (적응형 군집화 기반 확장 용이한 협업 필터링 기법)

  • Lee, O-Joun;Hong, Min-Sung;Lee, Won-Jin;Lee, Jae-Dong
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.2
    • /
    • pp.73-92
    • /
    • 2014
  • An Adaptive Clustering-based Collaborative Filtering Technique was proposed to solve the fundamental problems of collaborative filtering, such as cold-start problems, scalability problems and data sparsity problems. Previous collaborative filtering techniques were carried out according to the recommendations based on the predicted preference of the user to a particular item using a similar item subset and a similar user subset composed based on the preference of users to items. For this reason, if the density of the user preference matrix is low, the reliability of the recommendation system will decrease rapidly. Therefore, the difficulty of creating a similar item subset and similar user subset will be increased. In addition, as the scale of service increases, the time needed to create a similar item subset and similar user subset increases geometrically, and the response time of the recommendation system is then increased. To solve these problems, this paper suggests a collaborative filtering technique that adapts a condition actively to the model and adopts the concepts of a context-based filtering technique. This technique consists of four major methodologies. First, items are made, the users are clustered according their feature vectors, and an inter-cluster preference between each item cluster and user cluster is then assumed. According to this method, the run-time for creating a similar item subset or user subset can be economized, the reliability of a recommendation system can be made higher than that using only the user preference information for creating a similar item subset or similar user subset, and the cold start problem can be partially solved. Second, recommendations are made using the prior composed item and user clusters and inter-cluster preference between each item cluster and user cluster. In this phase, a list of items is made for users by examining the item clusters in the order of the size of the inter-cluster preference of the user cluster, in which the user belongs, and selecting and ranking the items according to the predicted or recorded user preference information. Using this method, the creation of a recommendation model phase bears the highest load of the recommendation system, and it minimizes the load of the recommendation system in run-time. Therefore, the scalability problem and large scale recommendation system can be performed with collaborative filtering, which is highly reliable. Third, the missing user preference information is predicted using the item and user clusters. Using this method, the problem caused by the low density of the user preference matrix can be mitigated. Existing studies on this used an item-based prediction or user-based prediction. In this paper, Hao Ji's idea, which uses both an item-based prediction and user-based prediction, was improved. The reliability of the recommendation service can be improved by combining the predictive values of both techniques by applying the condition of the recommendation model. By predicting the user preference based on the item or user clusters, the time required to predict the user preference can be reduced, and missing user preference in run-time can be predicted. Fourth, the item and user feature vector can be made to learn the following input of the user feedback. This phase applied normalized user feedback to the item and user feature vector. This method can mitigate the problems caused by the use of the concepts of context-based filtering, such as the item and user feature vector based on the user profile and item properties. The problems with using the item and user feature vector are due to the limitation of quantifying the qualitative features of the items and users. Therefore, the elements of the user and item feature vectors are made to match one to one, and if user feedback to a particular item is obtained, it will be applied to the feature vector using the opposite one. Verification of this method was accomplished by comparing the performance with existing hybrid filtering techniques. Two methods were used for verification: MAE(Mean Absolute Error) and response time. Using MAE, this technique was confirmed to improve the reliability of the recommendation system. Using the response time, this technique was found to be suitable for a large scaled recommendation system. This paper suggested an Adaptive Clustering-based Collaborative Filtering Technique with high reliability and low time complexity, but it had some limitations. This technique focused on reducing the time complexity. Hence, an improvement in reliability was not expected. The next topic will be to improve this technique by rule-based filtering.