• Korean Journal of Remote Sensing
• /
• v.37 no.2
• /
• pp.321-335
• /
• 2021

Particulate matter (PM10 and PM2.5 with a diameter less than 10 and 2.5 ㎛, respectively) can be absorbed by the human body and adversely affect human health. Although most of the PM monitoring are based on ground-based observations, they are limited to point-based measurement sites, which leads to uncertainty in PM estimation for regions without observation sites. It is possible to overcome their spatial limitation by using satellite data. In this study, we developed machine learning-based retrieval algorithm for ground-level PM10 and PM2.5 concentrations using aerosol parameters from Geostationary Ocean Color Imager (GOCI) satellite and various meteorological parameters from a numerical weather prediction model during January to December of 2019. Gradient Boosted Regression Trees (GBRT) and Light Gradient Boosting Machine (LightGBM) were used to estimate PM concentrations. The model performances were examined for two types of feature sets-all input parameters (Feature set 1) and a subset of input parameters without meteorological and land-cover parameters (Feature set 2). Both models showed higher accuracy (about 10 % higher in R2) by using the Feature set 1 than the Feature set 2. The GBRT model using Feature set 1 was chosen as the final model for further analysis(PM10: R2 = 0.82, nRMSE = 34.9 %, PM2.5: R2 = 0.75, nRMSE = 35.6 %). The spatial distribution of the seasonal and annual-averaged PM concentrations was similar with in-situ observations, except for the northeastern part of China with bright surface reflectance. Their spatial distribution and seasonal changes were well matched with in-situ measurements.

• Korean Journal of Remote Sensing
• /
• v.39 no.5_1
• /
• pp.655-667
• /
• 2023

Algal bloom outbreaks are frequently reported around the world, and serious water pollution problems arise every year in Korea. It is necessary to protect the aquatic ecosystem through continuous management and rapid response. Many studies using satellite images are being conducted to estimate the concentration of chlorophyll-a (Chl-a), an indicator of algal bloom occurrence. However, machine learning models have recently been used because it is difficult to accurately calculate Chl-a due to the spectral characteristics and atmospheric correction errors that change depending on the water system. It is necessary to consider the factors affecting algal bloom as well as the satellite spectral index. Therefore, this study constructed a dataset by considering water quality, hydrological and meteorological factors, and sentinel-2 images in combination. Representative ensemble models random forest and extreme gradient boosting (XGBoost) were used to predict the concentration of Chl-a in eight weirs located on the Nakdong river over the past five years. R-squared score (R²), root mean square errors (RMSE), and mean absolute errors (MAE) were used as model evaluation indicators, and it was confirmed that R² of XGBoost was 0.80, RMSE was 6.612, and MAE was 4.457. Shapley additive expansion analysis showed that water quality factors, suspended solids, biochemical oxygen demand, dissolved oxygen, and the band ratio using red edge bands were of high importance in both models. Various input data were confirmed to help improve model performance, and it seems that it can be applied to domestic and international algal bloom detection.

• Journal of Intelligence and Information Systems
• /
• v.24 no.3
• /
• pp.21-44
• /
• 2018

In recent years, the rapid development of internet technology and the popularization of smart devices have resulted in massive amounts of text data. Those text data were produced and distributed through various media platforms such as World Wide Web, Internet news feeds, microblog, and social media. However, this enormous amount of easily obtained information is lack of organization. Therefore, this problem has raised the interest of many researchers in order to manage this huge amount of information. Further, this problem also required professionals that are capable of classifying relevant information and hence text classification is introduced. Text classification is a challenging task in modern data analysis, which it needs to assign a text document into one or more predefined categories or classes. In text classification field, there are different kinds of techniques available such as K-Nearest Neighbor, Naïve Bayes Algorithm, Support Vector Machine, Decision Tree, and Artificial Neural Network. However, while dealing with huge amount of text data, model performance and accuracy becomes a challenge. According to the type of words used in the corpus and type of features created for classification, the performance of a text classification model can be varied. Most of the attempts are been made based on proposing a new algorithm or modifying an existing algorithm. This kind of research can be said already reached their certain limitations for further improvements. In this study, aside from proposing a new algorithm or modifying the algorithm, we focus on searching a way to modify the use of data. It is widely known that classifier performance is influenced by the quality of training data upon which this classifier is built. The real world datasets in most of the time contain noise, or in other words noisy data, these can actually affect the decision made by the classifiers built from these data. In this study, we consider that the data from different domains, which is heterogeneous data might have the characteristics of noise which can be utilized in the classification process. In order to build the classifier, machine learning algorithm is performed based on the assumption that the characteristics of training data and target data are the same or very similar to each other. However, in the case of unstructured data such as text, the features are determined according to the vocabularies included in the document. If the viewpoints of the learning data and target data are different, the features may be appearing different between these two data. In this study, we attempt to improve the classification accuracy by strengthening the robustness of the document classifier through artificially injecting the noise into the process of constructing the document classifier. With data coming from various kind of sources, these data are likely formatted differently. These cause difficulties for traditional machine learning algorithms because they are not developed to recognize different type of data representation at one time and to put them together in same generalization. Therefore, in order to utilize heterogeneous data in the learning process of document classifier, we apply semi-supervised learning in our study. However, unlabeled data might have the possibility to degrade the performance of the document classifier. Therefore, we further proposed a method called Rule Selection-Based Ensemble Semi-Supervised Learning Algorithm (RSESLA) to select only the documents that contributing to the accuracy improvement of the classifier. RSESLA creates multiple views by manipulating the features using different types of classification models and different types of heterogeneous data. The most confident classification rules will be selected and applied for the final decision making. In this paper, three different types of real-world data sources were used, which are news, twitter and blogs.

• Korean Journal of Agricultural and Forest Meteorology
• /
• v.16 no.2
• /
• pp.103-113
• /
• 2014

Under climate change, it is likely that the suitable area for forage crop cultivation would change in Korea. The potential cultivation areas for italian ryegrass (Lolium multiflorum L.), which has been considered one of an important forage crop in Korea, were identified using the EcoCrop model. To minimize the uncertainty associated with future projection under climate change, an ensemble approach was attempted using five climate change scenarios as inputs to the EcoCrop model. Our results indicated that most districts had relatively high suitability, e.g., >80, for italian ryegrass in South Korea. Still, suitability of the crop was considerably low in mountainous areas because it was assumed that a given variety of italian ryegrass had limited cold tolerance. It was predicted that suitability of italian ryegrass would increase until 2050s but decrease in 2080s in a relatively large number of regions due to high temperature. In North Korea, suitability of italian ryegrass was considerably low, e.g., 28 on average. Under climate change, however, it was projected that suitability of italian ryegrass would increase until 2080s. For example, suitability of italian ryegrass was more than 80 in 10 districts out of 14 by 2080s. Because cold tolerance of italian ryegrass varieties has been improved, it would be preferable to optimize parameters of the EcoCrop model for those varieties. In addition, it would be possible to grow italian ryegrass as the second crop following rice in Korea in the future. Thus, it merits further study to identify suitable areas for italian ryegrass cultivation after rice using new varieties of italian ryegrass.

• Journal of Intelligence and Information Systems
• /
• v.29 no.3
• /
• pp.145-165
• /
• 2023

Recommendation system plays a significant role on relieving difficulties of selecting information among rapidly increasing amount of information caused by the development of the Internet and on efficiently displaying information that fits individual personal interest. In particular, without the help of recommendation system, E-commerce and OTT companies cannot overcome the long-tail phenomenon, a phenomenon in which only popular products are consumed, as the number of products and contents are rapidly increasing. Therefore, the research on recommendation systems is being actively conducted to overcome the phenomenon and to provide information or contents that are aligned with users' individual interests, in order to induce customers to consume various products or contents. Usually, collaborative filtering which utilizes users' historical behavioral data shows better performance than contents-based filtering which utilizes users' preferred contents. However, collaborative filtering can suffer from cold-start problem which occurs when there is lack of users' historical behavioral data. In this paper, hybrid music recommendation system, which can solve cold-start problem, is proposed based on the playlist data of Melon music streaming service that is given by Kakao Arena for music playlist continuation competition. The goal of this research is to use music tracks, that are included in the playlists, and metadata of music tracks and playlists in order to predict other music tracks when the half or whole of the tracks are masked. Therefore, two different recommendation procedures were conducted depending on the two different situations. When music tracks are included in the playlist, LightFM is used in order to utilize the music track list of the playlists and metadata of each music tracks. Then, the result of Item2Vec model, which uses vector embeddings of music tracks, tags and titles for recommendation, is combined with the result of LightFM model to create final recommendation list. When there are no music tracks available in the playlists but only playlists' tags and titles are available, recommendation was made by finding similar playlists based on playlists vectors which was made by the aggregation of FastText pre-trained embedding vectors of tags and titles of each playlists. As a result, not only cold-start problem can be resolved, but also achieved better performance than ALS, BPR and Item2Vec by using the metadata of both music tracks and playlists. In addition, it was found that the LightFM model, which uses only artist information as an item feature, shows the best performance compared to other LightFM models which use other item features of music tracks.

• Journal of KIISE
• /
• v.43 no.10
• /
• pp.1085-1093
• /
• 2016

Community-based Question Answering system is a system which provides answers for each question from the documents uploaded on web communities. In order to enhance the capacity of question analysis, former methods have developed specific rules suitable for a target region or have applied machine learning to partial processes. However, these methods incur an excessive cost for expanding fields or lead to cases in which system is overfitted for a specific field. This paper proposes a multiple machine learning method which automates the overall process by adapting appropriate machine learning in each procedure for efficient processing of community-based Question Answering system. This system can be divided into question analysis part and answer selection part. The question analysis part consists of the question focus extractor, which analyzes the focused phrases in questions and uses conditional random fields, and the question type classifier, which classifies topics of questions and uses support vector machine. In the answer selection part, the we trains weights that are used by the similarity estimation models through an artificial neural network. Also these are a number of cases in which the results of morphological analysis are not reliable for the data uploaded on web communities. Therefore, we suggest a method that minimizes the impact of morphological analysis by using character features in the stage of question analysis. The proposed system outperforms the former system by showing a Mean Average Precision criteria of 0.765 and R-Precision criteria of 0.872.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.40 no.1
• /
• pp.19-29
• /
• 2003

This paper presents a novel hybrid classifier for face recognition with artificially generated virtual training samples. We utilize both the nearest neighbor approach in feature angle space and a connectionist model to obtain a synergy effect by combining the results of two heterogeneous classifiers. First, a classifier called the nearest feature angle (NFA), based on angular information, finds the most similar feature to the query from a given training set. Second, a classifier has been developed based on the recall of stored frontal projection of the query feature. It uses a frontal recall network (FRN) that finds the most similar frontal one among the stored frontal feature set. For FRN, we used an ensemble neural network consisting of multiple multiplayer perceptrons (MLPs), each of which is trained independently to enhance generalization capability. Further, both classifiers used the virtual training set generated adaptively, according to the spatial distribution of each person's training samples. Finally, the results of the two classifiers are combined to comprise the best matching class, and a corresponding similarit measure is used to make the final decision. The proposed classifier achieved an average classification rate of 96.33% against a large group of different test sets of images, and its average error rate is 61.5% that of the nearest feature line (NFL) method, and achieves a more robust classification performance.

• Journal of Korea Water Resources Association
• /
• v.56 no.9
• /
• pp.529-541
• /
• 2023

Due to the growing concern over forecasting extreme weather events such as droughts caused by climate change, there has been a rising interest in seasonal meteorological forecasts that offer ensemble predictions for the upcoming seven months. Nonetheless, limited research has been conducted in South Korea, particularly in assessing their effectiveness at the catchment-scale. In this study, we assessed the accuracy of ECMWF's seasonal forecasts (including precipitation, temperature, and evapotranspiration) for the period of 2011 to 2020. We focused on 12 multi-purpose reservoir catchments and compared the forecasts to climatology data. Continuous Ranked Probability Skill Score method is adopted to assess the forecast skill, and the linear scaling method was applied to evaluate its impact. The results showed that while the seasonal meteorological forecasts have similar skill to climatology for one month ahead, the skill decreased significantly as the forecast lead time increased. Compared to the climatology, better results were obtained in the Wet season than the Dry season. In particular, during the Wet seasons of the dry years (2015, 2017), the seasonal meteorological forecasts showed the highest skill for all lead times.

• Korean Journal of Environmental Biology
• /
• v.40 no.4
• /
• pp.567-578
• /
• 2022

Various social and environmental problems have recently emerged due to global climate change. In South Korea, coniferous forests in the highlands are decreasing due to climate change whereas the distribution of subtropical species is gradually increasing. This study aims to respond to changes in the distribution of forest species in South Korea due to climate change. This study predicts changes in future suitable areas for Pinus koraiensis, Cryptomeria japonica, and Chamaecyparis obtusa cultivated as timber species based on climate, topography, and environment. Appearance coordinates were collected only for natural forests in consideration of climate suitability in the National Forest Inventory. Future climate data used the SSP scenario by KMA. Species distribution models were ensembled to predict future suitable habitat areas for the base year(2000-2019), near future(2041-2060), and distant future(2081-2100). In the baseline period, the highly suitable habitat for Pinus koraiensis accounted for approximately 13.87% of the country. However, in the distant future(2081-2100), it decreased to approximately 0.11% under SSP5-8.5. For Cryptomeria japonica, the habitat for the base year was approximately 7.08%. It increased to approximately 18.21% under SSP5-8.5 in the distant future. In the case of Chamaecyparis obtusa, the habitat for the base year was approximately 19.32%. It increased to approximately 90.93% under SSP5-8.5 in the distant future. Pinus koraiensis, which had been planted nationwide, gradually moved north due to climate change with suitable habitats in South Korea decreased significantly. After the near future, Pinus koraiensis was not suitable for the afforestation as timber species in South Korea. Chamaecyparis obtusa can be replaced in most areas. In the case of Cryptomeria japonica, it was assessed that it could replace part of the south and central region.

• The Journal of Bigdata
• /
• v.6 no.2
• /
• pp.71-84
• /
• 2021

Since small and medium-sized enterprises fell short of the securement of technological competitiveness in the field of big data and artificial intelligence (AI) field-core technologies of the Fourth Industrial Revolution, it is important to strengthen the competitiveness of the overall industry through technology commercialization. In this study, we aimed to propose a priority related to technology transfer and commercialization for practical use of public research results. We utilized public research performance information, improving missing values of 6T classification by deep learning model with an ensemble method. Then, we conducted topic modeling to derive the converging fields of big data and AI. We classified the technology fields into four different segments in the technology portfolio based on technology activity and technology efficiency, estimating the potential of technology commercialization for those fields. We proposed a priority of technology commercialization for 10 detailed technology fields that require long-term investment. Through systematic analysis, active utilization of technology, and efficient technology transfer and commercialization can be promoted.