• Title/Summary/Keyword: random forest (RF)

Search Result 185, Processing Time 0.044 seconds

Estimation of TROPOMI-derived Ground-level SO2 Concentrations Using Machine Learning Over East Asia (기계학습을 활용한 동아시아 지역의 TROPOMI 기반 SO2 지상농도 추정)

  • Choi, Hyunyoung;Kang, Yoojin;Im, Jungho
    • Korean Journal of Remote Sensing
    • /
    • v.37 no.2
    • /
    • pp.275-290
    • /
    • 2021
  • Sulfur dioxide (SO2) in the atmosphere is mainly generated from anthropogenic emission sources. It forms ultra-fine particulate matter through chemical reaction and has harmful effect on both the environment and human health. In particular, ground-level SO2 concentrations are closely related to human activities. Satellite observations such as TROPOMI (TROPOspheric Monitoring Instrument)-derived column density data can provide spatially continuous monitoring of ground-level SO2 concentrations. This study aims to propose a 2-step residual corrected model to estimate ground-level SO2 concentrations through the synergistic use of satellite data and numerical model output. Random forest machine learning was adopted in the 2-step residual corrected model. The proposed model was evaluated through three cross-validations (i.e., random, spatial and temporal). The results showed that the model produced slopes of 1.14-1.25, R values of 0.55-0.65, and relative root-mean-square-error of 58-63%, which were improved by 10% for slopes and 3% for R and rRMSE when compared to the model without residual correction. The model performance by country was slightly reduced in Japan, often resulting in overestimation, where the sample size was small, and the concentration level was relatively low. The spatial and temporal distributions of SO2 produced by the model agreed with those of the in-situ measurements, especially over Yangtze River Delta in China and Seoul Metropolitan Area in South Korea, which are highly dependent on the characteristics of anthropogenic emission sources. The model proposed in this study can be used for long-term monitoring of ground-level SO2 concentrations on both the spatial and temporal domains.

Image Quality Assessment by Combining Masking Texture and Perceptual Color Difference Model

  • Tang, Zhisen;Zheng, Yuanlin;Wang, Wei;Liao, Kaiyang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.7
    • /
    • pp.2938-2956
    • /
    • 2020
  • Objective image quality assessment (IQA) models have been developed by effective features to imitate the characteristics of human visual system (HVS). Actually, HVS is extremely sensitive to color degradation and complex texture changes. In this paper, we firstly reveal that many existing full reference image quality assessment (FR-IQA) methods can hardly measure the image quality with contrast and masking texture changes. To solve this problem, considering texture masking effect, we proposed a novel FR-IQA method, called Texture and Color Quality Index (TCQI). The proposed method considers both in the masking effect texture and color visual perceptual threshold, which adopts three kinds of features to reflect masking texture, color difference and structural information. Furthermore, random forest (RF) is used to address the drawbacks of existing pooling technologies. Compared with other traditional learning-based tools (support vector regression and neural network), RF can achieve the better prediction performance. Experiments conducted on five large-scale databases demonstrate that our approach is highly consistent with subjective perception, outperforms twelve the state-of-the-art IQA models in terms of prediction accuracy and keeps a moderate computational complexity. The cross database validation also validates our approach achieves the ability to maintain high robustness.

Analysis of Algal Bloom Occurrence Characteristics Namyang Lake using Sentinel-2 MSI (Sentinel-2 MSI를 활용한 남양 간척담수호의 조류발생 특성 분석)

  • Wonjin Jang;Jinuk Kim;Jiwan Lee;Yongeun Park;Seongjoon Kim
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2023.05a
    • /
    • pp.56-56
    • /
    • 2023
  • 남양호는 농업용수 공급을 위해 건설된 하구 담수호로 과도한 영양물질 축적으로 인해 매년 여름 녹조류가 번성한다. 따라서 본 연구에서는 조류발생 특성을 분석하고자 식물성 플랑크톤 및 관련 분해 산물에 의해 고유 광학특성을 가지고 있는 Chlorophyll-a(Chl-a)의 추정을 통한 녹조 발생을 파악하고자 Sentinel-2 Multi Spectral Image(MSI)의 원격 반사율 광학 스펙트럼을 사용하였다. Chl-a 추정알고리즘 개발을 위하여 Sentinel-2 A, B의 교차 방문주기인 5일 간격에 맞추어 현장수질자료(2022년: 27회 2023년: 27회)를 측정하였다. Chl-a 농도는 EXO-YSI를이용하여 측정하였으며 해당기간동안 9.4 ~ 127.1 mg/L의 범위를 보였으며, Sentine-2 자료는 A, B자료에서 B1(443 nm) ~ B8A(865 nm)파장의 값을 기상조건(구름, 안개, 강수)을 고려하여 현장수질측정 위치에서 반사도를 추출하였다. 입력자료는 대기 및 방사영향을 고려해 반사도 간의 비율자료와 선행연구에서 활용된 반사도를 활용하였으며 알고리즘은 다중선형회귀분석(Multi Linear Regression Model)과 Random Forest를 활용하였다. MLR의 경우 결정계수(R2)가 학습 및 검증에서 각각 0.68, 0.59의 성능을 보였으며, RF의 경우 각각 0.94, 0.85의 성능을 보였다. 해당알고리즘으로 생성된 Chl-a 시공간농도 자료는 담수호내 조류발생 특성을 분석하고 효율적 조류관리 및 대처에 활용될 것으로 판단된다.

  • PDF

Projecting the spatial-temporal trends of extreme climatology in South Korea based on optimal multi-model ensemble members

  • Mirza Junaid Ahmad;Kyung-sook Choi
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2023.05a
    • /
    • pp.314-314
    • /
    • 2023
  • Extreme climate events can have a large impact on human life by hampering social, environmental, and economic development. Global circulation models (GCMs) are the widely used numerical models to understand the anticipated future climate change. However, different GCMs can project different future climates due to structural differences, varying initial boundary conditions and assumptions about the physical phenomena. The multi-model ensemble (MME) approach can improve the uncertainties associated with the different GCM outcomes. In this study, a comprehensive rating metric was used to select the best-performing GCMs out of 11 CMIP5 and 13 CMIP6 GCMs, according to their skills in terms of four temporal and five spatial performance indices, in replicating the 21 extreme climate indices during the baseline (1975-2017) in South Korea. The MME data were derived by averaging the simulations from all selected GCMs and three top-ranked GCMs. The random forest (RF) algorithm was also used to derive the MME data from the three top-ranked GCMs. The RF-derived MME data of the three top-ranked GCMs showed the highest performance in simulating the baseline extreme climate which was subsequently used to project the future extreme climate indices under both the representative concentration pathway (RCP) and the socioeconomic concentration pathway scenarios (SSP). The extreme cold and warming indices had declining and increasing trends, respectively, and most extreme precipitation indices had increasing trends over the period 2031-2100. Compared to all scenarios, RCP8.5 showed drastic changes in future extreme climate indices. The coasts in the east, south and west had stronger warming than the rest of the country, while mountain areas in the north experienced more extreme cold. While extreme cold climatology gradually declined from north to south, extreme warming climatology continuously grew from coastal to inland and northern mountainous regions. The results showed that the socially, environmentally and agriculturally important regions of South Korea were at increased risk of facing the detrimental impacts of extreme climatology.

  • PDF

Estimation of Chlorophyll-a via harmonized landsat sentinel-2 (HLS) datasets (Harmonized Landsat Sentinel-2 (HLS) 위성자료를 활용한 클로로필-a 추정)

  • Jongmin Park
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2023.05a
    • /
    • pp.400-400
    • /
    • 2023
  • 급격한 기후변화로 인해 일사량, 지표면 온도 및 이산화탄소 농도가 꾸준히 상승함에 따라 수문 순환의 불균형을 초래함과 하천 및 호소 내 수질 또한 악화되고 있는 추세이다. 특히, 국내의 경우, 기후변화 및 인위적 요인에 의해 하천 및 호소에서의 수위 감소 및 수온 증가로 인해 부영양화가 증가되고 있고, 이로 인한 유해 녹조의 발생빈도를 높이는 결과를 초래한다. 현재 국내에서는 유인 수질 관측 및 자동 수질관측 시스템을 통해 주요 수질인자를 모니터링 하고 있으나 시·공간적인 변동성을 파악하는데 제한점이 있다. 이러한 한계점을 극복하기 위해 국·내외에서 광학위성을 이용한 수질인자 추정 알고리즘 개발과 관련된 연구들이 진행되고 있다. 이에 따라, 본 연구에서는 NASA에서 제공하는 Landsat-8 위성과 ESA에서 제공하는 Sentinel-2자료가 동화된 Harmonized Landsat Sentinel-2 위성자료를 활용한 클로로필-a (Chl-a)를 추정하고자 한다. 이를 위해, 본 연구에서는 1) 단순 회귀 분석, 2) Akaike information criteria (AIC) 기반 최적화 회귀 분석 및 3) Random forest (RF)를 활용하였다. 또한, HLS 위성 자료의 적용성을 평가하기 위해 미국 오하이오 주에 위치하고 있는 130여개의 중규모 및 대규모 호소에서 2000년부터 2021년까지 수집된 클로로필-a 관측치를 활용하였다. 두 가지 수질 추정 모형에 대한 정확도 검증에 앞서 오하이오 주 내에서의 클로로필-a의 시계열적 변동성에 대하여 분석하였다. 전반적으로, 2000년부터 2016년까지는 Chl-a가 꾸준히 증가하는 경향성을 나타내었으나, 그 이후로는 감소하는 추세를 나타내었다. 이를 기반으로, 각 방법론을 통해서 나온 Chl-a 추정치에 대해서 통계적 검증을 수행하였다. 결과, 단순 회귀 분석을 통해 추청된 Chl-a값의 결정계수는 0.34였지만, AIC 기반 모델과 RF모형을 사용한 결과 결정계수가 각각 0.82와 0.92로 향상된 것을 확인할 수 있었다. 이와 더불어, spatial 및 temporal window와 더불어 호소의 크기에 따른 정확도 분석 또한 수행하였다. 그 결과, temporal window 가 정확도에 가장 큰 영향을 미치는 것으로 나타났으며, 호소의 크기가 작을수록 정확도가 낮아지는 것을 확인 할 수 있었다. 본 연구의 결과를 토대로 추후 국내 호소에 대해 상기 모형들의 적용성 평가를 수행하여 효율적인 수질 모니터링 시스템 구축으로 이어질 수 있을 것으로 기대된다.

  • PDF

Comparison of Chlorophyll-a Prediction and Analysis of Influential Factors in Yeongsan River Using Machine Learning and Deep Learning (머신러닝과 딥러닝을 이용한 영산강의 Chlorophyll-a 예측 성능 비교 및 변화 요인 분석)

  • Sun-Hee, Shim;Yu-Heun, Kim;Hye Won, Lee;Min, Kim;Jung Hyun, Choi
    • Journal of Korean Society on Water Environment
    • /
    • v.38 no.6
    • /
    • pp.292-305
    • /
    • 2022
  • The Yeongsan River, one of the four largest rivers in South Korea, has been facing difficulties with water quality management with respect to algal bloom. The algal bloom menace has become bigger, especially after the construction of two weirs in the mainstream of the Yeongsan River. Therefore, the prediction and factor analysis of Chlorophyll-a (Chl-a) concentration is needed for effective water quality management. In this study, Chl-a prediction model was developed, and the performance evaluated using machine and deep learning methods, such as Deep Neural Network (DNN), Random Forest (RF), and eXtreme Gradient Boosting (XGBoost). Moreover, the correlation analysis and the feature importance results were compared to identify the major factors affecting the concentration of Chl-a. All models showed high prediction performance with an R2 value of 0.9 or higher. In particular, XGBoost showed the highest prediction accuracy of 0.95 in the test data.The results of feature importance suggested that Ammonia (NH3-N) and Phosphate (PO4-P) were common major factors for the three models to manage Chl-a concentration. From the results, it was confirmed that three machine learning methods, DNN, RF, and XGBoost are powerful methods for predicting water quality parameters. Also, the comparison between feature importance and correlation analysis would present a more accurate assessment of the important major factors.

Comparison of Solar Power Generation Forecasting Performance in Daejeon and Busan Based on Preprocessing Methods and Artificial Intelligence Techniques: Using Meteorological Observation and Forecast Data (전처리 방법과 인공지능 모델 차이에 따른 대전과 부산의 태양광 발전량 예측성능 비교: 기상관측자료와 예보자료를 이용하여)

  • Chae-Yeon Shim;Gyeong-Min Baek;Hyun-Su Park;Jong-Yeon Park
    • Atmosphere
    • /
    • v.34 no.2
    • /
    • pp.177-185
    • /
    • 2024
  • As increasing global interest in renewable energy due to the ongoing climate crisis, there is a growing need for efficient technologies to manage such resources. This study focuses on the predictive skill of daily solar power generation using weather observation and forecast data. Meteorological data from the Korea Meteorological Administration and solar power generation data from the Korea Power Exchange were utilized for the period from January 2017 to May 2023, considering both inland (Daejeon) and coastal (Busan) regions. Temperature, wind speed, relative humidity, and precipitation were selected as relevant meteorological variables for solar power prediction. All data was preprocessed by removing their systematic components to use only their residuals and the residual of solar data were further processed with weighted adjustments for homoscedasticity. Four models, MLR (Multiple Linear Regression), RF (Random Forest), DNN (Deep Neural Network), and RNN (Recurrent Neural Network), were employed for solar power prediction and their performances were evaluated based on predicted values utilizing observed meteorological data (used as a reference), 1-day-ahead forecast data (referred to as fore1), and 2-day-ahead forecast data (fore2). DNN-based prediction model exhibits superior performance in both regions, with RNN performing the least effectively. However, MLR and RF demonstrate competitive performance comparable to DNN. The disparities in the performance of the four different models are less pronounced than anticipated, underscoring the pivotal role of fitting models using residuals. This emphasizes that the utilized preprocessing approach, specifically leveraging residuals, is poised to play a crucial role in the future of solar power generation forecasting.

Hybrid machine learning with HHO method for estimating ultimate shear strength of both rectangular and circular RC columns

  • Quang-Viet Vu;Van-Thanh Pham;Dai-Nhan Le;Zhengyi Kong;George Papazafeiropoulos;Viet-Ngoc Pham
    • Steel and Composite Structures
    • /
    • v.52 no.2
    • /
    • pp.145-163
    • /
    • 2024
  • This paper presents six novel hybrid machine learning (ML) models that combine support vector machines (SVM), Decision Tree (DT), Random Forest (RF), Gradient Boosting (GB), extreme gradient boosting (XGB), and categorical gradient boosting (CGB) with the Harris Hawks Optimization (HHO) algorithm. These models, namely HHO-SVM, HHO-DT, HHO-RF, HHO-GB, HHO-XGB, and HHO-CGB, are designed to predict the ultimate strength of both rectangular and circular reinforced concrete (RC) columns. The prediction models are established using a comprehensive database consisting of 325 experimental data for rectangular columns and 172 experimental data for circular columns. The ML model hyperparameters are optimized through a combination of cross-validation technique and the HHO. The performance of the hybrid ML models is evaluated and compared using various metrics, ultimately identifying the HHO-CGB model as the top-performing model for predicting the ultimate shear strength of both rectangular and circular RC columns. The mean R-value and mean a20-index are relatively high, reaching 0.991 and 0.959, respectively, while the mean absolute error and root mean square error are low (10.302 kN and 27.954 kN, respectively). Another comparison is conducted with four existing formulas to further validate the efficiency of the proposed HHO-CGB model. The Shapely Additive Explanations method is applied to analyze the contribution of each variable to the output within the HHO-CGB model, providing insights into the local and global influence of variables. The analysis reveals that the depth of the column, length of the column, and axial loading exert the most significant influence on the ultimate shear strength of RC columns. A user-friendly graphical interface tool is then developed based on the HHO-CGB to facilitate practical and cost-effective usage.

Study on Prediction of Attendance Using Machine Learning (머신러닝을 이용한 관중 수요 예측에 관한 연구)

  • Yoo, Ji-Hyun
    • Journal of IKEEE
    • /
    • v.23 no.4
    • /
    • pp.1243-1249
    • /
    • 2019
  • People who gathered to enjoy a specific event or content are called audiences or spectators, and show various propensity according to the characteristics of the crowd. Although there is such a difference, in general, the number of attendance is directly related to the business aspect, which enables stable financial operation for the sale of contents through various incomes, such as the admission fee and the use of other facilities. Therefore, prediction of audience can be used as a major factor in marketing and budgeting strategies. In this study, we review several existing models for predicting the number of attendance and propose an efficient machine learning model. In addition, we studied daily attendance prediction and abnormal attendance prediction using combine DNN(Deep Neural Network) and RF(Random Forest) model.

Machine Learning Approaches to Corn Yield Estimation Using Satellite Images and Climate Data: A Case of Iowa State

  • Kim, Nari;Lee, Yang-Won
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.34 no.4
    • /
    • pp.383-390
    • /
    • 2016
  • Remote sensing data has been widely used in the estimation of crop yields by employing statistical methods such as regression model. Machine learning, which is an efficient empirical method for classification and prediction, is another approach to crop yield estimation. This paper described the corn yield estimation in Iowa State using four machine learning approaches such as SVM (Support Vector Machine), RF (Random Forest), ERT (Extremely Randomized Trees) and DL (Deep Learning). Also, comparisons of the validation statistics among them were presented. To examine the seasonal sensitivities of the corn yields, three period groups were set up: (1) MJJAS (May to September), (2) JA (July and August) and (3) OC (optimal combination of month). In overall, the DL method showed the highest accuracies in terms of the correlation coefficient for the three period groups. The accuracies were relatively favorable in the OC group, which indicates the optimal combination of month can be significant in statistical modeling of crop yields. The differences between our predictions and USDA (United States Department of Agriculture) statistics were about 6-8 %, which shows the machine learning approaches can be a viable option for crop yield modeling. In particular, the DL showed more stable results by overcoming the overfitting problem of generic machine learning methods.