• Title/Summary/Keyword: frequency forecasting

Search Result 161, Processing Time 0.025 seconds

Research of Water-related Disaster Monitoring Using Satellite Bigdata Based on Google Earth Engine Cloud Computing Platform (구글어스엔진 클라우드 컴퓨팅 플랫폼 기반 위성 빅데이터를 활용한 수재해 모니터링 연구)

  • Park, Jongsoo;Kang, Ki-mook
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_3
    • /
    • pp.1761-1775
    • /
    • 2022
  • Due to unpredictable climate change, the frequency of occurrence of water-related disasters and the scale of damage are also continuously increasing. In terms of disaster management, it is essential to identify the damaged area in a wide area and monitor for mid-term and long-term forecasting. In the field of water disasters, research on remote sensing technology using Synthetic Aperture Radar (SAR) satellite images for wide-area monitoring is being actively conducted. Time-series analysis for monitoring requires a complex preprocessing process that collects a large amount of images and considers the noisy radar characteristics, and for this, a considerable amount of time is required. With the recent development of cloud computing technology, many platforms capable of performing spatiotemporal analysis using satellite big data have been proposed. Google Earth Engine (GEE)is a representative platform that provides about 600 satellite data for free and enables semi real time space time analysis based on the analysis preparation data of satellite images. Therefore, in this study, immediate water disaster damage detection and mid to long term time series observation studies were conducted using GEE. Through the Otsu technique, which is mainly used for change detection, changes in river width and flood area due to river flooding were confirmed, centered on the torrential rains that occurred in 2020. In addition, in terms of disaster management, the change trend of the time series waterbody from 2018 to 2022 was confirmed. The short processing time through javascript based coding, and the strength of spatiotemporal analysis and result expression, are expected to enable use in the field of water disasters. In addition, it is expected that the field of application will be expanded through connection with various satellite bigdata in the future.

Application of convolutional autoencoder for spatiotemporal bias-correction of radar precipitation (CAE 알고리즘을 이용한 레이더 강우 보정 평가)

  • Jung, Sungho;Oh, Sungryul;Lee, Daeeop;Le, Xuan Hien;Lee, Giha
    • Journal of Korea Water Resources Association
    • /
    • v.54 no.7
    • /
    • pp.453-462
    • /
    • 2021
  • As the frequency of localized heavy rainfall has increased during recent years, the importance of high-resolution radar data has also increased. This study aims to correct the bias of Dual Polarization radar that still has a spatial and temporal bias. In many studies, various statistical techniques have been attempted to correct the bias of radar rainfall. In this study, the bias correction of the S-band Dual Polarization radar used in flood forecasting of ME was implemented by a Convolutional Autoencoder (CAE) algorithm, which is a type of Convolutional Neural Network (CNN). The CAE model was trained based on radar data sets that have a 10-min temporal resolution for the July 2017 flood event in Cheongju. The results showed that the newly developed CAE model provided improved simulation results in time and space by reducing the bias of raw radar rainfall. Therefore, the CAE model, which learns the spatial relationship between each adjacent grid, can be used for real-time updates of grid-based climate data generated by radar and satellites.

Analysis of effects of drought on water quality using HSPF and QUAL-MEV (HSPF 및 QUAL-MEV를 이용한 가뭄이 수질에 미치는 영향 분석)

  • Lee, Sangung;Jo, Bugeon;Kim, Young Do;Lee, Joo-Heon
    • Journal of Korea Water Resources Association
    • /
    • v.56 no.6
    • /
    • pp.393-402
    • /
    • 2023
  • Drought, which has been increasing in frequency and magnitude due to recent abnormal weather events, poses severe challenges in various sectors. To address this issue, it is important to develop technologies for drought monitoring, forecasting, and response in order to implement effective measures and safeguard the ecological health of aquatic systems during water scarcity caused by drought. This study aimed to predict water quality fluctuations during drought periods by integrating the watershed model HSPF and the water quality model QUAL-MEV. The researchers examined the SPI and RCP 4.5 scenarios, and analyzed water quality changes based on flow rates by simulating them using the HSPF and QUAL-MEV models. The study found a strong correlation between water flow and water quality during the low flow. However, the relationship between precipitation and water quality was deemed insignificant. Moreover, the flow rate and SPI6 exhibited different trends. It was observed that the relationship with the mid- to long-term drought index was not significant when predicting changes in water quality influenced by drought. Therefore, to accurately assess the impact of drought on water quality, it is necessary to employ a short-term drought index and develop an evaluation method that considers fluctuations in flow.

Real-Time Flood Forecasting by Using a Measured Data Based Nomograph for Small Streams (계측자료 기반 Nomograph를 이용한 실시간 소하천 홍수량 산정 연구)

  • Tae Sung Cheong;Changwon Choi;Sung Je Yei;Kang Min Koo
    • Ecology and Resilient Infrastructure
    • /
    • v.10 no.4
    • /
    • pp.116-124
    • /
    • 2023
  • As the flood damage on small streams increase due to the increase in frequency of extreme climate events, the need to measure hydraulic data of them has increased for disaster risk management. National Disaster Management Institute, Ministry of Interior and Safety develops CADMT, a CCTV-based automatic discharge measurement technology, and operates pilot small streams to verify its performance and develop disaster risk management technology. The research selects two small streams such as the Neungmac and the Jungsunpil streams to develop the Nomograph by using the 4-Parameter Logistic method using only the observed rainfall data from the Automatic Weather System operated by the Korea Meteorological Agency closest to the small streams and discharge data collected by using the CADMT. To evaluate developed Nomograph, the research forecasts floods discharges in each small stream and compares the result with the observed discharges. As a result of the evaluations, the forecasted value is found to represent the observed value well, so if more accurate observed data are collected and the Nomograph based on it is developed in the future, the high-accuracy flood prediction and warning will be possible.

Automatic Detection of Type II Solar Radio Burst by Using 1-D Convolution Neutral Network

  • Kyung-Suk Cho;Junyoung Kim;Rok-Soon Kim;Eunsu Park;Yuki Kubo;Kazumasa Iwai
    • Journal of The Korean Astronomical Society
    • /
    • v.56 no.2
    • /
    • pp.213-224
    • /
    • 2023
  • Type II solar radio bursts show frequency drifts from high to low over time. They have been known as a signature of coronal shock associated with Coronal Mass Ejections (CMEs) and/or flares, which cause an abrupt change in the space environment near the Earth (space weather). Therefore, early detection of type II bursts is important for forecasting of space weather. In this study, we develop a deep-learning (DL) model for the automatic detection of type II bursts. For this purpose, we adopted a 1-D Convolution Neutral Network (CNN) as it is well-suited for processing spatiotemporal information within the applied data set. We utilized a total of 286 radio burst spectrum images obtained by Hiraiso Radio Spectrograph (HiRAS) from 1991 and 2012, along with 231 spectrum images without the bursts from 2009 to 2015, to recognizes type II bursts. The burst types were labeled manually according to their spectra features in an answer table. Subsequently, we applied the 1-D CNN technique to the spectrum images using two filter windows with different size along time axis. To develop the DL model, we randomly selected 412 spectrum images (80%) for training and validation. The train history shows that both train and validation losses drop rapidly, while train and validation accuracies increased within approximately 100 epoches. For evaluation of the model's performance, we used 105 test images (20%) and employed a contingence table. It is found that false alarm ratio (FAR) and critical success index (CSI) were 0.14 and 0.83, respectively. Furthermore, we confirmed above result by adopting five-fold cross-validation method, in which we re-sampled five groups randomly. The estimated mean FAR and CSI of the five groups were 0.05 and 0.87, respectively. For experimental purposes, we applied our proposed model to 85 HiRAS type II radio bursts listed in the NGDC catalogue from 2009 to 2016 and 184 quiet (no bursts) spectrum images before and after the type II bursts. As a result, our model successfully detected 79 events (93%) of type II events. This results demonstrates, for the first time, that the 1-D CNN algorithm is useful for detecting type II bursts.

Implementation of an Automated Agricultural Frost Observation System (AAFOS) (농업서리 자동관측 시스템(AAFOS)의 구현)

  • Kyu Rang Kim;Eunsu Jo;Myeong Su Ko;Jung Hyuk Kang;Yunjae Hwang;Yong Hee Lee
    • Korean Journal of Agricultural and Forest Meteorology
    • /
    • v.26 no.1
    • /
    • pp.63-74
    • /
    • 2024
  • In agriculture, frost can be devastating, which is why observation and forecasting are so important. According to a recent report analyzing frost observation data from the Korea Meteorological Administration, despite global warming due to climate change, the late frost date in spring has not been accelerated, and the frequency of frost has not decreased. Therefore, it is important to automate and continuously operate frost observation in risk areas to prevent agricultural frost damage. In the existing frost observation using leaf wetness sensors, there is a problem that the reference voltage value fluctuates over a long period of time due to contamination of the observation sensor or changes in the humidity of the surrounding environment. In this study, a datalogger program was implemented to automatically solve these problems. The established frost observation system can stably and automatically accumulate time-resolved observation data over a long period of time. This data can be utilized in the future for the development of frost diagnosis models using machine learning methods and the production of frost occurrence prediction information for surrounding areas.

An empirical study on RFM-T model for market performance of B2B-based Technology Industry Companies (B2B 중심의 기술 산업 기업의 수익성 성과를 위한 RFM-T 모형 실증 연구)

  • Miyoung Woo;Young-Jun Kim
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.24 no.2
    • /
    • pp.167-175
    • /
    • 2024
  • Due to the Fourth Industrial Revolution, ICT(Information and Communication Technology) industry is becoming more important and sophisticated than ever. In B2B based ICT industry demand forecasting by analyzing the previous customer data is so important. RFM, one of customer relationship management models is a marketing technique that evaluates Recency, Frequency and Monetary value to predict customers behavior. RFM model has been studied focusing on the B2C based industry. On the other hand there is a lack of research on B2B based technology industry. Therefore this study applied it to B2B based high technology industry and considered T(technology collaboration) value, which are identified as important factors in the technology industry. To present an improved model for market performance in B2B technology industry, an empirical study was conducted on comparing the accuracy of the traditional RFM model and the improved RFM-T model. The objective of this study is to contribute to market performance by presenting an improved model in B2B based high technology industry.

Estimation of GARCH Models and Performance Analysis of Volatility Trading System using Support Vector Regression (Support Vector Regression을 이용한 GARCH 모형의 추정과 투자전략의 성과분석)

  • Kim, Sun Woong;Choi, Heung Sik
    • Journal of Intelligence and Information Systems
    • /
    • v.23 no.2
    • /
    • pp.107-122
    • /
    • 2017
  • Volatility in the stock market returns is a measure of investment risk. It plays a central role in portfolio optimization, asset pricing and risk management as well as most theoretical financial models. Engle(1982) presented a pioneering paper on the stock market volatility that explains the time-variant characteristics embedded in the stock market return volatility. His model, Autoregressive Conditional Heteroscedasticity (ARCH), was generalized by Bollerslev(1986) as GARCH models. Empirical studies have shown that GARCH models describes well the fat-tailed return distributions and volatility clustering phenomenon appearing in stock prices. The parameters of the GARCH models are generally estimated by the maximum likelihood estimation (MLE) based on the standard normal density. But, since 1987 Black Monday, the stock market prices have become very complex and shown a lot of noisy terms. Recent studies start to apply artificial intelligent approach in estimating the GARCH parameters as a substitute for the MLE. The paper presents SVR-based GARCH process and compares with MLE-based GARCH process to estimate the parameters of GARCH models which are known to well forecast stock market volatility. Kernel functions used in SVR estimation process are linear, polynomial and radial. We analyzed the suggested models with KOSPI 200 Index. This index is constituted by 200 blue chip stocks listed in the Korea Exchange. We sampled KOSPI 200 daily closing values from 2010 to 2015. Sample observations are 1487 days. We used 1187 days to train the suggested GARCH models and the remaining 300 days were used as testing data. First, symmetric and asymmetric GARCH models are estimated by MLE. We forecasted KOSPI 200 Index return volatility and the statistical metric MSE shows better results for the asymmetric GARCH models such as E-GARCH or GJR-GARCH. This is consistent with the documented non-normal return distribution characteristics with fat-tail and leptokurtosis. Compared with MLE estimation process, SVR-based GARCH models outperform the MLE methodology in KOSPI 200 Index return volatility forecasting. Polynomial kernel function shows exceptionally lower forecasting accuracy. We suggested Intelligent Volatility Trading System (IVTS) that utilizes the forecasted volatility results. IVTS entry rules are as follows. If forecasted tomorrow volatility will increase then buy volatility today. If forecasted tomorrow volatility will decrease then sell volatility today. If forecasted volatility direction does not change we hold the existing buy or sell positions. IVTS is assumed to buy and sell historical volatility values. This is somewhat unreal because we cannot trade historical volatility values themselves. But our simulation results are meaningful since the Korea Exchange introduced volatility futures contract that traders can trade since November 2014. The trading systems with SVR-based GARCH models show higher returns than MLE-based GARCH in the testing period. And trading profitable percentages of MLE-based GARCH IVTS models range from 47.5% to 50.0%, trading profitable percentages of SVR-based GARCH IVTS models range from 51.8% to 59.7%. MLE-based symmetric S-GARCH shows +150.2% return and SVR-based symmetric S-GARCH shows +526.4% return. MLE-based asymmetric E-GARCH shows -72% return and SVR-based asymmetric E-GARCH shows +245.6% return. MLE-based asymmetric GJR-GARCH shows -98.7% return and SVR-based asymmetric GJR-GARCH shows +126.3% return. Linear kernel function shows higher trading returns than radial kernel function. Best performance of SVR-based IVTS is +526.4% and that of MLE-based IVTS is +150.2%. SVR-based GARCH IVTS shows higher trading frequency. This study has some limitations. Our models are solely based on SVR. Other artificial intelligence models are needed to search for better performance. We do not consider costs incurred in the trading process including brokerage commissions and slippage costs. IVTS trading performance is unreal since we use historical volatility values as trading objects. The exact forecasting of stock market volatility is essential in the real trading as well as asset pricing models. Further studies on other machine learning-based GARCH models can give better information for the stock market investors.

Population Phenology and an Early Season Adult Emergence model of Pumpkin Fruit Fly, Bactrocera depressa (Diptera: Tephritidae) (호박과실파리 발생생태 및 계절초기 성충우화시기 예찰 모형)

  • Kang, Taek-Jun;Jeon, Heung-Yong;Kim, Hyeong-Hwan;Yang, Chang-Yeol;Kim, Dong-Soon
    • Korean Journal of Agricultural and Forest Meteorology
    • /
    • v.10 no.4
    • /
    • pp.158-166
    • /
    • 2008
  • The pumpkin fruit fly, Bactrocera depressa (Tephritidae: Diptera), is one of the most important pests in Cucurbitaceae plants. This study was conducted to investigate the basic ecology of B. depressa, and to develop a forecasting model for predicting the time of adult emergence in early season. In green pumpkin producing farms, the oviposition punctures caused by the oviposition of B. depressa occurred first between mid- and late July, peaked in late August, and then decreased in mid-September followed by disappearance of the symptoms in late September, during which oviposition activity of B. depressa is considered active. In full-ripened pumpkin producing farms, damaged fruits abruptly increased from early Auguest, because the decay of pumpkins caused by larval development began from that time. B. depressa produced a mean oviposition puncture of 2.2 per fruit and total 28.8-29.8 eggs per fruit. Adult emergence from overwintering pupae, which was monitored using a ground emergence trap, was first observed between mid- and late May, and peaked during late May to early June. The development times from overwintering pupae to adult emergence decreased with increasing temperature: 59.0 days at $15^{\circ}C$, 39.3 days at $20^{\circ}C$, 25.8 days at$25^{\circ}C$ and 21.4 days at $30^{\circ}C$. The pupae did not develop to adult at $35^{\circ}C$. The lower developmental threshold temperature was calculated as $6.8^{\circ}C$ by linear regression. The thermal constant was 482.3 degree-days. The non-linear model of Gaussian equation well explained the relationship between the development rate and temperature. The Weibull function provided a good fit for the distribution of development times of overwintering pupae. The predicted date of 50% adult emergence by a degree-day model showed one day deviation from the observed actual date. Also, the output estimated by rate summation model, which was consisted of the developmental model and the Weibull function, well pursued the actual pattern of cumulative frequency curve of B. depressa adult emergence. Consequently, it is expected that the present results could be used to establish the management strategy of B. depressa.

Characteristics of Spectra of Daily Satellite Sea Surface Temperature Composites in the Seas around the Korean Peninsula (한반도 주변해역 일별 위성 해수면온도 합성장 스펙트럼 특성)

  • Woo, Hye-Jin;Park, Kyung-Ae;Lee, Joon-Soo
    • Journal of the Korean earth science society
    • /
    • v.42 no.6
    • /
    • pp.632-645
    • /
    • 2021
  • Satellite sea surface temperature (SST) composites provide important data for numerical forecasting models and for research on global warming and climate change. In this study, six types of representative SST composite database were collected from 2007 to 2018 and the characteristics of spatial structures of SSTs were analyzed in seas around the Korean Peninsula. The SST composite data were compared with time series of in-situ measurements from ocean meteorological buoys of the Korea Meteorological Administration by analyzing the maximum value of the errors and its occurrence time at each buoy station. High differences between the SST data and in-situ measurements were detected in the western coastal stations, in particular Deokjeokdo and Chilbaldo, with a dominant annual or semi-annual cycle. In Pohang buoy, a high SST difference was observed in the summer of 2013, when cold water appeared in the surface layer due to strong upwelling. As a result of spectrum analysis of the time series SST data, daily satellite SSTs showed similar spectral energy from in-situ measurements at periods longer than one month approximately. On the other hand, the difference of spectral energy between the satellite SSTs and in-situ temperature tended to magnify as the temporal frequency increased. This suggests a possibility that satellite SST composite data may not adequately express the temporal variability of SST in the near-coastal area. The fronts from satellite SST images revealed the differences among the SST databases in terms of spatial structure and magnitude of the oceanic fronts. The spatial scale expressed by the SST composite field was investigated through spatial spectral analysis. As a result, the high-resolution SST composite images expressed the spatial structures of mesoscale ocean phenomena better than other low-resolution SST images. Therefore, in order to express the actual mesoscale ocean phenomenon in more detail, it is necessary to develop more advanced techniques for producing the SST composites.