• Title/Summary/Keyword: Meteorological Big Data

검색결과 75건 처리시간 0.024초

Use of big data for estimation of impacts of meteorological variables on environmental radiation dose on Ulleung Island, Republic of Korea

  • Joo, Han Young;Kim, Jae Wook;Jeong, So Yun;Kim, Young Seo;Moon, Joo Hyun
    • Nuclear Engineering and Technology
    • /
    • 제53권12호
    • /
    • pp.4189-4200
    • /
    • 2021
  • In this study, the relationship between the environmental radiation dose rate and meteorological variables was investigated with multiple regression analysis and big data of those variables. The environmental radiation dose rate and 36 different meteorological variables were measured on Ulleung Island, Republic of Korea, from 2011 to 2015. Not all meteorological variables were used in the regression analysis because the different meteorological variables significantly affect the environmental radiation dose rate during different periods, and the degree of influence changes with time. By applying the Pearson correlation analysis and stepwise selection methods to the big dataset, the major meteorological variables influencing the environmental radiation dose rate were identified, which were then used as the independent variables for the regression model. Subsequently, multiple regression models for the monthly datasets and dataset of the entire period were developed.

방대한 기상 레이더 데이터의 원할한 처리를 위한 순환 가중최소자승법 기반 RBF 뉴럴 네트워크 설계 및 응용 (Design of RBF Neural Networks Based on Recursive Weighted Least Square Estimation for Processing Massive Meteorological Radar Data and Its Application)

  • 강전성;오성권
    • 전기학회논문지
    • /
    • 제64권1호
    • /
    • pp.99-106
    • /
    • 2015
  • In this study, we propose Radial basis function Neural Network(RBFNN) using Recursive Weighted Least Square Estimation(RWLSE) to effectively deal with big data class meteorological radar data. In the condition part of the RBFNN, Fuzzy C-Means(FCM) clustering is used to obtain fitness values taking into account characteristics of input data, and connection weights are defined as linear polynomial function in the conclusion part. The coefficients of the polynomial function are estimated by using RWLSE in order to cope with big data. As recursive learning technique, RWLSE which is based on WLSE is carried out to efficiently process big data. This study is experimented with both widely used some Machine Learning (ML) dataset and big data obtained from meteorological radar to evaluate the performance of the proposed classifier. The meteorological radar data as big data consists of precipitation echo and non-precipitation echo, and the proposed classifier is used to efficiently classify these echoes.

신재생에너지 국가참조표준 시스템 구축 및 개발 - 모델 기반 표준기상년 (System Construction and Data Development of National Standard Reference for Renewable Energy - Model-Based Standard Meteorological Year)

  • 김보영;김창기;윤창열;김현구;강용혁
    • 신재생에너지
    • /
    • 제20권1호
    • /
    • pp.95-101
    • /
    • 2024
  • Since 1990, the Renewable Big Data Research Lab at the Korea Institute of Energy Technology has been observing solar radiation at 16 sites across South Korea. Serving as the National Reference Standard Data Center for Renewable Energy since 2012, it produces essential data for the sector. By 2020, it standardized meteorological year data from 22 sites. Despite user demand for data from approximately 260 sites, equivalent to South Korea's municipalities, this need exceeds the capability of measurement-based data. In response, our team developed a method to derive solar radiation data from satellite images, covering South Korea in 400,000 grids of 500 m × 500 m each. Utilizing satellite-derived data and ERA5-Land reanalysis data from the European Centre for Medium-Range Weather Forecasts (ECMWF), we produced standard meteorological year data for 1,000 sites. Our research also focused on data measurement traceability and uncertainty estimation, ensuring the reliability of our model data and the traceability of existing measurement-based data.

Correlation Analysis of Atmospheric Pollutants and Meteorological Factors Based on Environmental Big Data

  • Chao, Chen;Min, Byung-Won
    • International Journal of Contents
    • /
    • 제18권1호
    • /
    • pp.17-26
    • /
    • 2022
  • With the acceleration of urbanization and industrialization, air pollution has become increasingly serious, and the pollution control situation is not optimistic. Climate change has become a major global challenge faced by mankind. To actively respond to climate change, China has proposed carbon peak and carbon neutral goals. However, atmospheric pollutants and meteorological factors that affect air quality are complex and changeable, and the complex relationship and correlation between them must be further clarified. This paper uses China's 2013-2018 high-resolution air pollution reanalysis open data set, as well as statistical methods of the Pearson Correlation Coefficient (PCC) to calculate and visualize the design and analysis of environmental monitoring big data, which is intuitive and it quickly demonstrated the correlation between pollutants and meteorological factors in the temporal and spatial sequence, and provided convenience for environmental management departments to use air quality routine monitoring data to enable dynamic decision-making, and promote global climate governance. The experimental results show that, apart from ozone, which is negatively correlated, the other pollutants are positively correlated; meteorological factors have a greater impact on pollutants, temperature and pollutants are negatively correlated, air pressure is positively correlated, and the correlation between humidity is insignificant. The wind speed has a significant negative correlation with the six pollutants, which has a greater impact on the diffusion of pollutants.

태양광 패널 일사량에 기반한 대표연도 데이터 비교 평가 (Comparative Assessment of Typical Year Dataset based on POA Irradiance)

  • 윤창열;김보영;김창기;김현구;강용혁;김용일
    • 신재생에너지
    • /
    • 제20권1호
    • /
    • pp.102-109
    • /
    • 2024
  • The Typical Meteorological Year (TMY) dataset compiles 12 months of data that best represent long-term climate patterns, focusing on global horizontal irradiance and other weather-related variables. However, the irradiance measured on the plane of the array (POA) shows certain distinct distribution characteristics compared with the irradiance in the TMY dataset, and this may introduce some biases. Our research recalculated POA irradiance using both the Isotropic and DIRINT models, generating an updated dataset that was tailored to POA characteristics. Our analysis showed a 28% change in the selection of typical meteorological months, an 8% increase in average irradiance, and a 40% reduction in the range of irradiance values, thus indicating a significant shift in irradiance distribution patterns. This research aims to inform stakeholders about accurate use of TMY datasets in potential decision-making. These findings underscore the necessity of creating a typical dataset by using the time series of POA irradiance, which represents the orientation in which PV panels will be deployed.

대용량 기후모델자료를 위한 통합관리시스템 구축 (Development of Climate & Environment Data System for Big Data from Climate Model Simulations)

  • 이재희;성현민;원상호;이조한;변영화
    • 대기
    • /
    • 제29권1호
    • /
    • pp.75-86
    • /
    • 2019
  • In this paper, we introduce a novel Climate & Environment Database System (CEDS). The CEDS is developed by the National Institute of Meteorological Sciences (NIMS) to provide easy and efficient user interfaces and storage management of climate model data, so improves work efficiency. In uploading the data/files, the CEDS provides an option to automatically operate the international standard data conversion (CMORization) and the quality assurance (QA) processes for submission of CMIP6 variable data. This option increases the system performance, removes the user mistakes, and increases the level of reliability as it eliminates user operation for the CMORization and QA processes. The uploaded raw files are saved in a NAS storage and the Cassandra database stores the metadata that will be used for efficient data access and storage management. The Metadata is automatically generated when uploading a file, or by the user inputs. With the Metadata, the CEDS supports effective storage management by categorizing data/files. This effective storage management allows easy and fast data access with a higher level of data reliability when requesting with the simple search words by a novice. Moreover, the CEDS supports parallel and distributed computing for increasing overall system performance and balancing the load. This supports the high level of availability as multiple users can use it at the same time with fast system-response. Additionally, it deduplicates redundant data and reduces storage space.

도로 침수영역의 탐색을 위한 빅데이터 분석 시스템 연구 (A Study on the Big Data Analysis System for Searching of the Flooded Road Areas)

  • 송영미;김창수
    • 한국멀티미디어학회논문지
    • /
    • 제18권8호
    • /
    • pp.925-934
    • /
    • 2015
  • The frequency of natural disasters because of global warming is gradually increasing, risks of flooding due to typhoon and torrential rain have also increased. Among these causes, the roads are flooded by suddenly torrential rain, and then vehicle and personal injury are happening. In this respect, because of the possibility that immersion of a road may occur in a second, it is necessary to study the rapid data collection and quick response system. Our research proposes a big data analysis system based on the collected information and a variety of system information collection methods for searching flooded road areas by torrential rains. The data related flooded roads are utilized the SNS data, meteorological data and the road link data, etc. And the big data analysis system is implemented the distributed processing system based on the Hadoop platform.

기상학적 가뭄, 농업 가뭄 및 빅데이터 현장가뭄간의 상관성 평가 (Evaluation of the Relationship between Meteorological, Agricultural and In-situ Big Data Droughts)

  • 이지완;장선숙;안소라;박기욱;김성준
    • 한국지리정보학회지
    • /
    • 제19권1호
    • /
    • pp.64-79
    • /
    • 2016
  • 본 논문의 목적은 SPI 기상학적 가뭄지수, 농업용 저수지 저수율, 농업가뭄 빅데이터간의 관계를 평가함으로써 빅데이터의 활용 가능성을 평가하는데 있다. 2014년 1월부터 2015년 9월까지의 장기가뭄을 대상으로, SPI-12개월 가뭄지수, 평년대비 강수부족율, 농업용저수지 저수부족율, 인터넷포털 검색을 통한 농업가뭄 빅데이터를 월단위 도별로 수집 및 분석하였다. SPI-12의 최대 가뭄심도와 최대 저수 부족율이 나타난 시기를 비교한 결과, 전국적으로 2014년은 7월, 2015년은 8월과 9월에 시기를 같이 하면서 발현되었다. 한편, 빅데이터의 도별 최대 발현시기는 2014년 6월과 7월, 2015년은 3월, 6월~9월에 나타나, SPI-12와 저수 부족율의 최대심도보다 2014년은 1개월, 2015년은 여름에 2개월 이르게 나타났다. 이는 빅데이터가 3월부터의 봄가뭄, 6월의 늦장마, 7월의 마른장마에 이어 2015년은 9월까지의 강우량 부족에 따라 기상학적 가뭄과 농업가뭄에 민감하게 반응하는 것을 의미하며, 농업가뭄관련 빅데이터의 활용이 가뭄의 위험관리에 효과가 있을 것으로 판단된다.

기상환경에 따른 농산물 전자상거래 빅데이터 분석 (Big Data Analysis of Agricultural Products E-Commerce According to Meteorological Environment)

  • 이석인;김기철
    • 한국컴퓨터정보학회:학술대회논문집
    • /
    • 한국컴퓨터정보학회 2020년도 제61차 동계학술대회논문집 28권1호
    • /
    • pp.113-116
    • /
    • 2020
  • 본 연구의 목적은 최근 비중이 급증하고 있는 국내 전자상거래 시장에서 농산물 판매 현황이 지역 날씨와 생육 환경 등 농산물 생산과 연관성이 높은 데이터와 어떤 관계가 있는지를 분석하는 것이다. 이를 위해 전라남도 농산물의 온라인 판매 현황을 분석하고, 전남 지역 날씨와 생육 환경에 관한 표준화된 데이터를 안정적으로 확보할 수 있도록 빅데이터 시스템을 구축하고자 한다. 본 연구의 결과는 지역 농업인의 농산물 생산과 유통 의사결정에 시사점을 제공하고 궁극적으로는 생산성과 수익성 향성에 기여할 것으로 기대된다.

  • PDF

Characteristics on Big Data of the Meteorology and Climate Reported in the Media in Korea

  • Choi, Jae-Won;Kim, Hae-Dong
    • Quantitative Bio-Science
    • /
    • 제37권2호
    • /
    • pp.91-101
    • /
    • 2018
  • This study has analyzed applicable characteristics on big data of the meteorology and climate depending on press releases in the media. As a result, more than half of them were conducted by governmental departments and institutions (26.9%) and meteorological administration (25.0%). Most articles were written by journalists, especially the highest portion stems from straight articles focusing on delivering simple information. For each field, the number of cases had listed in order of rank to be exposed to the media; information service, business management, farming, livestock, and fishing industries, and disaster management, but others did rank far behind; insurance, construction, hydrology and energy. Application of big data about meteorology and climate differed depending on the seasonal change, it was directly related to temperature information during spring, to weather phenomenon such as monsoon and heat wave during summer, to meteorology and climate information during fall, and to weather phenomenon such as cold wave and heavy snow during winter.