• Title/Summary/Keyword: data stream technology

Search Result 408, Processing Time 0.027 seconds

A Fuzzy Window Mechanism for Information Differentiation in Mining Data Streams (데이터 스트림 마이닝에서 정보 중요성 차별화를 위한 퍼지 윈도우 기법)

  • Chang, Joong-Hyuk
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.12 no.9
    • /
    • pp.4183-4191
    • /
    • 2011
  • Considering the characteristics of a data stream whose data elements are continuously generated and may change over time, there have been many techniques to differentiate the importance of data elements in a data stream by their generation time. The conventional techniques are efficient to get an analysis result focusing on the recent information in a data stream, but they have a limitation to differentiate the importance of information in various ways more flexible. An information differentiation technique based on the term of a fuzzy set can be an alternative way to compensate the limitation. A term of a fuzzy set has been widely used in various data mining fields, which can overcome the sharp boundary problem and give an analysis result reflecting the requirements in real world applications more. In this paper, a fuzzy window mechanism is proposed, which is adapting a term of a fuzzy set and is efficiently used to differentiate the importance of information in mining data streams. Basic concepts including fuzzy calendars are described first, and subsequently details on data stream mining of weighted patterns using a fuzzy window technique are described.

Development of Relational Formula between Groundwater Pumping Rate and Streamflow Depletion (지하수 양수량과 하천수 감소량간 상관관계식 개발)

  • Kim, Nam Won;Lee, Jeongwoo;Lee, Jung Eun;Won, You Seung
    • Journal of Korea Water Resources Association
    • /
    • v.45 no.12
    • /
    • pp.1243-1258
    • /
    • 2012
  • The objective of this study is to develop the relational formula to estimate the streamflow depletion due to groundwater pumping near stream, which has been statistically derived by using the simulated data. The integrated surface water and groundwater model, SWAT-MODFLOW was applied to the Sinduncheon and Juksancheon watersheds to obtain the streamflow depletion data under various pumping conditions. Through the multiple regression analyses for the simulated streamflow depletion data, the relational formula between the streamflow depletion rate and various factors such as pumping rate, distance between well and stream, hydraulic properties in/near stream, amount of rainfall was obtained. The derived relational formula is easy to apply for assessing the effects of groundwater pumping on near stream, and is expected to be a tool for estimate the streamflow contribution to the pumped water.

Improvement of Cross-section Estimation Method for Flood Stage Analysis in Unmeasured Streams (미계측 하천의 홍수위 해석을 위한 단면 추정 기법 개선)

  • Jun, Sang Min;Hwang, Soon Ho;Song, Jung-Hun;Kim, Si Nae;Choi, Soon-Kun;Kang, Moon Seong
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.61 no.4
    • /
    • pp.11-22
    • /
    • 2019
  • The objective of this study was to improve the cross-sectional area and height estimation method using stream width. Stream water levels should be calculated together to simulate inundation of agricultural land. However, cross-sectional survey data of small rural rivers are insufficient. The previous study has developed regression equations between the width and the cross-sectional area and between the width and the height of stream cross-section, but can not be applied to a wide range of stream widths. In this study, cross-sectional survey data of 6 streams (Doowol, Chungmi, Jiseok, Gam, Wonpyeong, and Bokha stream) were collected and divided into upstream, midstream and downstream considering the locations of cross-sections. The regression equations were estimated using the complete data. $R^2$ between the stream width and cross-sectional area was 0.96, and $R^2$ between width and height was 0.81. The regression equations were also estimated using divided data for upstream, midstream and downstream considering the locations of cross-sections. The range of $R^2$ between the stream width and cross-sectional area was 0.86 - 0.91, and the range of $R^2$ between width and height was 0.79 ? 0.92. As a result of estimating the cross-sections of 6 rivers using the regression equations, the regression equations considering the locations of cross-sections showed better performance both in the cross-sectional area and height estimation than the regression equations estimated using the complete data. Hydrologic Engineering Center - River Analysis System (HEC-RAS) was used to simulate the flood stage analysis of the estimated and the measured cross-sections for 50-year, 100-year, and 200-year frequency floods. As a result of flood stage analysis, the regression equations considering the locations of cross-sections also showed better performance than the regression equations estimated using the complete data. Future research would be needed to consider the factors affecting the cross-sectional shape such as river slope and average flow velocity. This study can be useful for inundation simulation of agricultural land adjacent to an unmeasured stream.

Identifying the Change of Urban Stream Bed Using Real-time Beacon DGPS (실시간 beacon DGPS를 이용한 도시하천의 하상변화 파악)

  • Lee, Kyoo-Seock;Lee, Sang-Hwa;Shin, Dong Hoon;Ahn, Seung-Mahn;Suh, Byung-Key
    • Journal of the Korean Society of Environmental Restoration Technology
    • /
    • v.6 no.1
    • /
    • pp.51-56
    • /
    • 2003
  • The urban stream include the channel and its adjacent banks, or hillslopes and it consists of various landscape elements. The riparian ecosystem is important to people. Its water is extracted for irrigation and drinking supplies. Biodiversity and many wetland species are protected here. The riparian ecosystem is diverse and needs to be preserved well. So, it is necessary to measure the features of the urban stream accurately to figure out the change of the riparian ecosystem. However, the traditional Electronic Distance Measurement(EDM) surveying is difficult to measure the curvilinear features of the stream - e, g, angle, curve. The beacon Differential Global Positioning System(DGPS) can handle to measure the curvilinear shape. Therefore, the purpose of this study is to measure the change of the river bed in urban stream accurately using realtime beacon DGPS, and ultimately to provide the basic data for identifying the change of the river ecosystem.

Influences of the Solifluction Soil on the Physicochemistry of Stream Water Quality (계류수의 이화학성에 미치는 동결융해침식토사의 영향)

  • Park, Jae Hyeon;Lee, Seung-Woo;Choi, Hyung-Tae
    • Journal of the Korean Society of Environmental Restoration Technology
    • /
    • v.5 no.2
    • /
    • pp.17-24
    • /
    • 2002
  • This research was conducted to investigate the influences caused by solifluction soil on the physicochemistry of stream water quality at the riparian area four points in the northeastern part of the Bughansan National Park from March to May of 2001. The average pH of stream water was higher than those in the caused by solifluction soil. The average electrical conductivity of upstream water was about 0.8~1.7 times lower than those in the caused by solifluction soil, but the average electrical conductivity of downstream water was about 1.6~3.8 times higher than those in the caused by solifluction soil. Therefore, these results showed that the water quality of downstream was worse than that of upstream. Twelve factors including the physicochemistry on the stream water and caused by solifluction soil were analyzed by spss/pc+ for the data collected from during March to May of 2001. pH of stream water was very significantly correlated with pH and electrical conductivity at the caused by solifluction soil. And the electrical conductivity of stream water was very significantly correlated with electrical conductivity and the amount of cation($Na^+$, ${NH_4}^+$, $Mg^{2+}$) at the caused by solifluction soil.

Derivation of Continuous Pollutant Loadograph using Distributed Model with 8-Day Measured Flow and Water Quality Data of MOE (환경부 8일 간격 유량·수질 관측자료와 분포형 모형을 이용한 연속오염부하곡선의 유도)

  • Kim, Chul-Gyum;Kim, Nam-Won
    • Journal of Korean Society on Water Environment
    • /
    • v.25 no.1
    • /
    • pp.125-135
    • /
    • 2009
  • Reliable long-term flows by SWAT-K model were applied to the relationship between stream flow and pollutant load derived from 8-day measured data of Ministry of Environment (MOE) in order to obtain continuous loadograph and evaluate accuracy in water quality modeling for the Chungju dam watershed. The measured flow were compared with flow duration curve from the model, and it showed that measured values corresponded to the almost full range of stream flow conditions except at Odae A. And there was significant relationship ($R^2=0.60{\sim}0.97$) between measured flow and water quality load at all unit-watersheds. Applying this relationship to simulated flows, continuous loadograph was obtained and compared with modeled pollutant loads. Although there were some differences during some dry and flood seasons, those were not significant and overall trend showed a good agreement. From the results, we would be able to derive a continuous loadograph based on measured data at total maximum daily loads (TMDLs) unit-watersheds on a national scale, in which stream flow and water quality have been measured at 8-day intervals since 2004, and this could be helpful to utilize distributed water quality models with difficulty in calibrating and validating parameters from lack of measured data at present.

A Review of Window Query Processing for Data Streams

  • Kim, Hyeon Gyu;Kim, Myoung Ho
    • Journal of Computing Science and Engineering
    • /
    • v.7 no.4
    • /
    • pp.220-230
    • /
    • 2013
  • In recent years, progress in hardware technology has resulted in the possibility of monitoring many events in real time. The volume of incoming data may be so large, that monitoring all individual data might be intractable. Revisiting any particular record can also be impossible in this environment. Therefore, many database schemes, such as aggregation, join, frequent pattern mining, and indexing, become more challenging in this context. This paper surveys the previous efforts to resolve these issues in processing data streams. The emphasis is on specifying and processing sliding window queries, which are supported in many stream processing engines. We also review the related work on stream query processing, including synopsis structures, plan sharing, operator scheduling, load shedding, and disorder control.

Effects of Combustor-Level High Inlet Turbulence on the Endwall Flow and Heat/Mass Transfer of a High-Turning Turbine Rotor Cascade

  • Lee, Sang-Woo;Jun, Sang-Bae;Park, Byung-Kyu;Lee, Joon-Sik
    • Journal of Mechanical Science and Technology
    • /
    • v.18 no.8
    • /
    • pp.1435-1450
    • /
    • 2004
  • Experimental data are presented which describe the effects of a combustor-level high free-stream turbulence on the near-wall flow structure and heat/mass transfer on the endwall of a linear high-turning turbine rotor cascade. The end wall flow structure is visualized by employing the partial- and total-coverage oil-film technique, and heat/mass transfer rate is measured by the naphthalene sublimation method. A turbulence generator is designed to provide a highly-turbulent flow which has free-stream turbulence intensity and integral length scale of 14.7% and 80mm, respectively, at the cascade entrance. The surface flow visualizations show that the high free-stream turbulence has little effect on the attachment line, but alters the separation line noticeably. Under high free-stream turbulence, the incoming near-wall flow upstream of the adjacent separation lines collides more obliquely with the suction surface. A weaker lift-up force arising from this more oblique collision results in the narrower suction-side corner vortex area in the high turbulence case. The high free-stream turbulence enhances the heat/mass transfer in the central area of the turbine passage, but only a slight augmentation is found in the end wall regions adjacent to the leading and trailing edges. Therefore, the high free-stream turbulence makes the end wall heat load more uniform. It is also observed that the heat/mass transfers along the locus of the pressure-side leg of the leading-edge horseshoe vortex and along the suction-side corner are influenced most strongly by the high free-stream turbulence. In this study, the end wall surface is classified into seven different regions based on the local heat/mass transfer distribution, and the effects of the high free-stream turbulence on the local heat/mass transfer in each region are discussed in detail.

Filtering Method for Analyzing Renewable Energy Stream Data (신재생 에너지 스트림 데이터 분석을 위한 필터링 기법)

  • Jin, Cheng Hao;Li, Xun;Kim, Kyu Ik;Hwang, Mi Yeong;Kim, Sang Yeob;Kim, Kwang Deuk;Ryu, Keun Ho
    • Journal of Convergence Society for SMB
    • /
    • v.1 no.1
    • /
    • pp.39-44
    • /
    • 2011
  • Recently, due to people's incontinent use all over the world, fossil fuels such as coal, oil, and natural gas were nearly to be exhausted and also causes serious environment pollutions. Therefore, there is a strong need to develop solar, wind, hydro, biomass, geothermal to replace fossil fuels to prevent suffering from above problems. Wish advances in sensor technology, such data is collected as a kind of stream data which arrives in an online manner so that it is characterized as high- speed, real-time and unbounded and it requires fast data processing to get the up-to-date results. Therefore, the traditional data processing techniques are not fit to deal with stream data. In this paper, we propose a kalman filter-based algorithm to process renewable stream data.

  • PDF

Efficient Filter Operator Ordering On Stream Data Environments (스트림 데이터 환경에서의 효율적인 필터 연산자 순서화)

  • Min, Jun-Ki
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2006.11a
    • /
    • pp.321-324
    • /
    • 2006
  • 인터넷과 인트라넷의 확산에 따라, 스트림 데이터 처리 (stream data processing) 와 같은 새로운 분야가 등장하게 되었다. 스트림 데이터의 특징은 실 시간적이고 연속적으로 생성된다는 것이다. 따라서 기존의 질의 처리와는 달리 질의 또한 연속적으로 처리된다. 본 논문에서는 시간에 따라서 예측할 수 없게 특성이 바뀌는 데이터 스트림에 대한 처리에 대하여 다룬다. 특별히, 본 논문에서는 스트림 데이터에 대한 질의문을 구성하는 연산자들 간의 효율적인 수행 순서 생성 기법을 제안한다. 본 논문에서 제안하는 방법은 시스템의 부담을 적게 주면서도 데이터의 변화에 따라 수행 순서를 변화시킨다. 또한 본 논문에서는 고정 연산자 순서와 비교하여 제안한 기법의 우수성을 보였다.

  • PDF