• Title/Summary/Keyword: data stream technology

Search Result 414, Processing Time 0.032 seconds

An Analysis of IT Trends Using Tweet Data (트윗 데이터를 활용한 IT 트렌드 분석)

  • Yi, Jin Baek;Lee, Choong Kwon;Cha, Kyung Jin
    • Journal of Intelligence and Information Systems
    • /
    • v.21 no.1
    • /
    • pp.143-159
    • /
    • 2015
  • Predicting IT trends has been a long and important subject for information systems research. IT trend prediction makes it possible to acknowledge emerging eras of innovation and allocate budgets to prepare against rapidly changing technological trends. Towards the end of each year, various domestic and global organizations predict and announce IT trends for the following year. For example, Gartner Predicts 10 top IT trend during the next year, and these predictions affect IT and industry leaders and organization's basic assumptions about technology and the future of IT, but the accuracy of these reports are difficult to verify. Social media data can be useful tool to verify the accuracy. As social media services have gained in popularity, it is used in a variety of ways, from posting about personal daily life to keeping up to date with news and trends. In the recent years, rates of social media activity in Korea have reached unprecedented levels. Hundreds of millions of users now participate in online social networks and communicate with colleague and friends their opinions and thoughts. In particular, Twitter is currently the major micro blog service, it has an important function named 'tweets' which is to report their current thoughts and actions, comments on news and engage in discussions. For an analysis on IT trends, we chose Tweet data because not only it produces massive unstructured textual data in real time but also it serves as an influential channel for opinion leading on technology. Previous studies found that the tweet data provides useful information and detects the trend of society effectively, these studies also identifies that Twitter can track the issue faster than the other media, newspapers. Therefore, this study investigates how frequently the predicted IT trends for the following year announced by public organizations are mentioned on social network services like Twitter. IT trend predictions for 2013, announced near the end of 2012 from two domestic organizations, the National IT Industry Promotion Agency (NIPA) and the National Information Society Agency (NIA), were used as a basis for this research. The present study analyzes the Twitter data generated from Seoul (Korea) compared with the predictions of the two organizations to analyze the differences. Thus, Twitter data analysis requires various natural language processing techniques, including the removal of stop words, and noun extraction for processing various unrefined forms of unstructured data. To overcome these challenges, we used SAS IRS (Information Retrieval Studio) developed by SAS to capture the trend in real-time processing big stream datasets of Twitter. The system offers a framework for crawling, normalizing, analyzing, indexing and searching tweet data. As a result, we have crawled the entire Twitter sphere in Seoul area and obtained 21,589 tweets in 2013 to review how frequently the IT trend topics announced by the two organizations were mentioned by the people in Seoul. The results shows that most IT trend predicted by NIPA and NIA were all frequently mentioned in Twitter except some topics such as 'new types of security threat', 'green IT', 'next generation semiconductor' since these topics non generalized compound words so they can be mentioned in Twitter with other words. To answer whether the IT trend tweets from Korea is related to the following year's IT trends in real world, we compared Twitter's trending topics with those in Nara Market, Korea's online e-Procurement system which is a nationwide web-based procurement system, dealing with whole procurement process of all public organizations in Korea. The correlation analysis show that Tweet frequencies on IT trending topics predicted by NIPA and NIA are significantly correlated with frequencies on IT topics mentioned in project announcements by Nara market in 2012 and 2013. The main contribution of our research can be found in the following aspects: i) the IT topic predictions announced by NIPA and NIA can provide an effective guideline to IT professionals and researchers in Korea who are looking for verified IT topic trends in the following topic, ii) researchers can use Twitter to get some useful ideas to detect and predict dynamic trends of technological and social issues.

Simulation Conditions based Characteristics of Spatial Flood Data Extension (모의조건에 따른 홍수 유출자료의 공간적 확장 영향분석)

  • Kim, Nam Won;Jung, Yong;Lee, Jeong Eun
    • Journal of Korea Water Resources Association
    • /
    • v.47 no.6
    • /
    • pp.501-511
    • /
    • 2014
  • The effects of initial conditions and input values of the rainfall-runoff model were studied in the applications of a lumped concept model for flood event data extension. For the initial conditions of the rainfall-runoff model, baseflow effects and spatial distributions of saturation points ($R_{sa}$) for the storage function methods (SFM) were analyzed. In addition, researches on the effects of rainfall data conditions as input values for the rainfall-runoff model were performed. The Chungju Dam watershed was selected and divided into 3 catchments including smaller size of 22 sub-catchments. The observed discharge and inflow amounts at Yeongwol 1, Chungju Dam, and Yeongwol 2 water level stations were individually operated as criteria for flood data extension in 30 flood events from 1993 to 2009. Direct and base flow were distinguished from a stream flow. In order to test capability of flood data extension, obtained base flow was applied to the rainfall-runoff model for three water level stations. When base flow was adopted in the model, the Nash-Sutcliffe Efficiency(NSE) was increased. The numbers of over satisfaction for model performance (>0.5) were increased over 10%. Saturation points ($R_{sa}$) which strongly influence the runoff amount when rainfall starts were optimized based on the runoff amount at three water level stations. The sizes of saturation points for three locations were similar which means saturation point size is not depending on the runoff amount. The effects of rainfall information for flood runoff were tested at 2002ev1 and 2008ev1. When increased the amount of rainfall information, the runoff simulations were closer to the simulations with full of rainfall information. However, the size of improvement was not substantial on rainfall-runoff simulations in terms of the size of total amount of rainfall.

Spatial Distribution and Dynamics of Vegetation on a Gravel Bar: Case Study in the Bangtae Stream (자갈 하중주에서 식생의 공간 분포 및 동태: 방태천의 사례)

  • Pee, Jung-Hun;Kim, Hye-Soo;Kim, Gyung-Soon;Oh, Woo-Seok;Koo, Bon-Yoel;Lee, Chang-Seok
    • Korean Journal of Ecology and Environment
    • /
    • v.46 no.2
    • /
    • pp.215-224
    • /
    • 2013
  • We clarified the background for establishment of vegetation by comparing the spatial distribution maps of vegetation and substrate on a gravel bar in the Bangtae stream located on Inje-gun of Gangwon-do, the central eastern Korea. The total vegetation coverage was higher in the interior and lower in the marginal parts of the gravel bar. Spatial distribution of vegetation on the longitudinal section of the gravel bar tended to be arranged in the order of shrub, subtree, and tree dominated vegetation types from the front (upstream) toward the rear (downstream) parts. Coverage of the herbaceous plants was higher in the central and rear parts and lower in the front and right parts of the gravel bar. Vegetation height was higher in the rear part and became lowered as move toward the front part. Substrate was distributed in the order of boulder, gravel, sand, and boulder from the front toward the rear parts. Ordination of stands based on vegetation data was arranged in the order of annual plant, perennial herb, shrub, and tree dominated vegetation as move from the right to the left parts on the axis I. Species richness was higher in the order of Pinus densiflora community, Phragmites japonica community, Salix gracilistyla community, Fraxinus rhynchophylla community, annual plant dominated vegetation, and Prunus padus for. padus community based on the species rank-abundance curve. The order based on the Shannon's index was some different; diversity of Phragmites japonica community and Salix gracilistyla community, which showed higher dominance degree, were low differently from species richness. In conclusion, it was evaluated that the gravel bar newly established toward the upstream and vegetation dynamics of the gravel bar seemed to follow ecosystem mechanisms of succession. As were shown in the above results, the Bangtae stream corresponded to the upstream and thereby particle size of substrate was big. Therefore, they move by rolling and are accumulated for the upstream. Vegetation types were arranged in the order of woodland, shrub-land and grassland from the rear toward the front parts of the gravel bar and thereby reflected the formation process of the bar. However, the gravel bar is disturbed frequently by not only the running water but also the suspended sand as the dynamic space. Such disturbances cause habitat diversity and consequently led to high biodiversity.

Development of Radar Polygon Method : Areal Rainfall Estimation Technique Based on the Probability of Similar Rainfall Occurrence (Radar Polygon 기법의 개발 : 유사강우발생 확률에 근거한 면적강우량 산정기법)

  • Cho, Woonki;Lee, Dongryul;Lee, Jaehyeon;Kim, Dongkyun
    • Journal of Korea Water Resources Association
    • /
    • v.48 no.11
    • /
    • pp.937-944
    • /
    • 2015
  • This study proposed a novel technique, namely the Radar Polygon Method (RPM), for areal rainfall estimation based on radar precipitation data. The RPM algorithm has the following steps: 1. Determine a map of the similar rainfall occurrence of which each grid cell contains the binary information on whether the grid cell rainfall is similar to that of the observation gage; 2. Determine the similar rainfall probability map for each gage of which each grid cell contains the probability of having the rainfall similar to that of the observation gage; 3. Determine the governing territory of each gage by comparing the probability maps of the gages. RPM method was applied to the Anseong stream basin. Radar Polygons and Thiessen Polygons of the study area were similar to each other with the difference between the two being greater for the rain gage highly influenced by the orography. However, the weight factor between the two were similar with each other. The significance of this study is to pioneer a new application field of radar rainfall data that has been limited due to short observation period and low accuracy.

Analysis of Soil Erosion Hazard Zone using GIS (GIS를 이용한 토양침식 위험지역 분석)

  • Kim, Joo-Hun;Kim, Kyung-Tak;Yeon, Gyu-Bang
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.6 no.2
    • /
    • pp.22-32
    • /
    • 2003
  • The purpose of this study is to analyze soil erosion quantity of a basin by using DEM, soil map and landuse map and to find a soil erosion hazard zone in a basin based on this data. In this study, RUSLE was used to analyze soil loss quantity and the research area chosen is Mushim stream which branches off the Geum river. This study used a mean annual precipitation of Cheongju Meteorological Observation was used as a hydrological data and DEM, the detailed soil map(1/25,000), the landuse map collected respectively from Ministry of Environment, National Institute of Agricultural Science and Technology and Ministry of Construction and Transportation. The subject map was drawn to analyze soil erosion hazard zone by using the above data and maps. According to the results of the analysis, a lot of soil loss shows in a bare area. In case of a forest, a slope has a lot of influence on soil loss. The integration and analysis of the above gave the result that $193,730.3m^2$corresponding to 8.5% of the places of which the slope is over 20 degree in a bare area was found to have a higher chance of soil erosion.

  • PDF

Consideration of Roman Character in KS × 1001 Code System for Information Interchange considered AMI/HDB-3 and HDLC FLAG (AMI/HDB-3 회선부호화 및 HDLC FLAG를 고려한 KS × 1001 정보 교환용 로마문자 부호체계고찰)

  • Hong, Wan-Pyo
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.8 no.7
    • /
    • pp.1017-1023
    • /
    • 2013
  • Datacommunications transmit the source codes that are coded in information devices, such as computer to the transmission line by means of the line coded signal. AMI method is applied to the line coding method to transmit the signal for long distance. The disadvantage of the AMI method is to loss the bit synchronization when consecutive binary bit '0' over 4ea is coming into line coder. The scrambling technique is used to overcome the problem. The HDB-3 scrambling method is used in Korea standard which standard in ITU-T. When the HDB-3 technology is used. the method should convert the consecutive bit '0' over 4ea to certain bits format. As a result, when there are many such kind of '0' bit stream in source codes, data transmission efficiency will be decreased to treat in line coder, etc. This paper is directed to study the Roman character code system in $KS{\times}1001$, Korea standard for information exchange code in datacommunication systems. Based on the study result, this paper proposed the maximum optimized Roman character code system. In the study, Character coding rule for $4{\times}4$bits and the statistical data for roman character using frequency were considered to simulate. The paper shows the result that when the proposed new roman character coding system is applied to use, the data transmission efficiency could be increased to about 134% compared to existing code system.

Applicability Evaluation of Multi Beam Echo Sounder for Inland Water (다중빔 음향측심기의 내수면 적용성 평가)

  • Jung, Jin Woo;Cho, Kwang Hee;Hong, Seung Seo
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.36 no.6
    • /
    • pp.629-639
    • /
    • 2018
  • In this study, the application of the single beam echosounder and multi beam echosounder was analyzed for the Youngsan river, from the Juksanbo to the Juksan bridge, length of 840m, width 230m and area $0.16km^2$. A single beam echosounder and a multi beam echosounder are mounted on an USV (Unmanned Surface Vessel), and each data is acquired. Then, TIN (Triangular Irregular Network) is created and the grid depth of 10m intervals is extracted. The grid depth of the single beam echo sounder and the grid depth of the multi beam echo sounder were overlapped to compare the two data. As a result of analysis using 5,024 data, the mean depth difference was 0.0319m and the standard deviation was 2.4095m. The river bed shape was similar to each other. If the multi-beam echo sounder is regarded as the standard, the volume difference of the stream is $161,882m^3$. With a multi-beam echo sounder installed, the operating distance increased by approximately 55% to 4595.85m, and the operating time increased by approximately 59% to approximately 47%.

Estimation of Groundwater Recharge by Considering Runoff Process and Groundwater Level Variation in Watershed (유역 유출과정과 지하수위 변동을 고려한 분포형 지하수 함양량 산정방안)

  • Chung, Il-Moon;Kim, Nam-Won;Lee, Jeong-Woo
    • Journal of Soil and Groundwater Environment
    • /
    • v.12 no.5
    • /
    • pp.19-32
    • /
    • 2007
  • In Korea, there have been various methods of estimating groundwater recharge which generally can be subdivided into three types: baseflow separation method by means of groundwater recession curve, water budget analysis based on lumped conceptual model in watershed, and water table fluctuation method (WTF) by using the data from groundwater monitoring wells. However, groundwater recharge rate shows the spatial-temporal variability due to climatic condition, land use and hydrogeological heterogeneity, so these methods have various limits to deal with these characteristics. To overcome these limitations, we present a new method of estimating recharge based on water balance components from the SWAT-MODFLOW which is an integrated surface-ground water model. Groundwater levels in the interest area close to the stream have dynamics similar to stream flow, whereas levels further upslope respond to precipitation with a delay. As these behaviours are related to the physical process of recharge, it is needed to account for the time delay in aquifer recharge once the water exits the soil profile to represent these features. In SWAT, a single linear reservoir storage module with an exponential decay weighting function is used to compute the recharge from soil to aquifer on a given day. However, this module has some limitations expressing recharge variation when the delay time is too long and transient recharge trend does not match to the groundwater table time series, the multi-reservoir storage routing module which represents more realistic time delay through vadose zone is newly suggested in this study. In this module, the parameter related to the delay time should be optimized by checking the correlation between simulated recharge and observed groundwater levels. The final step of this procedure is to compare simulated groundwater table with observed one as well as to compare simulated watershed runoff with observed one. This method is applied to Mihocheon watershed in Korea for the purpose of testing the procedure of proper estimation of spatio-temporal groundwater recharge distribution. As the newly suggested method of estimating recharge has the advantages of effectiveness of watershed model as well as the accuracy of WTF method, the estimated daily recharge rate would be an advanced quantity reflecting the heterogeneity of hydrogeology, climatic condition, land use as well as physical behaviour of water in soil layers and aquifers.

Estimation of channel morphology using RGB orthomosaic images from drone - focusing on the Naesung stream - (드론 RGB 정사영상 기반 하도 지형 공간 추정 방법 - 내성천 중심으로 -)

  • Woo-Chul, KANG;Kyng-Su, LEE;Eun-Kyung, JANG
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.25 no.4
    • /
    • pp.136-150
    • /
    • 2022
  • In this study, a comparative review was conducted on how to use RGB images to obtain river topographic information, which is one of the most essential data for eco-friendly river management and flood level analysis. In terms of the topographic information of river zone, to obtain the topographic information of flow section is one of the difficult topic, therefore, this study focused on estimating the river topographic information of flow section through RGB images. For this study, the river topography surveying was directly conducted using ADCP and RTK-GPS, and at the same time, and orthomosiac image were created using high-resolution images obtained by drone photography. And then, the existing developed regression equations were applied to the result of channel topography surveying by ADCP and the band values of the RGB images, and the channel bathymetry in the study area was estimated using the regression equation that showed the best predictability. In addition, CCHE2D flow modeling was simulated to perform comparative verification of the topographical informations. The modeling result with the image-based topographical information provided better water depth and current velocity simulation results, when it compared to the directly measured topographical information for which measurement of the sub-section was not performed. It is concluded that river topographic information could be obtained from RGB images, and if additional research was conducted, it could be used as a method of obtaining efficient river topographic information for river management.

Development and run time assessment of the GPU accelerated technique of a 2-Dimensional model for high resolution flood simulation in wide area (광역 고해상도 홍수모의를 위한 2차원 모형의 GPU 가속기법 개발 및 실행시간 평가)

  • Choi, Yun Seok;Noh, Hui Seong;Choi, Cheon Kyu
    • Journal of Korea Water Resources Association
    • /
    • v.55 no.12
    • /
    • pp.991-998
    • /
    • 2022
  • The purpose of this study is to develop GPU (Graphics Processing Unit) acceleration technique for 2-dimensional model and to assess the effectiveness for high resolution flood simulation in wide area In this study, GPU acceleration technique was implemented in the G2D (Grid based 2-Dimensional land surface flood model) model, using implicit scheme and uniform square grid, by using CUDA. The technique was applied to flood simulation in Jinju-si. The spatial resolution of the simulation domain is 10 m × 10 m, and the number of cells to calculate is 5,090,611. Flood period by typhoon Mitag, December 2019, was simulated. Rainfall radar data was applied to source term and measured discharge of Namgang-Dam (Ilryu-moon) and measured stream flow of Jinju-si (Oksan-gyo) were applied to boundary conditions. From this study, 2-dimensional flood model could be implemented to reproduce the measured water level in Nam-gang (Riv.). The results of GPU acceleration technique showed more faster flood simulation than the serial and parallel simulation using CPU (Central Processing Unit). This study can contribute to the study of developing GPU acceleration technique for 2-dimensional flood model using implicit scheme and simulating land surface flood in wide area.