• Title/Summary/Keyword: Multiple Stream

Search Result 364, Processing Time 0.023 seconds

Performance Evaluation and Analysis of Multiple Scenarios of Big Data Stream Computing on Storm Platform

  • Sun, Dawei;Yan, Hongbin;Gao, Shang;Zhou, Zhangbing
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.7
    • /
    • pp.2977-2997
    • /
    • 2018
  • In big data era, fresh data grows rapidly every day. More than 30,000 gigabytes of data are created every second and the rate is accelerating. Many organizations rely heavily on real time streaming, while big data stream computing helps them spot opportunities and risks from real time big data. Storm, one of the most common online stream computing platforms, has been used for big data stream computing, with response time ranging from milliseconds to sub-seconds. The performance of Storm plays a crucial role in different application scenarios, however, few studies were conducted to evaluate the performance of Storm. In this paper, we investigate the performance of Storm under different application scenarios. Our experimental results show that throughput and latency of Storm are greatly affected by the number of instances of each vertex in task topology, and the number of available resources in data center. The fault-tolerant mechanism of Storm works well in most big data stream computing environments. As a result, it is suggested that a dynamic topology, an elastic scheduling framework, and a memory based fault-tolerant mechanism are necessary for providing high throughput and low latency services on Storm platform.

DISSECTION TECHNIQUE FOR EFFICIENT JOIN OPERATION ON SEMI-STRUCTURED DOCUMENT STREAM

  • Seo, Dong-Hyeok;Lee, Dong-Gyu;Ryu, Keun-Ho
    • Proceedings of the KSRS Conference
    • /
    • 2007.10a
    • /
    • pp.11-13
    • /
    • 2007
  • There has been much interest in stream query processing. Various index techniques and advanced join techniques have been proposed to efficiently process data stream queries. Previous proposals support rapid and advanced response to the data stream queries. However, the amount of data stream is increasing and the data stream query processing needs more speedup than before. In this paper, we proposed novel query processing techniques for large number of incoming documents stream. We proposed Dissection Technique for efficient query processing in the data stream environment. We focused on the dissection technique in join query processing. Our technique shows efficient operation performance comparing with the other proposal in the data stream. Proposed technique is applied to the sensor network system and XML database.

  • PDF

An Analysis of Agenda-setting Process to Appoint Library Professional as the Director of National Assembly Library: Based on the Kingdon's Multiple Streams Model (국회도서관장 전문가 임명 정책 의제화 과정 분석 - Kingdon의 다중흐름모형을 적용하여 -)

  • Yeon, Jieun;Kim, Giyeong
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.51 no.3
    • /
    • pp.293-322
    • /
    • 2017
  • The purpose of the study is to identify the background of the agenda-setting to appoint library professional as the director of National Assembly Library and characteristics of the policy entrepreneur of this agenda. To this purpose an agenda-setting process in 2014 is analyzed with the Kingdon's multiple streams model. Kingdon's multiple streams model explains that an agenda is set when a window of opportunity is opened by coupling of problem stream, political stream, and policy stream. They have existed independently before setting the agenda. This study showed that the political stream was the major stream to open the window of opportunity. The lawmaker in the opposition party is identified as the leader for the agenda and the motivations, resources, and strategies of the policy entrepreneur were also analyzed. The analysis showed the agenda for library professional as the director was set without visible participation of library professionals. Therefore this study proposed the library professionals' roles for the library and information policy making process.

Conservation Strategy on Stream Water Quality in the Mt. Bughansan National Park (II) -­With a Special Reference to the Factor influenced on Stream Water Quality Pollution­- (북한산국립공원의 계류수질 보전 전략 (II) ­-계류수질오염 영향인자를 중심으로­-)

  • Park, Jae-Hyeon
    • Journal of the Korean Society of Environmental Restoration Technology
    • /
    • v.5 no.1
    • /
    • pp.8-18
    • /
    • 2002
  • This research was conducted to establish the conservation strategy of stream water quality by analyzing the factors influenced on stream water quality in the northeastern part of Mt. Bughansan National Park from July 1998 to October 2001. The number of visitors resulted in the significant increase of electrical conductivity, which affected on pollution of the stream water quality. According to the multiple regression analysis, the pH of the stream water was related to dissolved oxygen and temperature of water at the 1% significant level. The electrical conductivity of the stream water was related to number of visitors, amount of $K^+$ and ${NO_3}^-$, total amount of ions, percentages of $Cl^-$ and $Na^+$ caused by solifluction soil at the 1% significant level. The anions($Cl^-$, ${NO_3}^-$ and ${SO_4}^{2-}$) of the stream water were related to number of visitors, electrical conductivity, air temperature, hardness, amount of ${NO_3}^-$, ${SO_4}^{2-}$, total ions, percentage of $Cl^-$, ${NO_3}^-$, ${SO_4}^{2-}$, amount of $Ca^{2+}$ caused by solifluction soil at the 1% significant level. To prevent the pollution of stream water in the northeastern part of Mt. Bughansan National Park, it is recommended that the number of visitors in the park should be managed and rehabilitated rapidly by measure to eco-friendly during the spring season.

Data Stream Allocation Algorithm for Maximizing Sum Capacity in Multiuser MIMO Systems (다중 사용자 MIMO 시스템에서 전체 채널 용량을 최대화하기 위한 데이터 스트림 할당 기법)

  • Kim, Bong-Seok;Choi, Kwon-Hue
    • Journal of Satellite, Information and Communications
    • /
    • v.6 no.1
    • /
    • pp.19-27
    • /
    • 2011
  • In this paper, we propose the data stream allocation algorithms for maximizing sum capacity of downlink multiuser MIMO (Multiple-input Multiple-output) systems with BD (Block Diagonalization). The conventional BD precoding algorithms maximize the capacity by controlling power against channel gain of each user. In multiuser MIMO systems, however, the number of data streams for each user can be used to as another control parameter, which determines the capacity. This paper proposes the data stream allocation algorithm of BD for increasing capacity in multiuser MIMO systems. The proposed algorithm allocates unequal bit stream to each user based on channel matrix of each user for maximizing sum capacity. It is proved that proposed algorithm can achieve the significantly improved sum capacity by computer simulation.

Analysis of the Changes of the Vegetated Area in an Unregulated River and Their Underlying Causes: A Case Study on the Naeseong Stream

  • Lee, Chanjoo;Kim, Donggu
    • Ecology and Resilient Infrastructure
    • /
    • v.5 no.4
    • /
    • pp.229-245
    • /
    • 2018
  • This study aims to investigate the changes in the riparian vegetated area in the Naeseong stream, an unregulated river, in order to analyze the main factors leading to these changes. For this purpose, the land surface cover in the channel area of the Naeseong stream was classified into 9 categories using past aerial photographs collected between 1970 and 2016, which recorded the long-term changes of the Naeseong stream. The increase or decrease in the vegetated area was calculated for each category using a pair of before and after images. The changes in the vegetated area were divided into 6 periods: the unvegetated channel period (1970 - 1980), the first rapid increase (1980 - 1986), the period of decrease due to flood (1986 - 1988), the period of repetitive man-induced disturbance and vegetation increase (1988 - 2008), the period of gradual vegetation increase (2008 - 2013), and the period of second rapid increase (2013 - 2016). Multiple regression analysis was performed using independent variables representing hydrology, climate, and geomorphology. The major variables found to be involved in the changes in the vegetated area of the Naeseong stream were the discharge during June - July, channel width, and temperature during April - June. Among the three variables, discharge and temperature were respectively the main independent variables in the downstream and the upstream reaches as per a single variable model. Channel width was the variable that distinguished the upstream and downstream reaches of the stream. The implication of the long-term increase in the vegetated area in the Naeseong stream was discussed based on the result of this study.

Multi-stream Delivery Method of the Video Signal based on Wavelet (웨이브릿 기반 비디오 신호의 멀티 스트림 전송 기법)

  • 강경원;류권열;권기룡;문광석;김문수
    • Proceedings of the IEEK Conference
    • /
    • 2001.06c
    • /
    • pp.101-104
    • /
    • 2001
  • Over the last few years, streaming audio and video content on Internet sites has increased at unprecedented rates. The predominant method of delivering video over the current Internet is video streaming such as SureStream or Intelligent Stream. Since each method provides the client with only one data stream from one server, it often suffers from poor qualify of pictures in the case of network link congestion. In this paper, we propose a novel method of delivering video stream based on wavelet to a client by utilizing multi-threaded parallel connections from the client to multiple servers and to provides a better way to address the scalability functionalities. The experimental results show that the video quality delivered by the proposed multithreaded stream could significantly be improved over the conventional single video stream methods.

  • PDF

Study on the Critical Storm Duration Decision of the Rivers Basin (중소하천유역의 임계지속시간 결정에 관한 연구)

  • Ahn, Seung-Seop;Lee, Hyeo-Jung;Jung, Do-June
    • Journal of Environmental Science International
    • /
    • v.16 no.11
    • /
    • pp.1301-1312
    • /
    • 2007
  • The objective of this study is to propose a critical storm duration forecasting model on storm runoff in small river basin. The critical storm duration data of 582 sub-basin which introduced disaster impact assessment report on the National Emergency Management Agency during the period from 2004 to 2007 were collected, analyzed and studied. The stepwise multiple regression method are used to establish critical storm duration forecasting models(Linear and exponential type). The results of multiple regression analysis discriminated the linear type more than exponential type. The results of multiple linear regression analysis between the critical storm duration and 5 basin characteristics parameters such as basin area, main stream length, average slope of main stream, shape factor and CN showed more than 0.75 of correlation in terms of the multi correlation coefficient.

Efficient Processing of Multidimensional Sensor stream Data in Digital Marine Vessel (디지털 선박 내 다차원 센서 스트림 데이터의 효율적인 처리)

  • Song, Byoung-Ho;Park, Kyung-Woo;Lee, Jin-Seok;Lee, Keong-Hyo;Jung, Min-A;Lee, Sung-Ro
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.35 no.5B
    • /
    • pp.794-800
    • /
    • 2010
  • It is necessary to accurate and efficient management for measured digital data from various sensors in digital marine vessel. It is not efficient that sensor network process input stream data of mass storage stored in database the same time. In this paper, We propose to improve the processing performance of multidimensional stream data continuous incoming from multiple sensor. We propose that we arrange some sensors (temperature, humidity, lighting, voice) and process query based on sliding window for efficient input stream and found multiple query plan to Mjoin method and we reduce stored data using SVM algorithm. We automatically delete that it isn't necessary to the data from the database and we used to ship diagnosis system for available data. As a result, we obtained to efficient result about 18.3% reduction rate of database using 35,912 data sets.

Data Stream Allocation for Fair Performance in Multiuser MIMO Systems (다중 사용자 MIMO 환경에서 균등한 성능을 보장하는 데이터 스트림 할당 기법)

  • Lim, Dong-Ho;Choi, Kwon-Hue
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.34 no.12A
    • /
    • pp.1006-1013
    • /
    • 2009
  • This paper proposes a data stream allocation technique for fair capacity performance in multiuser multiple-input multiple-output (MIMO) systems using block diagonalization (BD) algorithm. Conventional studies have been focused on maximum sum capacity. Thus, there is a very large difference of capacity among users, since user capacity unfairly distributed according to each user channel environment. In additional, poor channel user has very small capacity, since base station allocates the power by using water-filling technique. Also, almost studies limited itself to obtain the additional gain by using the same number of data streams for all users. In this paper, we propose the technique for maximizing sum capacity under the fair performance constraint by allocating data stream according to user channel environment. Also, proposed algorithm has more gain of sum capacity and transmit power than conventional equal allocation via computer simulation.