• Title/Summary/Keyword: Multiple Stream Data

Search Result 178, Processing Time 0.025 seconds

Squall: A Real-time Big Data Processing Framework based on TMO Model for Real-time Events and Micro-batch Processing (Squall: 실시간 이벤트와 마이크로-배치의 동시 처리 지원을 위한 TMO 모델 기반의 실시간 빅데이터 처리 프레임워크)

  • Son, Jae Gi;Kim, Jung Guk
    • Journal of KIISE
    • /
    • v.44 no.1
    • /
    • pp.84-94
    • /
    • 2017
  • Recently, the importance of velocity, one of the characteristics of big data (5V: Volume, Variety, Velocity, Veracity, and Value), has been emphasized in the data processing, which has led to several studies on the real-time stream processing, a technology for quick and accurate processing and analyses of big data. In this paper, we propose a Squall framework using Time-triggered Message-triggered Object (TMO) technology, a model that is widely used for processing real-time big data. Moreover, we provide a description of Squall framework and its operations under a single node. TMO is an object model that supports the non-regular real-time processing method for certain conditions as well as regular periodic processing for certain amount of time. A Squall framework can support the real-time event stream of big data and micro-batch processing with outstanding performances, as compared to Apache storm and Spark Streaming. However, additional development for processing real-time stream under multiple nodes that is common under most frameworks is needed. In conclusion, the advantages of a TMO model can overcome the drawbacks of Apache storm or Spark Streaming in the processing of real-time big data. The TMO model has potential as a useful model in real-time big data processing.

Landscape Evaluation of Rural Stream based on the Factor Analysis of Visual Preference (시각적 선호요인 분석을 통한 농촌 소하천 경관평가에 관한 연구)

  • Kim, Sung-Keun;Cho, Woo-Hyun;Im, Seung-Bin
    • Journal of Korean Society of Rural Planning
    • /
    • v.5 no.1 s.9
    • /
    • pp.35-44
    • /
    • 1999
  • The purpose of this study is to find the bi-polar adjectives for rural stream landscape evaluation by the semantic differential scale and to suggest the major determinants of visual preference in rural stream landscapes. For this, the bi-polar adjectives for rural stream landscape evaluation was found by the method of the reliability test, and the spatial image was analyzed by the factor analysis. The level of visual preference was measured by slide simulation test, and these data were analyzed by the multiple regression. The major findings of this study can be summarized as follows : 1) Of the bi-polar adjectives expressing psychological and physical characteristics, the hi-polar adjectives which demonstrated reliability and consistency run as follows : Bi-polar adjectives expressing psychological characteristics : 'calm-bustling', 'unfamiliar-familiar', 'still-active','depressing-brisk', 'discomfortable-comfortable', 'suppressed-free', 'lifeless-living', 'quiet-noisy', 'unpleasant-pleasant'. Bi-polar adjectives expressing physical characteristics : 'artificial-natural', 'narrow-wide', 'rocky-not rocky', 'desolate-fertile', 'dirty-clean', 'enclosed-open', 'flat-steep', 'not gravelly-gravelly', 'thicketed-not thicketed', 'not weedy-weedy'. 2) Two factors, the harmony and the movement, were derived from the factor analysis for the psychological variables. Three factors, the naturalness, the rock, and the vegetation, were derived from the factor analysis for the physical variables. 3) Rural stream landscape types were classified into four types by the multi-dimensional scaling method. Type III, IV obtained higher rank of visual preference and type I, II obtained lower. 4) For all types, the factors determining the level of visual preference were found to be the harmony, the naturalness, and the vegetation. The visual preference determinants of rural stream landscape need to be considered in improving or restoring the rural stream landscapes.

  • PDF

Development of Concentration Time and Storage Coefficient Considering Regional Trend in Urban Stream Watershed (지역적 성향을 고려한 도시하천 유역의 도달시간 및 저류상수 공식 개발)

  • Bae, Deg-Hyo;Kim, Yong-Jae
    • Journal of Korea Water Resources Association
    • /
    • v.48 no.6
    • /
    • pp.479-489
    • /
    • 2015
  • The objective of this study is to develop the equations for concentration time and storage coefficient considering regional trend in urban stream watershed for reliable hydrological analysis. The 13 basins located in Jungrang, Tan, Anyang, and Hongje stream are selected for the data collection and formula development in this study. The stepwise multiple-regression analysis is used for the development considering watershed, urban, and precipitation characteristic indices. The developed formulae are compared with the domestic and foreign empirical formulae and evaluated the accuracy in urban stream area. It shows the computed value from the equation developed in this study is more accurate than those from other empirical formulae. The error sum, average error and RMSE of computed values from the developed equations in this study are the lowest. The formulae considering the regional trend of urban stream watershed are worth in terms of showing better results than the domestic and foreign empirical formulae. It can be concluded the developed formulae can be useful in urban stream watershed.

Selective Decoding Schemes and Wireless MAC Operating in MIMO Ad Hoc Networks

  • Suleesathira, Raungrong;Aksiripipatkul, Jansilp
    • Journal of Communications and Networks
    • /
    • v.13 no.5
    • /
    • pp.421-427
    • /
    • 2011
  • Problems encountered in IEEE 802.11 medium access control (MAC) design are interferences from neighboring or hidden nodes and collision from simultaneous transmissions within the same contention floors. This paper presents the selective decoding schemes in MAC protocol for multiple input multiple output ad-hoc networks. It is able to mitigate interferences by using a developed minimum mean-squared error technique. This interference mitigation combined with the maximum likelihood decoding schemes for the Alamouti coding enables the receiver to decode and differentiate the desired data streams from co-channel data streams. As a result, it allows a pair of simultaneous transmissions to the same or different nodes which yields the network utilization increase. Moreover, the presented three decoding schemes and time line operations are optimally selected corresponding to the transmission demand of neighboring nodes to avoid collision. The selection is determined by the number of request to send (RTS) packets and the type of clear to send packets. Both theoretical channel capacity and simulation results show that the proposed selective decoding scheme MAC protocol outperforms the mitigation interference using multiple antennas and the parallel RTS processing protocols for the cases of (1) single data stream and (2) two independent data streams which are simultaneously transmitted by two independent transmitters.

Performance Analysis of Multimedia CDMA Mobile Communication System Considering Diverse Qos Requirements (멀티미디어 CDMA 이동통신 시스템에서의 다양한 QoS 요구조건을 고려한 성능 분석)

  • Kim, Baek-Hyun;Shin, Seung-Hoon;Kwak Kyung-Sup
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.27 no.1B
    • /
    • pp.1-12
    • /
    • 2002
  • In the multimedia CDMA mobile communication service, it is required to support various applications, such as voice, video, file transfer, e-mail, and Internet access, with guaranteed QoS. In the mixed traffic environment ,which consists of voice, stream data, and packet data, we analyze the network where preemptive priority is granted to delay-intolerant voice service and a buffer is offered to delay-tolerant stream data service. And, for best-effort packet data service, the access control by transmission permission probability is applied to obtain prominent throughput. To analyze the multimedia CDMA mobile communication system, we build a 2-dimensional markov chain model about prioritized-voice and stream data services and accomplish numerical analysis in combination with packet data traffic based on residual capacity equation.

An Efficient Technique for Processing of Spatial Data Using GPU (GPU를 사용한 효율적인 공간 데이터 처리)

  • Lee, Jae-Il;Oh, Byoung-Woo
    • Spatial Information Research
    • /
    • v.17 no.3
    • /
    • pp.371-379
    • /
    • 2009
  • Recently, GPU (Graphics Processing Unit) has been improved rapidly on the need of speed for gaming. As a result, GPU contains multiple ALU (Arithmetic Logic Unit) for parallel processing of a lot of graphics data, such as transform, ray tracing, etc. Therefore, this paper proposed a technique for parallel processing of spatial data using GPU. Spatial data consists of multiple coordinates, and each coordinate contains value of x and y axis. To display spatial data graphics operations have to be processed to large amount of coordinates. Because the graphics operation is identical and coordinates are multiple data, SIMD (Single Instruction Multiple Data) parallel processing of GPU can be used for processing of spatial data to improve performance. This paper implemented SIMD parallel processing of spatial data using two kinds of SDK (Software Development Kit). CUDA and ATI Stream are used for NVIDIA and ATI GPU respectively. Experiments that measure time of calculation for graphics operations are carried out to observe enhancement of performance. Experimental result is reported that proposed method can enhance performance up to 1,162% for graphics operations. The proposed method that uses parallel processing with GPU for spatial data can be generally used to enhance performance for applications which deal with large amount of spatial data.

  • PDF

Improvement of Upload Traffic through Negotiation in UCC Broadcasting System (P2P 기반의 UCC 방송에서 협상을 통한 업로드 트래픽의 개선)

  • Kim, Ji Hoon
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.10 no.3
    • /
    • pp.171-179
    • /
    • 2014
  • Among the P2P based multimedia streaming architecture, multiple chain architecture has advantage in adapting to dynamically changing network topology simply and rapidly, so this architecture is used for UCC broadcasting system. In UCC broadcasting system, general peer involved in DSLAM becomes UCC server rather than broadcasting system that transfers data from ISP servers. Therefore UCC data generated from UCC server peers is transmitted to peers through DSLAM, and this transmission uses uplink bandwidth of DSLAM. In this paper, I propose an efficient management method of DSLAM uplink bandwidths through negotiating tracker and UCC server peer or head peers of DSLAM. I propose the method that tracker restricts a bitrate of uplink stream of UCC servers when used uplink bandwidth of DSLAM exceeds a certain point of maximum uplink bandwidths. I will show the improved performance of proposed scheme rather than general method with respect to the uplink bandwidth of DSLAM by numerical analysis and simulation.

Ecological Comparisons of Stream Conditions Between the Unimpacted and Impacted Sites: Case Study

  • Lee, Jae-Hoon;Lee, Sang-Jae;An, Kwang-Guk
    • Korean Journal of Ecology and Environment
    • /
    • v.41 no.4
    • /
    • pp.441-448
    • /
    • 2008
  • The purpose of this study was to analyze chemical water quality, fish trophic guilds, tolerance indicators, and fish community conditions in the Gap Stream and to compare the stream conditions between the unimpacted site and impacted site. This study was conducted in the physically stable season (May 2008) to minimize physical impacts such as flow and hydrological disturbance, and applied the study in the Gap Stream with two sites of unimpacted upstream site (Unim-S), mainly surrounded by forested area and impacted site (Im-S), influenced by the wastewater disposal plants and industrial complex in the urban region. Chemical data analysis showed that the degree of organic matter pollution, based on BOD, and COD, was $2{\sim}3$ fold greater in the Im-S than the Unim-S, and that TP, as eutrophication indicators, was 4.7 fold greater in the Im-S. Also, $NH_3-N$ was in 8.2 fold greater in the Im-S ($6.25\;mg\;L^{-1}$) than the Unim-S ($0.76\;mg\;L^{-1}$), indicating a massive influence of wastewater from the disposal plant. Similar results were found in other chemical parameters. Thus, chemical impacts in the Im-S were evident, compared to the unimpacted site. Evaluations of tolerant indicator species indicated that sensitive species were dominant in the Unim-S (23.9%) and tolerant species were dominant (97.8%) in the Im-S. Condition factor (CF) was averaged 0.95 ($0.68{\sim}1.18$) in the Unim-S and 1.08 ($0.93{\sim}1.22$) in the Im-S. Fish community in the Unim-S and Im-S was categorized as Zacco-community and Hemibarbus-community, respectively, and the community diversity index (H') was significantly (p<0.05) higher in the Unim-S (0.810) than the Im-S (0.466). Overall, our results suggest that the comparison approach of various chemical and ecological indicators provide important information in identifying multiple stressors in the stream ecosystems.

Smartphone Real Time Streaming Service using Parallel TCP Transmission (병렬 TCP 통신을 이용한 스마트폰 실시간 스트리밍 서비스)

  • Kim, Jang-Young
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.20 no.5
    • /
    • pp.937-941
    • /
    • 2016
  • This paper proposed an efficient multiple TCP mechanism using Android smartphones for remote control video Wi-Fi stream transmission via network communications in real time. The wireless video stream transmission mechanism can be applied in various area such as real time server stream transmissions, movable drones, disaster robotics and real time security monitoring systems. Moreover, we urgently need to transmit data in timely fashion such as medical emergency, security surveillance and disaster prevention. Our parallel TCP transmission system can play an important role in several area such as real time server stream transmissions, movable drones, disaster robotics and real time security monitoring systems as mentioned in the previous sentence. Therefore, we designed and implemented a parallel TCP transmission (parallel stream) for an efficient real time video streaming services. In conclusion, we evaluated proposed mechanism using parallel TCP transmission under various environments with performance analysis.

Examining Interaction Patterns in Online Discussion through Multiple Lenses

  • HAN, Seungyeon
    • Educational Technology International
    • /
    • v.15 no.2
    • /
    • pp.117-141
    • /
    • 2014
  • This qualitative study investigated different interaction patterns in an online discussion. The data was collected from asynchronous discussion occurred in a graduate course. The data analysis methods include inductive analysis and mapping strategy. The results of the study suggest three layers of interaction: response sequences, interaction amongst participants, and concept map of messages. The visualization of response sequences enabled the researcher to discover complex and dynamic interaction patterns amongst participants. The many-to-many communication feature of online discussion does not always enable direct one-on-one interaction between two participants. Rather, one message contributed to multiple threads in the stream of conversation. In terms of interaction amongst participants, the interaction amongst participants, as indicated in the data, the messages also bind each participant and consequently a group(s) of participants together. It appears that the contribution of one message may not only enable a response to one participant, but also connect many participants to each other. The concept map of messages proposes that response sequences and interaction amongst participants can also be viewed between concepts within messages in the discussion. On the surface, the messages posted by individuals are linked by the system in a linear fashion as they are posted. However, the interaction extends to collaborative conversation amongst participants. Ultimately, a conceptual network of interrelated ideas including multiple perspectives is built in asynchronous discussion.