• 제목/요약/키워드: Distributed Streaming

검색결과 112건 처리시간 0.027초

Hazelcast Vs. Ignite: Opportunities for Java Programmers

  • Maxim, Bartkov;Tetiana, Katkova;S., Kruglyk Vladyslav;G., Murtaziev Ernest;V., Kotova Olha
    • International Journal of Computer Science & Network Security
    • /
    • 제22권2호
    • /
    • pp.406-412
    • /
    • 2022
  • Storing large amounts of data has always been a big problem from the beginning of computing history. Big Data has made huge advancements in improving business processes by finding the customers' needs using prediction models based on web and social media search. The main purpose of big data stream processing frameworks is to allow programmers to directly query the continuous stream without dealing with the lower-level mechanisms. In other words, programmers write the code to process streams using these runtime libraries (also called Stream Processing Engines). This is achieved by taking large volumes of data and analyzing them using Big Data frameworks. Streaming platforms are an emerging technology that deals with continuous streams of data. There are several streaming platforms of Big Data freely available on the Internet. However, selecting the most appropriate one is not easy for programmers. In this paper, we present a detailed description of two of the state-of-the-art and most popular streaming frameworks: Apache Ignite and Hazelcast. In addition, the performance of these frameworks is compared using selected attributes. Different types of databases are used in common to store the data. To process the data in real-time continuously, data streaming technologies are developed. With the development of today's large-scale distributed applications handling tons of data, these databases are not viable. Consequently, Big Data is introduced to store, process, and analyze data at a fast speed and also to deal with big users and data growth day by day.

DSM 을 사용한 VOD 스트리밍 시스템 설계 (Design of the VOD Streaming System Using DSM S/W)

  • 황정현;장승주
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2005년도 춘계학술발표대회
    • /
    • pp.933-936
    • /
    • 2005
  • 네트워크 기술의 발전과 멀티미디어 데이터의 전송을 가능하게 되어 VOD 서버등의 연구가 활발하게 이루어지고 있다. 본 논문에서는 리눅스 시스템에 다윈 스트리밍 서버와 DSM(Distributed Shared Memory)을 구축하고, 구축된 시스템을 이용하여 DSM 기반에서 다윈 스트리밍 서버가 실행이 될 수 있도록 설계한다.

  • PDF

모바일 스트리밍을 위한 분산 트랜스코딩 시스템의 구현 및 효율적인 자원 모니터링 (Implementation and Efficient Resource Monitoring of Distributed Transcoding System for Mobile Streaming)

  • 이성용;최창열
    • 한국정보과학회:학술대회논문집
    • /
    • 한국정보과학회 2004년도 가을 학술발표논문집 Vol.31 No.2 (3)
    • /
    • pp.487-489
    • /
    • 2004
  • 모바일 기기를 이용하여 다양한 멀티미디어 서비스를 즐길 수 있는 환경이 보편화되면서 더 많은 사용자에게 자연스러운 멀티미디어 스트리밍을 제공하기 위해 모바일 기기의 성능 특성과 무선 대역폭 제약을 고려하여 서비스를 적응시키는 기법들이 강구되고 있다. 본 논문에서는 모바일 멀티미디어 스트리밍을 위한 분산 트랜스코딩 시스템을 구현하고 트랜스코딩시 서버의 자원을 효율적으로 관리하는 새로운 기법을 제안하여 성능을 측정, 분석하였다. 제안된 callback 모니터링에서는 트랜스코딩 서버가 할당된 작업을 모두 마치면 자신의 자원 정보를 스스로 갱신하기 때문에 사용자 응답시간이 최소화되고 서버의 가용 자원을 모두 활용하게 된다.

  • PDF

분산 비디오 스트리밍을 위한 FEC(Forward Error Correction)제어기법 (FEC Control Mechanism for Distributed Video Streaming)

  • 이병길;이석주;서경룡
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2004년도 춘계학술발표대회
    • /
    • pp.1363-1366
    • /
    • 2004
  • 인터넷은 best-effort network를 근간으로 하기 때문에 대용량의 비디오 스트리밍을 제공하기에는 대역폭의 제한과 패킷 손실과 같은 다양한 문제가 발생한다. 이러한 문제를 해결하기 위해 다양한 방법들이 제안 되었는데, 본 논문에서는 다수의 송신측이 하나의 수신측으로 FEC를 이용하여 비디오 스트리밍을 제공할 때, 수신측의 ACK에 부가정보를 추가하여 FEC의 성능 개선과 분산 스트리밍 제어가 가능한 기법을 제안한다.

  • PDF

Dynamic Multi-frame Transmission Technology Using the WiMedia MAC for Multi-hop N-screen Services

  • Hur, Kyeong
    • Journal of information and communication convergence engineering
    • /
    • 제14권1호
    • /
    • pp.21-25
    • /
    • 2016
  • N-screen is a promising technology to improve support for multimedia multicasting, content sharing, content mobility, media scalability, and seamless mobility. In this paper, the WiMedia distributed-MAC (D-MAC) protocol is adopted for development of a seamless N-screen wireless service. Furthermore, to provide a multi-hop, one source multi-use N-screen service through point to point streaming in a seamless D-MAC protocol, a dynamic multi-frame transmission technology is proposed. In this technology, a dynamic time slot allocation scheme and a multi-hop resource reservation scheme are combined. In the proposed dynamic time slot allocation scheme, two thresholds, a hard threshold and a soft threshold, are included to satisfy the power consumption and delay requirements. A multi-frame DRP reservation scheme is proposed to minimize end-to-end delay during the multi-hop transmissions between N-screen devices. The proposed dynamic multi-frame transmission scheme enhances N-screen performance in terms of the multi-hop link establishment success rate and link establishment time compared to the conventional WiMedia D-MAC system.

Wireless Channel Management Scheme for ASMD Groups in Wireless N-screen Services

  • Hur, Kyeong
    • 한국멀티미디어학회논문지
    • /
    • 제19권11호
    • /
    • pp.1871-1877
    • /
    • 2016
  • In this paper, a Wireless USB (WUSB) protocol is adopted for development of ASMD (Adaptive Source Multi Device) N-screen wireless services. WUSB is the USB technology merged with WiMedia PHY and Distributed-MAC (D-MAC). However, the current WUSB protocol can't provide seamless N-screen streaming services to moving WUSB devices in home network environment. Therefore, to provide the ASMD N-screen services through WUSB based on D-MAC protocol, a channel management scheme is proposed to support seamless mobility between adjacent ASMD groups for wireless IPTV N-screen services. In simulation results, proposed ASMD channel management (ACM) scheme is compared with conventional WUSB channel management scheme in view points of throughput, average path interference and energy consumption according to various numbers of nodes and elapsed simulation times. Through simulation results, it is explained that proposed ASMD channel management (ACM) scheme should be adopted in the WUSB protocol to realize ASMD N-screen wireless services.

An Attack-based Filtering Scheme for Slow Rate Denial-of-Service Attack Detection in Cloud Environment

  • Gutierrez, Janitza Nicole Punto;Lee, Kilhung
    • Journal of Multimedia Information System
    • /
    • 제7권2호
    • /
    • pp.125-136
    • /
    • 2020
  • Nowadays, cloud computing is becoming more popular among companies. However, the characteristics of cloud computing such as a virtualized environment, constantly changing, possible to modify easily and multi-tenancy with a distributed nature, it is difficult to perform attack detection with traditional tools. This work proposes a solution which aims to collect traffic packets data by using Flume and filter them with Spark Streaming so it is possible to only consider suspicious data related to HTTP Slow Rate Denial-of-Service attacks and reduce the data that will be stored in Hadoop Distributed File System for analysis with the FP-Growth algorithm. With the proposed system, we also aim to address the difficulties in attack detection in cloud environment, facilitating the data collection, reducing detection time and enabling an almost real-time attack detection.

MPEG-21기반 디지털 컨버젼스 플랫폼 기술 (A Digital Convergence Platform based on the MPEG-21 Multimedia Framework)

  • 오화룡;김동환;이은서;장태규
    • 전기학회논문지
    • /
    • 제56권5호
    • /
    • pp.987-989
    • /
    • 2007
  • This paper describes a digital convergence platform(DCP) which is implemented based on the MPEG-21 multimedia framework. DCP is a newly proposed solution in this research for the convergence service of future home multimedia environment. DCP is a common platform designed to have the feature of reconfigurability, by means of S/W. which supports to run diverse digital multimedia services. A distributed peer to peer service and transaction model is also a new feature realized in DCP using the MPEG-21 multimedia framework. A prototype DCP is implemented to verify its functions of multimedia service and transactions. The developed DCPs are networked with IP clustering storage systems for the distributed service of multimedia. Successful streaming services of the MPEG-2/4 video and audio are verified with the implemented test-bed system of DCP.

Distributed Indexing Methods for Moving Objects based on Spark Stream

  • Lee, Yunsou;Song, Seokil
    • International Journal of Contents
    • /
    • 제11권1호
    • /
    • pp.69-72
    • /
    • 2015
  • Generally, existing parallel main-memory spatial index structures to avoid the trade-off between query freshness and CPU cost uses light-weight locking techniques. However, still, the lock based methods have some limits such as thrashing which is a well-known problem in lock based methods. In this paper, we propose a distributed index structure for moving objects exploiting the parallelism in multiple machines. The proposed index is a lock free multi-version concurrency technique based on the D-Stream model of Spark Stream. The proposed method exploits the multiversion nature of D-Stream of Spark Streaming.

네트워크 멀티미디어 시스템 구현 이슈 및 QoS 협상 프로토콜 모델 (Design Issues and QoS Negotiation Protocol Model for Networked Multimedia Systems)

  • 이원준
    • 정보처리학회논문지C
    • /
    • 제9C권5호
    • /
    • pp.757-764
    • /
    • 2002
  • 본 논문에서는 분산 멀티미디어 응용을 위한 객체 지향형 프레임워크 방식으로 설계된 네트워크 멀티미디어 관리 시스템 개발에 관한 설계 이슈 및 프로토타입 개발 경험을 기술하고, 특히 멀티미디어 관리 시스템의 일부로서 개발한 비디오 서버 상에 적용 가능한 통합형 QoS-자원 협상 프로토콜의 주요 특징에 관하여 설명한다. 구현된 멀티미디어 프레임 워크 상에서 효율적인 멀티미디어 스트리밍을 지원하기 위하여 새로 제안된 QoS 협상 정책을 실제 서버에 적용하는데 있어서 고려해야 할 중요 이슈에 대해서도 분석하였다.