• Title/Summary/Keyword: Real Data Analysis

Search Result 5,233, Processing Time 0.031 seconds

Efficient Processing of Continuous Join Queries between a Data Stream and Multiple Relations for Real-Time Analysis of E-Commerce Data (전자상거래 데이터의 실시간 분석을 위한 데이터 스트림과 다수 릴레이션 간의 효율적인 연속 조인 처리 기법)

  • Kim, Haeri;Lee, Ki Yong
    • The Journal of Society for e-Business Studies
    • /
    • v.18 no.3
    • /
    • pp.159-175
    • /
    • 2013
  • Recently, as real-time availability of e-commerce data becomes possible, the requirement of real-time analysis of e-commerce increases significantly. In the real-time analysis of e-commerce data, it is very important to efficiently process continuous join queries between an e-commerce data stream and disk-based large relations. In this paper, we propose an efficient method for processing a continuous join query between an e-commerce data stream and multiple disk-based relations. The proposed method improves the service rate significantly, while reducing the amount of required memory substantially. Through analysis and various experiments, we show the efficiency of the proposed method compared with the previous one in terms of service rate and memory usage.

Review of Internet of Things-Based Artificial Intelligence Analysis Method through Real-Time Indoor Air Quality and Health Effect Monitoring: Focusing on Indoor Air Pollution That Are Harmful to the Respiratory Organ

  • Eunmi Mun;Jaehyuk Cho
    • Tuberculosis and Respiratory Diseases
    • /
    • v.86 no.1
    • /
    • pp.23-32
    • /
    • 2023
  • Everyone is aware that air and environmental pollutants are harmful to health. Among them, indoor air quality directly affects physical health, such as respiratory rather than outdoor air. However, studies that have examined the correlation between environmental and health information have been conducted with public data targeting large cohorts, and studies with real-time data analysis are insufficient. Therefore, this research explores the research with an indoor air quality monitoring (AQM) system based on developing environmental detection sensors and the internet of things to collect, monitor, and analyze environmental and health data from various data sources in real-time. It explores the usage of wearable devices for health monitoring systems. In addition, the availability of big data and artificial intelligence analysis and prediction has increased, investigating algorithmic studies for accurate prediction of hazardous environments and health impacts. Regarding health effects, techniques to prevent respiratory and related diseases were reviewed.

A Study on the Data Visualization for Real Time Power System Operation (실시간 전력계통 운영을 위한 데이터 시각화에 관한 연구)

  • Chog, Yoon-Sung;Joung, Jinyoung
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.62 no.10
    • /
    • pp.1361-1367
    • /
    • 2013
  • This paper describes and suggests the data visualization for real time power system operation based on energy management system. Because real time power system operation performs analysis of the vast amount of on-line data, the operators need intuitive data visualization to find out useful information in the big data. Especially, in emergency situation, the data visualization is able to assist the operators in handling the crisis quickly and efficiently. Therefore, this paper aims to improve displays of output of real time power system operation by visualizing on-line big data. Through this study, we can develop improved visualization technique for real time power system operation, which has highly readable displays of output and intuitive information.

Implementation of a Real-time Data fusion Algorithm for Flight Test Computer (비행시험통제컴퓨터용 실시간 데이터 융합 알고리듬의 구현)

  • Lee, Yong-Jae;Won, Jong-Hoon;Lee, Ja-Sung
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.8 no.4 s.23
    • /
    • pp.24-31
    • /
    • 2005
  • This paper presents an implementation of a real-time multi-sensor data fusion algorithm for Flight Test Computer. The sensor data consist of positional information of the target from a radar, a GPS receiver and an INS. The data fusion algorithm is designed by the 21st order distributed Kalman Filter which is based on the PVA model with sensor bias states. A fault detection and correction logics are included in the algorithm for bad measurements and sensor faults. The statistical parameters for the states are obtained from Monte Carlo simulations and covariance analysis using test tracking data. The designed filter is verified by using real data both in post processing and real-time processing.

CIM-Based System For Real-Time Voltage Stability Analysis (CIM 기반의 실시간 전압안정도 해석 시스템 구축)

  • Lee, Sung-Woo;Jang, Moon-Jong;Seo, Dong-Wan;Namkoong, Won
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.27 no.10
    • /
    • pp.41-49
    • /
    • 2013
  • There is a wide variety of system and applications in the power system. However, they have compatibility issues because they use different data standard and communication method. With the introduction of the smart grid, power system has been grow and diversified. Therefore power system need to be compatible with each other and the interoperability between applications is increasingly important. Thus, the IEC established IEC61970 and CIM Standard data exchange model for interoperability and system integration. Server-Client system was constructed which using CIM HSDA(Part4), a standard communication model, presented in IEC 619710. Also, self-developed real-time voltage stability analysis application and contingency analysis application was used. CIM HSDA was used for data input and real-time analysis. Tolerance of result which is in the range of allowable derived by Perform real-time voltage stability and contingency analysis of Jeju power system, and then compare it's result with PSS/E result.

Spatio-temporal Analysis using Real-Time Data Processing for Wireless Sensor Networks (무선 센서 네트워크에서 실시간 데이터 처리를 이용한 시공간 분석)

  • Baek, Jeong-Ho;Mun, Young-Chae;Lee, Hong-Ro
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.16 no.6
    • /
    • pp.688-692
    • /
    • 2010
  • Wireless sensor network system collects and analyzes real-time data that have been requested by the many application nodes. This paper has constructed a sensor network cluster with various elements in the Gunsan City area of Jeollabuk-do, S.korea. The purpose of this paper is to utilize the constructed system in order to illustrate the real-time data in a diagram and analyze it to deduce the change ratio. The resulting analysis contents allow simple data interpretation by illustrating the data in change ratio by time, space, and motional directions. This analytical method will offer great benefit to those users using the wireless sensor network.

Real-time Dangerous Driving Behavior Analysis Utilizing the Digital Tachograph and Smartphone

  • Kang, Joon-Gyu;Kim, Yoo-Won;Jun, Moon-Seog
    • Journal of the Korea Society of Computer and Information
    • /
    • v.20 no.12
    • /
    • pp.37-44
    • /
    • 2015
  • In this paper, we propose the assistance method to enable safe driving through analysis of dangerous driving behavior using real-time alarm by vehicle speed, azimuth data and smartphone. For this method, smartphone is receiving driving data from digital tachograph using communication. Safe driving habit is a very important issue to commercial vehicle because that driver's long time driving than other vehicle type driver. Existing methods are very inefficient to improve immediately dangerous driving habits during driving because proceed driving behavior analysis after the vehicle operation. We propose the new safe driving assistance method that can prevent traffic accidents by real-time and improve the driver's wrong driving habits through real-time dangerous driving behavior analysis and notification the result to the driver. We have confirmed that the method in this paper will help to improve driving habits and can be applied through the proposed method implementation and simulation experiment.

Real-time data analysis technique using large data compression based spark (스파크 기반의 대용량 데이터 압축을 이용한 실시간 데이터 분석 기법)

  • Park, Soo-Yong;Shin, Yong-Tae
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2020.07a
    • /
    • pp.545-546
    • /
    • 2020
  • 스파크는 데이터 분석을 위한 오픈소스 툴이다. 스파크에서는 실시간 데이터 분석을 위하여 스파크 스트리밍이라는 기술을 제공한다. 스파크 스트리밍은 데이터 소스가 분석서버로 데이터 스트림을 전송한다. 이때 전송하는 데이터의 크기가 커질 경우 전송과정에서 지연이 발생할 수 있다. 제안하는 기법은 전송하고자 하는 데이터의 크기가 클 때 허프만 인코딩을 이용하여 데이터를 압축하여 전송시키므로 지연시간을 줄일 수 있다.

  • PDF

Real-Time Sink Node Architecture for a Service Robot Based on Active Healthcare/Living-support USN (능동 건강/생활지원 USN 기반 서비스 로봇 시스템의 실시간 싱크 노드 구조)

  • Shin, Dong-Gwan;Yi, Soo-Yeong;Choi, Byoung-Wook
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.14 no.7
    • /
    • pp.720-725
    • /
    • 2008
  • This paper proposes a system architecture for USN with a service robot to provide more active assisted living services for elderly persons by monitoring their mental and physical well-being with USN environments at home, hospital, or silver town. Sensors embedded in USN are used to detect preventive measures for chronic disease. Logged data are transferred to main controller of a service robot via wireless channel in which the analysis of data is performed. For the purpose of handling emergency situations, it needs real-time processing on gathering variety sensor data, routing algorithms for sensor nodes to a moving sink node and processing of logged data. This paper realized multi-hop sensor network to detect user movements with biometric data transmission and performed algorithms on Xenomai, a real-time embedded Linux. To leverage active sensing, a mobile robot is used of which task was implemented with a priority to process urgent data came from the sink-node. This software architecture is anticipated to integrate sensing, communication and computing with real-time manner. In order to verify the usefulness of a proposed system, the performance of data transferring and processing on a real-time OS with non real-time OS is also evaluated.

Proposal an Alternative Data Pipeline to Secure the Timeliness for Official Statistical Indicators (공식발표 통계지표의 적시성 확보를 위한 대안 데이터 파이프라인 구축제안)

  • Yongbok Cho;Dowan Kim
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.28 no.5
    • /
    • pp.89-108
    • /
    • 2023
  • This study provides a comprehensive analysis of recent studies conducted on the topic of nowcasting in order to enhance the accuracy and promptness of official statistical data. Furthermore, we propose an alternative approach involving the utilization of real-time data and its corresponding collection methods to effectively operate a real-time nowcasting model capable of accurately capturing the current economic condition. We explore high-frequency real-time data that can predict economic indicators in both the public and private sectors and propose a pipeline for data collection processing and modeling that is based on cloud platforms. Furthermore we validate the essential elements required for the implementation of real-time nowcasting, as well as their data management protocols to ensure the reliability and consistency needed for accurate forecasting of official statistical indicators.