• Title/Summary/Keyword: Sensor Data Stream

Search Result 124, Processing Time 0.023 seconds

A Study on the Data Collection Methods based Hadoop Distributed Environment (하둡 분산 환경 기반의 데이터 수집 기법 연구)

  • Jin, Go-Whan
    • Journal of the Korea Convergence Society
    • /
    • v.7 no.5
    • /
    • pp.1-6
    • /
    • 2016
  • Many studies have been carried out for the development of big data utilization and analysis technology recently. There is a tendency that government agencies and companies to introduce a Hadoop of a processing platform for analyzing big data is increasing gradually. Increased interest with respect to the processing and analysis of these big data collection technology of data has become a major issue in parallel to it. However, study of the collection technology as compared to the study of data analysis techniques, it is insignificant situation. Therefore, in this paper, to build on the Hadoop cluster is a big data analysis platform, through the Apache sqoop, stylized from relational databases, to collect the data. In addition, to provide a sensor through the Apache flume, a system to collect on the basis of the data file of the Web application, the non-structured data such as log files to stream. The collection of data through these convergence would be able to utilize as a basic material of big data analysis.

Performance and functionality of SRI detector array and focal plane electronics

  • Kim, Young-Sun;Kong, Jong-Pil;Heo, Haeng-Pal;Park, Jong-Euk;Chang, Young-Jun
    • Proceedings of the KSRS Conference
    • /
    • v.2
    • /
    • pp.804-807
    • /
    • 2006
  • The SRI(Super Resolution Imager) with 800mm aperture primary mirror is the ground development model of the high resolution satellite camera. The SRI focal plane electronics including detector array generates the data for high-resolution images by converting incoming light into digital stream of pixel data. Since the focal plane including a detector is the basic building block of the camera system, the main system performances is directly determined by its performance. This paper measures the SRI focal plane electronics’ performance such as the dark signal, the dark signal noise, the linearity, the PRNU(Photo Response Non-Uniformity), the SNR(Signal to Noise Ratio) and the sensor saturation capability. In addition, this paper verifies the various functionalities of the SRI focal plane electronics. The electrical test equipment with the specialized software and the optical test equipments such as the integrating sphere, the rotation stage and the target are implemented and used to verify these functionalities and performances.

  • PDF

Feature Selection for Abnormal Driving Behavior Recognition Based on Variance Distribution of Power Spectral Density

  • Nassuna, Hellen;Kim, Jaehoon;Eyobu, Odongo Steven;Lee, Dongik
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.15 no.3
    • /
    • pp.119-127
    • /
    • 2020
  • The detection and recognition of abnormal driving becomes crucial for achieving safety in Intelligent Transportation Systems (ITS). This paper presents a feature extraction method based on spectral data to train a neural network model for driving behavior recognition. The proposed method uses a two stage signal processing approach to derive time-saving and efficient feature vectors. For the first stage, the feature vector set is obtained by calculating variances from each frequency bin containing the power spectrum data. The feature set is further reduced in the second stage where an intersection method is used to select more significant features that are finally applied for training a neural network model. A stream of live signals are fed to the trained model which recognizes the abnormal driving behaviors. The driving behaviors considered in this study are weaving, sudden braking and normal driving. The effectiveness of the proposed method is demonstrated by comparing with existing methods, which are Particle Swarm Optimization (PSO) and Convolution Neural Network (CNN). The experiments show that the proposed approach achieves satisfactory results with less computational complexity.

Evaluation of Interactions Between Surface Water and Groundwater Based on Temperature, Flow Properties, and Geochemical Data (온도, 유동특성 및 지화학분석 자료를 이용한 지표수-지하수 연계특성 평가)

  • Jeon, Hang-Tak;Kim, Gyoo-Bum
    • The Journal of Engineering Geology
    • /
    • v.21 no.1
    • /
    • pp.45-55
    • /
    • 2011
  • We examined the interactions between surface and groundwater through (1) flowmeter logging, (2) measurements of seasonal and vertical changes in temperature within a well, and (3) geochemical analyses of water samples from nine groundwater-monitoring wells. At two wells adjacent to a stream, subsurface water was found to flow from the stream to a surrounding alluvial fan, and the seasonal change in groundwater temperature is similar to those of surface water and air. Geochemical analyses at two wells indicated hydro-geochemical features affected by streamwater inflow, showing seasonal variations. Accordingly, these two wells are located in an area with active interaction between surface water and groundwater. The Thermochron I-button used in the present study is useful for this type of study of groundwater?surface water interaction because of its low cost and small size.

Design and Implementation of Event Hierarchy through Extended Spatio-Temporal Complex Event Processing (시공간 복합 이벤트 처리의 확장을 통한 계층적 이벤트 설계 및 구현)

  • Park, Ye Jin;Yom, Jae-Hong
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.30 no.6_1
    • /
    • pp.549-557
    • /
    • 2012
  • Spatial phenomena such as environment pollution, disease and the risk of spreading information need a rapid initial response to perceive spread event. Moving data perceive spread event through real-time processing and analysis. To process and analysis the event, spatial-temporal complex event processing is used. Previous spatialtemporal complex event processing is possible basis spatial operator but insufficient apply to design spatialtemporal complex event processing to perceive spatial phenomena of high complexity. This study proposed hierarchical spatio-temporal CEP design which will efficiently manage the fast growing incoming sensor data. The implementation of the proposed design is evaluated with GPS location data of moving vehicles which are used as the incoming data stream for identifying spatial events. The spatial component of existing CEP software engine has been extended during the implementation phase to broaden the capabilities of processing spatio-temporal events.

Janus - Multi Source Event Detection and Collection System for Effective Surveillance of Criminal Activity

  • Shahabi, Cyrus;Kim, Seon Ho;Nocera, Luciano;Constantinou, Giorgos;Lu, Ying;Cai, Yinghao;Medioni, Gerard;Nevatia, Ramakant;Banaei-Kashani, Farnoush
    • Journal of Information Processing Systems
    • /
    • v.10 no.1
    • /
    • pp.1-22
    • /
    • 2014
  • Recent technological advances provide the opportunity to use large amounts of multimedia data from a multitude of sensors with different modalities (e.g., video, text) for the detection and characterization of criminal activity. Their integration can compensate for sensor and modality deficiencies by using data from other available sensors and modalities. However, building such an integrated system at the scale of neighborhood and cities is challenging due to the large amount of data to be considered and the need to ensure a short response time to potential criminal activity. In this paper, we present a system that enables multi-modal data collection at scale and automates the detection of events of interest for the surveillance and reconnaissance of criminal activity. The proposed system showcases novel analytical tools that fuse multimedia data streams to automatically detect and identify specific criminal events and activities. More specifically, the system detects and analyzes series of incidents (an incident is an occurrence or artifact relevant to a criminal activity extracted from a single media stream) in the spatiotemporal domain to extract events (actual instances of criminal events) while cross-referencing multimodal media streams and incidents in time and space to provide a comprehensive view to a human operator while avoiding information overload. We present several case studies that demonstrate how the proposed system can provide law enforcement personnel with forensic and real time tools to identify and track potential criminal activity.

Design of Miniaturized Telemetry Module for Bi-Directional Wireless Endoscopy

  • Park, H. J.;H. W. Nam;B. S. Song;J. H. Cho
    • Proceedings of the IEEK Conference
    • /
    • 2002.07a
    • /
    • pp.494-496
    • /
    • 2002
  • A bi-directional and multi-channel wireless telemetry capsule, 11mm in diameter, is presented that can transmit video images from inside the human body and receive a control signal from an external control unit. The proposed telemetry capsule includes transmitting and receiving antennas, a demodulator, decoder, four LEDs, and CMOS image sensor, along with their driving circuits. The receiver demodulates the received signal radiated from the external control unit. Next, the decoder receives the stream of control signals and interprets five of the binary digits as an address code. Thereafter, the remaining signal is interpreted as four bits of binary data. Consequently, the proposed telemetry module can demodulate external signals so as to control the behavior of the camera and four LEDs during the transmission of video images. The proposed telemetry capsule can simultaneously transmit a video signal and receive a control signal determining the behavior of the capsule itself. As a result, the total power consumption of the telemetry capsule can be reduced by turning off the camera power during dead time and separately controlling the LEDs for proper illumination of the intestine.

  • PDF

The measurement and evaluation of local scour at a bridge pier using the profiling scour monitoring system (프로파일링 세굴 모니터링 시스템을 이용한 교각 국부세굴 계측 및 평가)

  • Shin, Jong-Hyun;Park, Hyun-Il;Shin, Seung-Hyun;Park, Kyung-Soo
    • Proceedings of the Korean Geotechical Society Conference
    • /
    • 2009.03a
    • /
    • pp.38-47
    • /
    • 2009
  • Scour means the erosion of bed material by flow change when a bridge is constructed in a stream. Scour is one of the critical factors of a bridge failure. There are several methods for the monitoring of scour near bridge foundations; Sounding rods, Magnetic sliding collar System, Sonar system, underwater camera system and so on. In general, Sonar system is preferred due to its convenience and good accuracy. In this study, the new scour monitoring system was developed using profiling sonar sensor. The new system can measure a line profile of a seabed and has small size due to the effectively designed data logger. The performance of the new scour monitoring system was evaluated at a bridge pier in tidal environment. The measured local scour depths were discussed with the result of the empirical formulas; CSU, Froehlich, Laursen and Neill.

  • PDF

Design of the Framework for Processing Large Sensor Data Stream (대용량 센서 데이터 스트림 처리를 위한 프레임워크 설계)

  • Choi Hyun-Hwa;Won Jong-Ho;Lee Hun-Soon;Chae Mi-Ok;Park Jae-Hong;Chung Warnill;Kim Byung-Seob;Lee Myung-Cheol;Lee Mi-Young
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2004.11a
    • /
    • pp.35-38
    • /
    • 2004
  • 센서 데이터 스트림 처리 기술은 유비쿼터스 컴퓨팅의 핵심 기술로 그 중요성이 날로 증대되어, 현재 산업계는 물론 학계에서도 그 역량을 이에 집중하고 있다. 본 논문에서는, 센서 데이터 스트림에 대한 특징 및 이를 처리하기 위한 산업계와 학계의 동향을 알아본다. 그리고, 대용량 센서데이터 스트림을 처리하기 위해 요구되어지는 기능을 정리하고, 이를 기반으로 센서 데이터 스트림처리 시스템의 구조를 설계한다.

  • PDF

Developing an On-Line Monitoring System for a Forest Hydrological Environment - Development of Hardware - (산림수문환경(山林水文環境) 모니터링을 위(爲)한 원거리(遠距離) 자동관측(自動觀測)시스템의 개발(開發) - 하드웨어를 중심(中心)으로 -)

  • Lee, Heon Ho;Suk, Soo Il
    • Journal of Korean Society of Forest Science
    • /
    • v.89 no.3
    • /
    • pp.405-413
    • /
    • 2000
  • This study was conducted to develop an on-line monitoring system for a forest hydrological environment and its meteorological condition, such as temperature, wind direction and speed, rainfall and water level on V-notch, electrical conductivity(EC), potential of hydrogen(PH) by the motor drive sensor unit and measurement with a single-chip microprocessor as controller. These results are summarized as follows ; 1. The monitoring system consists of a signal process unit, motor drive sensor unit, radio modem unit and power supply. 2. The motor drive sensor unit protects the sensor from swift current or freezing and can constantly maintain fixed water level during measurements. 3. This monitoring system can transfer the data by radio modem. Additionally, this system can monitor hydrological conditions in real time. 4. The hardware was made of several modules with an independent CPU. They can be mounted, removed, repaired and added to. Their function can be changed and expanded. 5. These are the result of an accuracy test, the values of temperature, EC and pH measured within an error range of ${\pm}0.2^{\circ}C$, ${\pm}1{\mu}S$ and ${\pm}0.1pH$ respectively. 6. This monitoring system proved to be able to measure various factors for a forest hydrological environment in various experimental stations.

  • PDF