• Title/Summary/Keyword: time sensor fusion

Search Result 217, Processing Time 0.027 seconds

Multiple Color and ToF Camera System for 3D Contents Generation

  • Ho, Yo-Sung
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.6 no.3
    • /
    • pp.175-182
    • /
    • 2017
  • In this paper, we present a multi-depth generation method using a time-of-flight (ToF) fusion camera system. Multi-view color cameras in the parallel type and ToF depth sensors are used for 3D scene capturing. Although each ToF depth sensor can measure the depth information of the scene in real-time, it has several problems to overcome. Therefore, after we capture low-resolution depth images by ToF depth sensors, we perform a post-processing to solve the problems. Then, the depth information of the depth sensor is warped to color image positions and used as initial disparity values. In addition, the warped depth data is used to generate a depth-discontinuity map for efficient stereo matching. By applying the stereo matching using belief propagation with the depth-discontinuity map and the initial disparity information, we have obtained more accurate and stable multi-view disparity maps in reduced time.

Design of ESN(Educational Sensor Network) for interpretation of the data

  • Park, In-Deok;Paek, Seung-Eun;Kim, Si-Kyung
    • The Journal of Information Technology
    • /
    • v.12 no.3
    • /
    • pp.1-6
    • /
    • 2009
  • This paper has focused on the development of an educational sensor network (ESN) based on wireless sensor networks(WSN) and pervasive monitoring systems for students' activity during scientific experiments. A number of WSN systems have been proposed with integrated wireless transmission, mounted sensor boards and local processing. However, there is no trail to employ WSN on the educational field. In this paper, to facilitate research and development using wireless sensor network and multi-sensor data fusion, the educational sensor network (ESN) hardware development platform is presented. The ESN project is conducted over one semester time period (Spring Semesters). It involves approximately twenty middle school students who enrolled a gifted program in Kongju National University. Though under prepared, these students are in general highly motivated to learning specially when presented with the ESN project. An ESN project such as this is expected to provide an excellent means for teaching and learning scientific and mathematical principles.

  • PDF

A Data Fusion Method of Odometry Information and Distance Sensor for Effective Obstacle Avoidance of a Autonomous Mobile Robot (자율이동로봇의 효율적인 충돌회피를 위한 오도메트리 정보와 거리센서 데이터 융합기법)

  • Seo, Dong-Jin;Ko, Nak-Yong
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.57 no.4
    • /
    • pp.686-691
    • /
    • 2008
  • This paper proposes the concept of "virtual sensor data" and its application for real time obstacle avoidance. The virtual sensor data is virtual distance which takes care of the movement of the obstacle as well as that of the robot. In practical application, the virtual sensor data is calculated from the odometry data and the range sensor data. The virtual sensor data can be used in all the methods which use distance data for collision avoidance. Since the virtual sensor data considers the movement of the robot and the obstacle, the methods utilizing the virtual sensor data results in more smooth and safer collision-free motion.

Evaluation of Spatio-temporal Fusion Models of Multi-sensor High-resolution Satellite Images for Crop Monitoring: An Experiment on the Fusion of Sentinel-2 and RapidEye Images (작물 모니터링을 위한 다중 센서 고해상도 위성영상의 시공간 융합 모델의 평가: Sentinel-2 및 RapidEye 영상 융합 실험)

  • Park, Soyeon;Kim, Yeseul;Na, Sang-Il;Park, No-Wook
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.5_1
    • /
    • pp.807-821
    • /
    • 2020
  • The objective of this study is to evaluate the applicability of representative spatio-temporal fusion models developed for the fusion of mid- and low-resolution satellite images in order to construct a set of time-series high-resolution images for crop monitoring. Particularly, the effects of the characteristics of input image pairs on the prediction performance are investigated by considering the principle of spatio-temporal fusion. An experiment on the fusion of multi-temporal Sentinel-2 and RapidEye images in agricultural fields was conducted to evaluate the prediction performance. Three representative fusion models, including Spatial and Temporal Adaptive Reflectance Fusion Model (STARFM), SParse-representation-based SpatioTemporal reflectance Fusion Model (SPSTFM), and Flexible Spatiotemporal DAta Fusion (FSDAF), were applied to this comparative experiment. The three spatio-temporal fusion models exhibited different prediction performance in terms of prediction errors and spatial similarity. However, regardless of the model types, the correlation between coarse resolution images acquired on the pair dates and the prediction date was more significant than the difference between the pair dates and the prediction date to improve the prediction performance. In addition, using vegetation index as input for spatio-temporal fusion showed better prediction performance by alleviating error propagation problems, compared with using fused reflectance values in the calculation of vegetation index. These experimental results can be used as basic information for both the selection of optimal image pairs and input types, and the development of an advanced model in spatio-temporal fusion for crop monitoring.

Anomaly Event Detection Algorithm of Single-person Households Fusing Vision, Activity, and LiDAR Sensors

  • Lee, Do-Hyeon;Ahn, Jun-Ho
    • Journal of the Korea Society of Computer and Information
    • /
    • v.27 no.6
    • /
    • pp.23-31
    • /
    • 2022
  • Due to the recent outbreak of COVID-19 and an aging population and an increase in single-person households, the amount of time that household members spend doing various activities at home has increased significantly. In this study, we propose an algorithm for detecting anomalies in members of single-person households, including the elderly, based on the results of human movement and fall detection using an image sensor algorithm through home CCTV, an activity sensor algorithm using an acceleration sensor built into a smartphone, and a 2D LiDAR sensor-based LiDAR sensor algorithm. However, each single sensor-based algorithm has a disadvantage in that it is difficult to detect anomalies in a specific situation due to the limitations of the sensor. Accordingly, rather than using only a single sensor-based algorithm, we developed a fusion method that combines each algorithm to detect anomalies in various situations. We evaluated the performance of algorithms through the data collected by each sensor, and show that even in situations where only one algorithm cannot be used to detect accurate anomaly event through certain scenarios we can complement each other to efficiently detect accurate anomaly event.

Decentralized Moving Average Filtering with Uncertainties

  • Song, Il Young
    • Journal of Sensor Science and Technology
    • /
    • v.25 no.6
    • /
    • pp.418-422
    • /
    • 2016
  • A filtering algorithm based on the decentralized moving average Kalman filter with uncertainties is proposed in this paper. The proposed filtering algorithm presented combines the Kalman filter with the moving average strategy. A decentralized fusion algorithm with the weighted sum structure is applied to the local moving average Kalman filters (LMAKFs) of different window lengths. The proposed algorithm has a parallel structure and allows parallel processing of observations. Hence, it is more reliable than the centralized algorithm when some sensors become faulty. Moreover, the choice of the moving average strategy makes the proposed algorithm robust against linear discrete-time dynamic model uncertainties. The derivation of the error cross-covariances between the LMAKFs is the key idea of studied. The application of the proposed decentralized fusion filter to dynamic systems within a multisensor environment demonstrates its high accuracy and computational efficiency.

Locality Aware Multi-Sensor Data Fusion Model for Smart Environments (장소인식멀티센서스마트 환경을위한 데이터 퓨전 모델)

  • Nawaz, Waqas;Fahim, Muhammad;Lee, Sung-Young;Lee, Young-Koo
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2011.04a
    • /
    • pp.78-80
    • /
    • 2011
  • In the area of data fusion, dealing with heterogeneous data sources, numerous models have been proposed in last three decades to facilitate different application domains i.e. Department of Defense (DoD), monitoring of complex machinery, medical diagnosis and smart buildings. All of these models shared the theme of multiple levels processing to get more reliable and accurate information. In this paper, we consider five most widely acceptable fusion models (Intelligence Cycle, Joint Directors of Laboratories, Boyd control, Waterfall, Omnibus) applied to different areas for data fusion. When they are exposed to a real scenario, where large dataset from heterogeneous sources is utilize for object monitoring, then it may leads us to non-efficient and unreliable information for decision making. The proposed variation works better in terms of time and accuracy due to prior data diminution.

On-line Measurement and Characterization of Nano-web Qualities Using a Stochastic Sensor Fusion System Design and Implementation of NAFIS(NAno-Fiber Information System)

  • Kim, Joovong;Lim, Dae-Young;Byun, Sung-Weon
    • Proceedings of the Korean Fiber Society Conference
    • /
    • 2003.10a
    • /
    • pp.45-46
    • /
    • 2003
  • A process control system has been developed for measurement and characterization of the nanofiber web qualities. The nano-fiber information system (NAFIS) developed consists of a measurement device and an analysis algorithm, which are a microscope-laser sensor fusion system and a process information system, respectively. It has been found that NAFIS is so successful in detecting irregularities of pore and diameter that the resulting product has been quitely under control even at the high production rate. Pore distribution, fiber diameter and mass uniformity have been readily measured and analyzed by integrating the non-contact measurement technology and the random function-based time domain signal/image processing algorithm. Qualifies of the nano-fiber webs have been revealed in a way that the statistical parameters for the characteristics above are calculated and stored in a certain interval along with the time-specific information. Quality matrix, scale of homogeneity is easily obtained through the easy-to-use GUI information. Finally, ANFIS has been evaluated both for the real-time measurement and analysis, and for the process monitoring.

  • PDF

Bayesian Statistical Modeling of System Energy Saving Effectiveness for MAC Protocols of Wireless Sensor Networks: The Case of Non-Informative Prior Knowledge

  • Kim, Myong-Hee;Park, Man-Gon
    • Journal of Korea Multimedia Society
    • /
    • v.13 no.6
    • /
    • pp.890-900
    • /
    • 2010
  • The Bayesian networks methods provide an efficient tool for performing information fusion and decision making under conditions of uncertainty. This paper proposes Bayes estimators for the system effectiveness in energy saving of the wireless sensor networks by use of the Bayesian method under the non-informative prior knowledge about means of active and sleep times based on time frames of sensor nodes in a wireless sensor network. And then, we conduct a case study on some Bayesian estimation models for the system energy saving effectiveness of a wireless sensor network, and evaluate and compare the performance of proposed Bayesian estimates of the system effectiveness in energy saving of the wireless sensor network. In the case study, we have recognized that the proposed Bayesian system energy saving effectiveness estimators are excellent to adapt in evaluation of energy efficiency using non-informative prior knowledge from previous experience with robustness according to given values of parameters.

Two-Step Suboptimal Filters for Linear Dynamic Systems

  • Ahn, Jun-Il;Minhas, Rashid;Shin, Vladimir
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.16-21
    • /
    • 2005
  • This paper considers the problem of state estimation in linear continuous-time systems with multi-sensor environment and observation uncertainties. We propose two suboptimal filtering algorithms for these types of systems. The filtering algorithms consist of two steps: The local optimal Kalman estimates are computed at the first step. And, these local estimates are lineally fused at the second step. The implementation of the two-step filtering algorithms needs a lower memory demand than the optimal Kalman and adaptive Lainiotis-Kalman filters. In consequence of parallel structure of the proposed filters, the parallel computers can be used for their design. The examples exhibit the effect of common noise on the performance of fusion of the local Kalman estimates based on observations from different sensors and in the presence of uncertainties.

  • PDF