• Title/Summary/Keyword: Data validation

Search Result 3,188, Processing Time 0.033 seconds

Lightweight Validation Mechanism for IoT Sensing Data Based on Obfuscation and Variance Analysis (난독화와 변화량 분석을 통한 IoT 센싱 데이터의 경량 유효성 검증 기법)

  • Yun, Junhyeok;Kim, Mihui
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.8 no.9
    • /
    • pp.217-224
    • /
    • 2019
  • Recently, sensor networks are built and used on many kinds of fields such as home, traffic, medical treatment and power grid. Sensing data manipulation on these fields could be a serious threat on property and safety. Thus, a proper way to block sensing data manipulation is necessary. In this paper, we propose IoT(Internet of Things) sensing data validation mechanism based on data obfuscation and variance analysis to remove manipulated sensing data effectively. IoT sensor device modulates sensing data with obfuscation function and sends it to a user. The user demodulates received data to use it. Fake data which are not modulated with proper obfuscation function show different variance aspect with valid data. Our proposed mechanism thus can detect fake data by analyzing data variance. Finally, we measured data validation time for performance analysis. As a result, block rate for false data was improved by up to 1.45 times compared with the existing technique and false alarm rate was 0.1~2.0%. In addition, the validation time on the low-power, low-performance IoT sensor device was measured. Compared to the RSA encryption method, which increased to 2.5969 seconds according to the increase of the data amount, the proposed method showed high validation efficiency as 0.0003 seconds.

Assessment of the Near Real-Time Validation for the AQUA Satellite Level-2 Observation Products

  • Yang Min-Sil;Lee Jeongsoon;Lee Chol;Park Jong-Seo;Kim Hee-Ah
    • Proceedings of the KSRS Conference
    • /
    • 2004.10a
    • /
    • pp.35-38
    • /
    • 2004
  • We developed a Near Real-Time Validation System (NRVS) for the Level-2 Products of AQUA Satellite. AQUA satellite is the second largest project of Earth Observing System (EOS) mission of NASA. This satellite provides the information of water cycle of the entire earth with many different forms. Among its products, we have used five kinds of level-2 geophysical parameters containing rain rate, sea surface wind speed, skin surface temperature, atmospheric temperature profile, and atmospheric humidity profile. To use these products in a scientific purpose, reasonable quantification is indispensable. In this paper we explain the near real-time validation system process and its detail algorithm. Its simulation results are also analyzed in a quantitative way. As reference data set in-situ measured meteorological data which are periodically gathered and provided by the Korea Meteorological Administration (KMA) is processed. Not only site-specific analysis but also time-series analysis of the validation results are explained and detail algorithms are described.

  • PDF

Noise Contour Map Designed from Validation Study of Model for Predicting Aircraft Noise (항공기 소음모델의 정합성 평가를 통한 소음지도 작성)

  • Yim, Bongbeen;Kim, Jooin;Lee, Kyusung;Hong, Hyunsu;Kim, Suntae
    • Journal of Environmental Impact Assessment
    • /
    • v.21 no.6
    • /
    • pp.893-901
    • /
    • 2012
  • Aircraft noise model such as FAA Integrated Noise Model(INM) has recently been used for forecasting the impact of noise in a residential area near an airport and quantifying the effect of various options for noise mitigation. The noise modeling should be reliable and precise in order to ensure the quality of the results provided. In this study, the validation of the noise levels simulated by the INM against measurement data recorded continuously at multiple monitoring sites was discussed. As a result of validation, the quality of the input data used as a fixed point profiles for the INM was enhanced. The noise contour maps were designed as a way to evaluate the aircraft noise of the vicinity of the airfield. The results of this study indicate that the validation of aircraft noise model by the measurement data would be required for the accurate assessment of the aircraft noise levels.

Development of On-Line Diagnostic Expert System Algorithmic Sensor Validation (진단 전문가시스템의 개발 : 연산적 센서검증)

  • 김영진
    • Transactions of the Korean Society of Mechanical Engineers
    • /
    • v.18 no.2
    • /
    • pp.323-338
    • /
    • 1994
  • This paper outlines a framework for performing intelligent sensor validation for a diagnostic expert system while reasoning under uncertainty. The emphasis is on the algorithmic preprocess technique. A companion paper focusses on heuristic post-processing. Sensor validation plays a vital role in the ability of the overall system to correctly detemine the state of a plant monitored by imperfect sensors. Especially, several theoretical developments were made in understanding uncertain sensory data in statistical aspect. Uncertain information in sensory values is represented through probability assignments on three discrete states, "high", "normal", and "low", and additional sensor confidence measures in Algorithmic Sv.Upper and lower warning limits are generated from the historical learning sets, which represents the borderlines for heat rate degradation generated in the Algorithmic SV initiates a historic data base for better reference in future use. All the information generated in the Algorithmic SV initiate a session to differentiate the sensor fault from the process fault and to make an inference on the system performance. This framework for a diagnostic expert system with sensor validation and reasonig under uncertainty applies in HEATXPRT$^{TM}$, a data-driven on-line expert system for diagnosing heat rate degradation problems in fossil power plants.

An Efficient Validation Method for XML Data Updates (XML 데이타 갱신에 대한 효율적인 유효 검증 기법)

  • Lee, Ji-Hyun;Park, Myung-Jae;Chung, Chin-Wan
    • Journal of KIISE:Databases
    • /
    • v.34 no.2
    • /
    • pp.153-165
    • /
    • 2007
  • XML is widely used in various applications as the standard for representing and exchanging data on the Web. XML Schema is the standard schema for XML and an XML document generated based on the XML Schema is called 'Valid XML document'. The XML Schema validity should be guaranteed after the XML document is updated. In this paper, we design an efficient method that verifies XML Schema validity before update, and so eliminates unnecessary validations. Also, we propose validation algorithms for each update. In addition, we propose the mapping between XML data and XML Schema and a storage method for XML Schema in order to efficiently extract the schema information for the validation. Finally, we compare the performance of the validation according to the storage methods.

ASUSD nuclear data sensitivity and uncertainty program package: Validation on fusion and fission benchmark experiments

  • Kos, Bor;Cufar, Aljaz;Kodeli, Ivan A.
    • Nuclear Engineering and Technology
    • /
    • v.53 no.7
    • /
    • pp.2151-2161
    • /
    • 2021
  • Nuclear data (ND) sensitivity and uncertainty (S/U) quantification in shielding applications is performed using deterministic and probabilistic approaches. In this paper the validation of the newly developed deterministic program package ASUSD (ADVANTG + SUSD3D) is presented. ASUSD was developed with the aim of automating the process of ND S/U while retaining the computational efficiency of the deterministic approach to ND S/U analysis. The paper includes a detailed description of each of the programs contained within ASUSD, the computational workflow and validation results. ASUSD was validated on two shielding benchmark experiments from the Shielding Integral Benchmark Archive and Database (SINBAD) - the fission relevant ASPIS Iron 88 experiment and the fusion relevant Frascati Neutron Generator (FNG) Helium Cooled Pebble Bed (HCPB) Test Blanket Module (TBM) mock-up experiment. The validation process was performed in two stages. Firstly, the Denovo discrete ordinates transport solver was validated as a standalone solver. Secondly, the ASUSD program package as a whole was validated as a ND S/U analysis tool. Both stages of the validation process yielded excellent results, with a maximum difference of 17% in final uncertainties due to ND between ASUSD and the stochastic ND S/U approach. Based on these results, ASUSD has proven to be a user friendly and computationally efficient tool for deterministic ND S/U analysis of shielding geometries.

Censored Kernel Ridge Regression

  • Shim, Joo-Yong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.16 no.4
    • /
    • pp.1045-1052
    • /
    • 2005
  • This paper deals with the estimations of kernel ridge regression when the responses are subject to randomly right censoring. The weighted data are formed by redistributing the weights of the censored data to the uncensored data. Then kernel ridge regression can be taken up with the weighted data. The hyperparameters of model which affect the performance of the proposed procedure are selected by a generalized approximate cross validation(GACV) function. Experimental results are then presented which indicate the performance of the proposed procedure.

  • PDF

Mixed-effects LS-SVR for longitudinal dat

  • Cho, Dae-Hyeon
    • Journal of the Korean Data and Information Science Society
    • /
    • v.21 no.2
    • /
    • pp.363-369
    • /
    • 2010
  • In this paper we propose a mixed-effects least squares support vector regression (LS-SVR) for longitudinal data. We add a random-effect term in the optimization function of LS-SVR to take random effects into LS-SVR for analyzing longitudinal data. We also present the model selection method that employs generalized cross validation function for choosing the hyper-parameters which affect the performance of the mixed-effects LS-SVR. A simulated example is provided to indicate the usefulness of mixed-effect method for analyzing longitudinal data.

REQUIREMENT AND INITIALIZATION OF KOMPSAT-5 CALIBRATION AND VALIDATION

  • Lee, Dong-Han;Seo, Doo-Chun;Song, Jeong-Heon;Park, Soo-Young;Lim, Hyo-Suk
    • Proceedings of the KSRS Conference
    • /
    • v.2
    • /
    • pp.776-779
    • /
    • 2006
  • KOMPSAT-5 that will be launched at the end of 2008 has a SAR (Synthetic Aperture Radar) payload. Since the Calibration and Validation of a satellite SAR is different from a passive optical camera as KOMPSAT-2 MSC and KOMPSAT-3 payload, we have started from the basis of SAR system. Firstly, the general SAR Cal/Val parameters have been gathered and defined. Secondly, we have been choosing the Cal/Val parameters suitable to KOMPSAT-5. Thirdly, the methods of SAR Cal/Val with the parameters have been studied. Fourthly, the requirement of Cal/Val devices and Cal/Val site has been studied.

  • PDF

The Precision Validation of the Precise Baseline Determination for Satellite Formation

  • Choi, Jong-Yeoun;Lee, Sang-Jeong
    • Journal of Astronomy and Space Sciences
    • /
    • v.28 no.1
    • /
    • pp.63-70
    • /
    • 2011
  • The needs for satellite formation flying are gradually increasing to perform the advanced space missions in remote sensing and observation of the space or Earth. Formation flying in low Earth orbit can perform the scientific missions that cannot be realized with a single spacecraft. One of the various techniques of satellite formation flying is the determination of the precise baselines between the satellites within the formation, which has to be in company with the precision validation. In this paper, the baseline of Gravity Recovery and Climate Experiment (GRACE) A and B was determined with the real global positioning system (GPS) measurements of GRACE satellites. And baseline precision was validated with the batch and sequential processing methods using K/Ka-band ranging system (KBR) biased range measurements. Because the proposed sequential method validate the baseline precision, removing the KBR bias with the epoch difference instead of its estimation, the validating data (KBR biased range) are independent of the data validated (GPS-baseline) and this method can be applied to the real-time precision validation. The result of sequential precision validation was 1.5~3.0 mm which is similar to the batch precision validation.