• Title/Summary/Keyword: Savitzky-golay smoothing Filter

Search Result 8, Processing Time 0.023 seconds

Comparison of Savitzky-Golay filtering results for quality control of soil moisture data (토양수분량 자료의 품질관리를 위한 Savitzky-Golay 필터링 적용결과 비교)

  • Lee, Yongjun;Kim, Kiyoung
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2020.06a
    • /
    • pp.268-268
    • /
    • 2020
  • 토양수분량은 수문연구에 있어 중요한 인자 중의 하나이며, 그 필요성이 점차 강조되고 있다. 국내에서도 최근 새로운 관측기기의 도입이나 수자원위성의 개발 등에 관한 연구가 점차 활발하게 이뤄지고 있으나, 토양수분량 자료의 생산, 품질관리 및 배포 시스템에 관한 연구 및 개발이 부족한 실정이다. 반면에 해외에서는 International Soil Moisture Network(ISMN)을 통해 토양수분량 자료의 품질관리 및 배포가 활발하게 이루어지고 있는데, ISMN에서는 토양특성, 강우에 대한 반응, 토양온도, 시계열특성을 이용해 토양수분량 관측 자료를 품질관리 하고 있다. 본 연구에서는 ISMN의 spike 검출 알고리즘에서 그래프 평활화(smoothing)를 위해 이용되는 Savitzky-Golay 필터의 window size와 polynomial order(filter order)를 다양하게 변화시키고, 이를 설마천 관측소에서 측정한 토양수분량 원시자료에 적용하여 window size와 polynomial order별로 편의(bias), 변동(variation), 평균 제곱근 오차(Root Mean Square Error, RMSE)를 산정하였다. 통계산정 결과 원시자료와의 bias는 window size가 3이고 polynomial order가 2인 필터를 적용했을 때 가장 작은 것으로 나타났으며, variance는 window size가 3이고 polynomial order가 2인 필터를 이용했을 때가 원시자료와 가장 유사한 것으로 나타났다. 또한, RMSE는 window size가 5이고 polynomial order가 3일 때 가장 작은 것으로 나타났다. 이는 추후 토양수분량 품질관리를 수행하기 위해 적절한 필터 계수 값을 제시할 수 있는 논문으로 사료된다.

  • PDF

A Comparative study on smoothing techniques for performance improvement of LSTM learning model

  • Tae-Jin, Park;Gab-Sig, Sim
    • Journal of the Korea Society of Computer and Information
    • /
    • v.28 no.1
    • /
    • pp.17-26
    • /
    • 2023
  • In this paper, we propose a several smoothing techniques are compared and applied to increase the application of the LSTM-based learning model and its effectiveness. The applied smoothing technique is Savitky-Golay, exponential smoothing, and weighted moving average. Through this study, the LSTM algorithm with the Savitky-Golay filter applied in the preprocessing process showed significant best results in prediction performance than the result value shown when applying the LSTM model to Bitcoin data. To confirm the predictive performance results, the learning loss rate and verification loss rate according to the Savitzky-Golay LSTM model were compared with the case of LSTM used to remove complex factors from Bitcoin price prediction, and experimented with an average value of 20 times to increase its reliability. As a result, values of (3.0556, 0.00005) and (1.4659, 0.00002) could be obtained. As a result, since crypto-currencies such as Bitcoin have more volatility than stocks, noise was removed by applying the Savitzky-Golay in the data preprocessing process, and the data after preprocessing were obtained the most-significant to increase the Bitcoin prediction rate through LSTM neural network learning.

A comparative study for reconstructing a high-quality NDVI time series data derived from MODIS surface reflectance (MODIS 지표 분광반사도 자료를 이용한 고품질 NDVI 시계열 자료 생성의 기법 비교 연구)

  • Lee, Jihye;Kang, Sinkyu;Jang, Keunchang;Hong, Suk Young
    • Korean Journal of Remote Sensing
    • /
    • v.31 no.2
    • /
    • pp.149-160
    • /
    • 2015
  • A comparative study was conducted for alternative consecutive procedures of detection of cloud-contaminated pixels and gap-filling and smoothing of time-series data to produce high-quality gapless satellite vegetation index (i.e. Normalized Difference Vegetation Index, NDVI). Performances of five alternative methods for detecting cloud contaminations were tested with ground-observed cloudiness data. The data gap was filled with a simple linear interpolation and then, it was applied two alternative smoothing methods (i.e. Savitzky-Golay and Wavelet transform). Moderate resolution imaging spectroradiometer (MODIS) data were used in this study. Among the alternative cloud detection methods, a criterion of MODIS Band 3 reflectance over 10% showed best accuracy with an agreement rate of 85%, which was followed by criteria of MODIS Quality assessment (82%) and Band 3 reflectance over 20% (81%), respectively. In smoothing process, the Savitzky-Golay filter was better performed to retain original NDVI patterns than the wavelet transform. This study demonstrated an operational framework of gapdetection, filling, and smoothing to produce high-quality satellite vegetation index.

Application of MAP and MLP Classifier on Raman Spectral Data for Classification of Liver Disease (라만 스펙트럼에서 간 질병 분류를 위한 MAP과 MLP 적용 연구)

  • Park, Aa-Ron;Baek, Seong-Joon;Yang, Bing-Xin;Na, Seung-You
    • The Journal of the Korea Contents Association
    • /
    • v.9 no.2
    • /
    • pp.432-438
    • /
    • 2009
  • In this paper, we evaluated the performance of the automatic classifier applied for the discrimination of acute alcoholic liver injury and chronic liver fibrosis. The classifier uses the discriminant peaks of the preprocessed Raman spectrum as a feature set. In preprocessing step, we subtract baseline and apply Savitzky-Golay smoothing filter which is known to be useful at preserving peaks. After identifying discriminant peaks from the spectra, we carried out the classification experiments using MAP and neural networks. According to the experimental results, the classifier shows the promising results to diagnosis alcoholic liver injury and chronic liver fibrosis. Classification results over 80% means that the peaks used as a feature set is useful for diagnosing liver disease.

Real-time Stabilization Method for Video acquired by Unmanned Aerial Vehicle (무인 항공기 촬영 동영상을 위한 실시간 안정화 기법)

  • Cho, Hyun-Tae;Bae, Hyo-Chul;Kim, Min-Uk;Yoon, Kyoungro
    • Journal of the Semiconductor & Display Technology
    • /
    • v.13 no.1
    • /
    • pp.27-33
    • /
    • 2014
  • Video from unmanned aerial vehicle (UAV) is influenced by natural environments due to the light-weight UAV, specifically by winds. Thus UAV's shaking movements make the video shaking. Objective of this paper is making a stabilized video by removing shakiness of video acquired by UAV. Stabilizer estimates camera's motion from calculation of optical flow between two successive frames. Estimated camera's movements have intended movements as well as unintended movements of shaking. Unintended movements are eliminated by smoothing process. Experimental results showed that our proposed method performs almost as good as the other off-line based stabilizer. However estimation of camera's movements, i.e., calculation of optical flow, becomes a bottleneck to the real-time stabilization. To solve this problem, we make parallel stabilizer making average 30 frames per second of stabilized video. Our proposed method can be used for the video acquired by UAV and also for the shaking video from non-professional users. The proposed method can also be used in any other fields which require object tracking, or accurate image analysis/representation.

Study of the Wearable Electrocardiogram Measuring System using Capacitive-coupled Electrode (정전 용량성 결합 전극을 이용한 웨어러블 심전도 측정 시스템 설계에 관한 연구)

  • Lee, Jae-Ho;Lee, Young-Jae;Lee, Kang-Hwi;Kang, Seng-Jin;Kim, Kyeung-Nam;Park, Hee-Jung;Lee, Jeong-Whan
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.63 no.10
    • /
    • pp.1448-1454
    • /
    • 2014
  • In this study, a new type of electrode device is implemented to measure the capacitance energy and interpret it as the ECG (Electrocardiogram) data. The main idea of this new electrode system is to estimate the capacitance on the skin by assembling a capacitive-coupled circuits and translate into the ECG signal. To measure the coupling energy and estimate the aquired data in terms of heart activity, the capacitive-coupled electrode is garmented with fabrics in the form of a chest band or a vest jacket. To compare the ECG data from the capacitive-coupled electrode with the conventional electrode(Ag-AgCl) system, the corelation coefficient between two signals is computed as 0.9517. Thus, we can conclude the fact that capacitive-coupled electrode system can measure a person's heart activity without any contact to his or her skin and can the interpreted as the ECG data.

Number of sampling leaves for reflectance measurement of Chinese cabbage and kale

  • Chung, Sun-Ok;Ngo, Viet-Duc;Kabir, Md. Shaha Nur;Hong, Soon-Jung;Park, Sang-Un;Kim, Sun-Ju;Park, Jong-Tae
    • Korean Journal of Agricultural Science
    • /
    • v.41 no.3
    • /
    • pp.169-175
    • /
    • 2014
  • Objective of this study was to investigate effects of pre-processing method and number of sampling leaves on stability of the reflectance measurement for Chinese cabbage and kale leaves. Chinese cabbage and kale were transplanted and cultivated in a plant factory. Leaf samples of the kale and cabbage were collected at 4 weeks after transplanting of the seedlings. Spectra data were collected with an UV/VIS/NIR spectrometer in the wavelength region from 190 to 1130 nm. All leaves (mature and young leaves) were measured on 9 and 12 points in the blade part in the upper area for kale and cabbage leaves, respectively. To reduce the spectral noise, the raw spectral data were preprocessed by different methods: i) moving average, ii) Savitzky-Golay filter, iii) local regression using weighted linear least squares and a $1^{st}$ degree polynomial model (lowess), iv) local regression using weighted linear least squares and a $2^{nd}$ degree polynomial model (loess), v) a robust version of 'lowess', vi) a robust version of 'loess', with 7, 11, 15 smoothing points. Effects of number of sampling leaves were investigated by reflectance difference (RD) and cross-correlation (CC) methods. Results indicated that the contribution of the spectral data collected at 4 sampling leaves were good for both of the crops for reflectance measurement that does not change stability of measurement much. Furthermore, moving average method with 11 smoothing points was believed to provide reliable pre-processed data for further analysis.

Bioprocess Control for Continuous Culture of Dunaliella Salina in Flat Panel Photobioreactor (평판형 광생물반응기의 Dunaliella Salina 연속배양을 위한 생물공정 제어)

  • Kim, Gwang Ho;Ahn, Dong-Gyu;Park, Jong Rak;Choi, Gang Hun;Kim, Jong Tye;Kim, Ki Won;Jeong, Sang Hwa
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.30 no.2
    • /
    • pp.137-142
    • /
    • 2013
  • The indiscriminate use of the fossil fuel has caused serious environmental pollutions such as the shortage of energy and global warming. Microalgae have being emphasized as $3^{rd}$ generation biomass which makes the carbon dioxide reduce effectively as well as produces the biofuel. Large scale production of microbial biomass by continuous culture is a quite challenging issue, because off-line optimization strategies of a microbial process utilizing a model-based scheme give rise to many difficult problems. In this paper, the static and simple control method which was able to be applied in time-variant growth environment and large scale of algae culture was studied. The significant disturbances in on-line measurement of cell density were reduced by Savitzky-Golay FIR smoothing filter. Dunaliella salina was cultivated continuously in a flat panel photobioreactor by the on-off control of the turbidostat process.