• Journal of the Korean Society for Nondestructive Testing
• /
• v.22 no.4
• /
• pp.361-368
• /
• 2002

The aim of this study was to investigate the effect of preprocessing the transmitted energy spectrum data on development of a robust model to predict the sugar content in intact apples. The spectrum data were measured from 120 Fuji apple samples conveying at the speed of 2 apples per second. Computer algorithms of preprocessing methods such as MSC, SNV, first derivative, OSC and their combinations were developed and applied to the raw spectrum data set. The results indicated that correlation coefficients between the transmitted energy values at each wavelength and sugar contents of apples were significantly improved by the preprocessing of MSC and SNV in particular as compared with those of no-preprocessing. SEPs of the prediction models showed great difference depending on the preprocessing method of the raw spectrum data, the largest of 1.265%brix and the smallest of 0.507% brix. Such a result means that an appropriate preprocessing method corresponding to the characteristics of the spectrum data set should be found or developed for minimizing the prediction errors. It was observed that MSC and SNV are closely related to prediction accuracy, OSC is to number of PLS factors and the first derivative resulted in decrease of the prediction accuracy. A robust calibration model could be d3eveloped by the combined preprocessing of MSC and OSC, which showed that SEP=0.507%brix, bias=0.0327 and R2=0.8823.

• Proceedings of the Korean Society for Agricultural Machinery Conference
• /
• 2000.11c
• /
• pp.560-568
• /
• 2000

The aims of this research were to investigate the preprocessing effect of spectrum data on prediction performance and to develop a robust model to predict SSC in intact apple. Spectrum data of 320 Fuji apples were measured with the on-line transmittance measurement system at the wavelength range of 550∼1100nm. Preprocess methods adopted for the tests were Savitzky Golay, MSC, SNV, first derivative and OSC. Several combinations of those methods were applied to the raw spectrum data set to investigate the relative effect of each method on the performance of the calibration model. PLS method was used to regress the preprocessed data set and the SSCs of samples, and the cross-validation was to select the optimal number of PLS factors. Smoothing and scattering corection were essential in increasing the prediction performance of PLS regression model and the OSC contributed to reduction of the number of PLS factors. The first derivative resulted in unfavorable effect on the prediction performance. MSC and SNV showed similar effect. A robust calibration model could be developed by the preprocessing combination of Savitzky Golay smoothing, MSC and OSC, which resulted in SEP= 0.507, bias=0.032 and R$^2$=0.8823.

• Journal of the Korean Institute of Telematics and Electronics
• /
• v.27 no.12
• /
• pp.1800-1809
• /
• 1990

This paper proposed a preprocessing algorithm which is named Automatic Tracking Window (ATW), which eliminates the effects of noises at spatial signals and spurious peaks at high-resolution algorithm in bearing estimation algorithm. This method estimates spatial spectrum by periodogram algorisdthm and hihg-resolution algorithm after preprocessing of spatial signal by automatically tracked window.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.67 no.4
• /
• pp.569-577
• /
• 2018

In this paper, with the aid of information which is included within data, preprocessing algorithm-based black plastic classifier is designed. The slope and area of spectrum obtained by using laser induced breakdown spectroscopy(LIBS) are analyzed for each material and its ensuing information is applied as the input data of the proposed classifier. The slope is represented by the rate of change of wavelength and intensity. Also, the area is calculated by the wavelength of the spectrum peak where the material property of chemical elements such as carbon and hydrogen appears. Using informations such as slope and area, input data of the proposed classifier is constructed. In the preprocessing part of the classifier, Principal Component Analysis(PCA) and fuzzy transform are used for dimensional reduction from high dimensional input variables to low dimensional input variables. Characteristic analysis of the materials as well as the processing speed of the classifier is improved. In the condition part, FCM clustering is applied and linear function is used as connection weight in the conclusion part. By means of Particle Swarm Optimization(PSO), parameters such as the number of clusters, fuzzification coefficient and the number of input variables are optimized. To demonstrate the superiority of classification performance, classification rate is compared by using WEKA 3.8 data mining software which contains various classifiers such as Naivebayes, SVM and Multilayer perceptron.

• Journal of Biosystems Engineering
• /
• v.35 no.6
• /
• pp.450-457
• /
• 2010

Although cherry tomato is one of major vegetables consumed in fresh vegetable market, the quality grading method is mostly dependant on size measurement using drum shape sorting machines. Using Visible/Near-infrared spectroscopy, apparatus to be able to acquire transmittance spectrum data was made and used to estimate firmness, sugar content, and acidity of cherry tomatoes grown at hydroponic and soil culture. Partial least square (PLS) models were performed to predict firmness, sugar content, and acidity for the acquired transmittance spectra. To enhance accuracy of the PLS models, several preprocessing methods were carried out, such as normalization, multiplicative scatter correction (MSC), standard normal variate (SNV), and derivatives, etc. The coefficient of determination ($R^2_p$) and standard error of prediction (SEP) for the prediction of firmness, sugar, and acidity of cherry tomatoes from green to red ripening stages were 0.859 and 1.899 kgf, with a preprocessing of normalization, 0.790 and $0.434^{\circ}Brix$ with a preprocessing of the 1st derivative of Savitzky Golay, and 0.518 and 0.229% with a preprocessing normalization, respectively.

• Applied Chemistry for Engineering
• /
• v.23 no.1
• /
• pp.35-41
• /
• 2012

This paper proposes a new methodology for the real-time on-line quality monitoring of biofuel processes through the integration of infrared spectroscopy and chemometrics. A method of Partial Least Squares (PLS) in Chemometrics is employed for quantitative analysis of key components in bioethanol products. After a number of preprocessing methods and variable importance in projection (VIP) are used, Savitzky-Golay method showed the best performance in terms of spectrum correction, noise reduction, and model maintenance. The proposed method allows us to economically forecast the concentration of multiple impurities encountered with the production of bioethanol. The proposed system is also accurate enough ($R^2$ > 0.99) to replace the laboratory analysis.

• Food Science and Preservation
• /
• v.30 no.2
• /
• pp.224-234
• /
• 2023

We analyzed the major quality characteristics of red pepper powders from various regions and predicted these characteristics nondestructively using shortwave infrared hyperspectral imaging (HSI) technology. We conducted partial least squares regression analysis on 70% (n=71) of the acquired hyperspectral data of the red pepper powders to examine the major quality characteristics. R_c² values of ≥0.8 were obtained for the ASTA color value (0.9263) and capsaicinoid content (0.8310). The developed quality prediction model was validated using the remaining 30% (n=35) of the hyperspectral data; the highest accuracy was achieved for the ASTA color value (R_p²=0.8488), and similar validity levels were achieved for the capsaicinoid and moisture contents. To increase the accuracy of the quality prediction model, we conducted spectrum preprocessing using SNV, MSC, SG-1, and SG-2, and the model's accuracy was verified. The results indicated that the accuracy of the model was most significantly improved by the MSC method, and the prediction accuracy for the ASTA color value was the highest for all the spectrum preprocessing methods. Our findings suggest that the quality characteristics of red pepper powders, even powders that do not conform to specific variables such as particle size and moisture content, can be predicted via HSI.

• Journal of Biosystems Engineering
• /
• v.33 no.1
• /
• pp.63-68
• /
• 2008

This study was carried out to find a useful method to predict hardness of tomato using optical spectrum data. Optical spectrum of reflectance and transmittance data were collected processed by 9 kind of preprocessing methods-normalizations of mean, maximum and range, SNV (standard normal variate), MSC (multiplicative scatter correction), the first derivative and second derivative of Savitzky-Golay and Norris-Gap. With the preprocessed and non-processed original spectrum data, prediction models of hardness of tomato were developed using analytical tools of PLS (partial least squares) and MLR (multiple linear regression) and tested for their validation. The test of validation resulted that the analytical tools of PLS and MLR output similar performances while the transmittance spectra showed much better result than the reflectance spectra.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.51 no.7
• /
• pp.327-333
• /
• 2002

In this study, we developed a snoring detection algorithm that detects snores automatically. It consists of preprocessing and snoring detection part. The preprocessing part is composed of a noise removal part using spectrum subtraction, and segmentation part, and computation part of temporal and spectral features. And the snoring detection part decides whether detected blocks are snores with BPNN(Back-Propagation Neural Network). BPNN with one hidden layer and one output layer, is trained with data of 7 subjects and tested with data of 11 subjects of total 18 subjects. The proposed algorithm showed a Sensitivity of 90.41% and a Predictive Positive Value of 84.95%.

• Journal of Korea Multimedia Society
• /
• v.7 no.12
• /
• pp.1639-1649
• /
• 2004

In this paper, a method for detection of forged signatures based on spectral analysis of directional gradient density function and a weighted fuzzy classifier is proposed. The well defined outline of an incoming signature image is extracted in a preprocessing stage which includes noise reduction, automatic thresholding, image restoration and erosion process. The directional gradient density function derived from extracted signature outline is highly related to the overall shape of signature image, and thus its frequency spectrum is used as a feature set. With this spectral feature set, having a property to be invariant in size, shift, and rotation, a weighted fuzzy classifier is evaluated for the verification of freehand and random forgeries. Experiments show that less than 5% averaged error rate can be achieved on a database of 500 signature samples.