• Journal of the Korean Data and Information Science Society
• /
• v.24 no.1
• /
• pp.33-39
• /
• 2013

In the transformation of response variable in partial linear models outliers can cause a bad effect on estimating the transformation parameter, just as in the linear models. To solve this problem the processes of estimating transformation parameter and detecting outliers are needed, but have difficulties to be performed due to the arbitrariness of the nonparametric function included in the partial linear model. In this study, through the estimation of nonparametric function and outlier detection methods such as a sequential test and a maximum trimmed likelihood estimation, processes for transforming response variable robust to outliers in partial linear models are suggested. The proposed methods are verified and compared their effectiveness by simulation study and examples.

• Journal of the Korea Society of Computer and Information
• /
• v.10 no.6 s.38
• /
• pp.17-26
• /
• 2005

In this paper we propose three nonparametric tests such as Wilcoxon test, Median test and Van der Waerden test, based on linear rank statistics for detecting edges in images. The methods used herein are based on detecting changes in gray-levels obtained using an edge-height parameter between two sub-regions in a 5$\times$5 window We compare and analysis the performance of three statistical edge detectors in terms of qualitative measures with the edge maps and objective, quantitative measures.

• Smart Structures and Systems
• /
• v.14 no.3
• /
• pp.377-395
• /
• 2014

Vibration-based fault detection and condition monitoring of rotating machinery, using statistical process control (SPC) combined with statistical pattern recognition methodology, has been widely investigated by many researchers. In particular, the discrete wavelet transform (DWT) is considered as a powerful tool for feature extraction in detecting fault on rotating machinery. Although DWT significantly reduces the dimensionality of the data, the number of retained wavelet features can still be significantly large. Then, the use of standard multivariate SPC techniques is not advised, because the sample covariance matrix is likely to be singular, so that the common multivariate statistics cannot be calculated. Even though many feature-based SPC methods have been introduced to tackle this deficiency, most methods require a parametric distributional assumption that restricts their feasibility to specific problems of process control, and thus limit their application. This study proposes a nonparametric multivariate control chart method, based on multiscale wavelet scalogram (MWS) features, that overcomes the limitation posed by the parametric assumption in existing SPC methods. The presented approach takes advantage of multi-resolution analysis using DWT, and obtains MWS features with significantly low dimensionality. We calculate Hotelling's $T^2$-type monitoring statistic using MWS, which has enough damage-discrimination ability. A bootstrap approach is used to determine the upper control limit of the monitoring statistic, without any distributional assumption. Numerical simulations demonstrate the performance of the proposed control charting method, under various damage-level scenarios for a bearing system.

• Journal of Broadcast Engineering
• /
• v.14 no.2
• /
• pp.253-264
• /
• 2009

This paper presents an algorithm, aims at practical applications, for the high speed processing and performance enhancement of lane detection base on vision processing system. As a preprocessing for high speed lane detection, the vanishing line estimation and the optimal extraction of region of interest for lane boundary (ROI-LB) can be processed to reduction of detection region in which high speed processing is enabled. Image feature information is extracted only in the ROI-LB. Road lane is extracted using a non-parametric model fitting and Hough transform within the ROI-LB. With simultaneous processing of noise reduction and edge enhancement using the Laplacian filter, the reliability of feature extraction can be increased for various road lane patterns. Since outliers of edge at each block can be removed with clustering of edge orientation for each block within the ROI-LB, the performance of lane detection can be greatly improved. The various real road experimental results are presented to evaluate the effectiveness of the proposed method.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.11 no.12
• /
• pp.5905-5926
• /
• 2017

Sentiments can profoundly affect individual behavior as well as decision-making. Confronted with the ever-increasing amount of review information available online, it is desirable to provide an effective sentiment model to both detect and organize the available information to improve understanding, and to present the information in a more constructive way for consumers. This study developed a unified phrase-based topic and sentiment detection model, combined with a tracking model using incremental hierarchical dirichlet allocation (PTSM_IHDP). This model was proposed to discover the evolutionary trend of topic-based sentiments from online reviews. PTSM_IHDP model firstly assumed that each review document has been composed by a series of independent phrases, which can be represented as both topic information and sentiment information. PTSM_IHDP model secondly depended on an improved time-dependency non-parametric Bayesian model, integrating incremental hierarchical dirichlet allocation, to estimate the optimal number of topics by incrementally building an up-to-date model. To evaluate the effectiveness of our model, we tested our model on a collected dataset, and compared the result with the predictions of traditional models. The results demonstrate the effectiveness and advantages of our model compared to several state-of-the-art methods.

• Journal of Korean Society on Water Environment
• /
• v.33 no.1
• /
• pp.40-50
• /
• 2017

We were interested in the long-term temporal and spatial variability trends of water quality. Trend tests such as the Seasonal and Regional Kendall tests and LOWESS (LOcally WEighted Scatter plot Smoother) have been recommended as outstanding tools for trend detection. In this study, we conducted four types of nonparametric trend tests (Seasonal and Regional Kendall tests, LOWESS, and flow-adjusted Seasonal Kendall). We aimed to identify water quality trends using the monthly data for five variables (BOD, COD, TN, TP, and flow) collected from 24 sites in the Nakdong River from August 2004 to December 2013. According to the Regional Kendall test, BOD, COD, and TN increased but TP decreased trend. The Seasonal Kendall test showed that BOD, TN, and TP remained constant at 62.5-83.3% of the sites. COD remained constant at 58.3% of the sites. LOWESS showed that TP gradually increased between 2007 and 2008, then decreased slowly at the Gumi, Geumhogang6, Daeam-1 and Milyanggang3 sites. BOD increased slightly between 2008 and 2009, and then decreased slowly at the Namgang4-1 site. Lastly, a flow-adjusted Seasonal Kendall test was conducted. There were different results between Seasonal Kendall and flow-adjusted Seasonal Kendall tests at 11 of the 24 sites. According to the results from six of the eleven sites, BOD increased at one site, showed no trends at three sited, and decreased at two sites. Each of COD, TN increased at two, one site. but TP decreased at two sites.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.41 no.3
• /
• pp.147-153
• /
• 2004

This paper proposes an efficient edge detection using Van der Waerden statistic in original and noisy images. An edge is where the intensity of an image moves from a low value to a high value or vice versa. We describe a nonparametric Wilcoxon test and a parametric T test based on statistical hypothesis testing for the detection of edges. We use the threshold determined by specifying significance level $\alpha$, while Bovik, Huang and Munson consider the range of possible values of test statistics for the threshold. From the experimental results of edge detection, the T and Wilcoxon method perform sensitively to the noisy image, while the proposed Waerden method is robust over both noisy and noise-free images under $\alpha$=0.0005. Comparison with our statistical test and Sobel, LoG, Canny operators shows that Waerden method perform more effectively in both noisy and noise-free images.

• Informatization Policy
• /
• v.26 no.4
• /
• pp.85-106
• /
• 2019

Recently, there have been increasing cases of collective petitions filed in the electronic petitions system. However, there is no efficient management system, raising concerns on side effects such as increased administrative workload and mass production of social conflicts. Aimed at suggesting a methodology for estimating electronic collective petitions using anomaly detection and corpus linguistics-based content analysis, this study conducted the followings: i) a theoretical review of the concept of collective petitions, ii) estimation of electronic collective petitions using anomaly detection based on nonparametric unsupervised learning, iii) a content similarity analysis on petitions using n-gram cosine angle distance, and iv) a case study on the Voice of Citizens of Changwon City, through which the utility of the proposed methodology, policy implications and future tasks were reviewed.

• Journal of the Korean Data and Information Science Society
• /
• v.18 no.2
• /
• pp.385-399
• /
• 2007

In many image processing applications, a random noise makes some trouble since most video enhancement functions produce visual artifacts if a priori of the noise is incorrect. The basic difficulty is that the noise and the signal are difficult to be distinguished. Typical unsharp masking (UM) enhances the visual appearances of images, but it also amplifies the noise components of the image. Hence, the applications of a UM are limited when noises are presented. This paper proposed statistical algorithms based on parametric and nonparametric tests to adaptively enhance the image feature and the noise combining while applying UM. With the proposed algorithm, it is made possible to enhance the local contrast of an image without amplifying the noise.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.49 no.2
• /
• pp.83-89
• /
• 2012

Natural Vegetation cover, which is very important earth resource, has been significantly altered by humans in some manner. Since this has currently resulted in a significant effect on global climate, various studies on vegetation environment including forest have been performed and the results are utilized in policy decision making. Remotely sensed data can detect, identify and map vegetation cover change based on the analysis of spectral characteristics and thus are vigorously utilized for monitoring vegetation resources. Among various vegetation indices extracted from spectral reponses of remotely sensed data, NDVI is the most popular index which provides a measure of how much photosynthetically active vegetation is present in the scene. In this study, for change detection in vegetation cover, a Multi-layer Perceptron Network (MLPN) as a nonparametric approach has been designed and applied to MODIS/Aqua vegetation indices 16-day L3 global 250m SIN Grid(v005) (MYD13Q1) data. The feature vector for change detection is constructed with the direct NDVI diffenrence at a pixel as well as the differences in some subset of NDVI series data. The research covered 5 years (2006-20110) over Korean peninsular.