• Title/Summary/Keyword: sequential regression

Search Result 122, Processing Time 0.024 seconds

Performance and Root Mean Squared Error of Kernel Relaxation by the Dynamic Change of the Moment (모멘트의 동적 변환에 의한 Kernel Relaxation의 성능과 RMSE)

  • 김은미;이배호
    • Journal of Korea Multimedia Society
    • /
    • v.6 no.5
    • /
    • pp.788-796
    • /
    • 2003
  • This paper proposes using dynamic momentum for squential learning method. Using The dynamic momentum improves convergence speed and performance by the variable momentum, also can identify it in the RMSE(root mean squared error). The proposed method is reflected using variable momentum according to current state. While static momentum is equally influenced on the whole, dynamic momentum algorithm can control the convergence rate and performance. According to the variable change of momentum by training. Unlike former classification and regression problems, this paper confirms both performance and regression rate of the dynamic momentum. Using RMSE(root mean square error ), which is one of the regression methods. The proposed dynamic momentum has been applied to the kernel adatron and kernel relaxation as the new sequential learning method of support vector machine presented recently. In order to show the efficiency of the proposed algorithm, SONAR data, the neural network classifier standard evaluation data, are used. The simulation result using the dynamic momentum has a better convergence rate, performance and RMSE than those using the static moment, respectively.

  • PDF

Variable selection in partial linear regression using the least angle regression (부분선형모형에서 LARS를 이용한 변수선택)

  • Seo, Han Son;Yoon, Min;Lee, Hakbae
    • The Korean Journal of Applied Statistics
    • /
    • v.34 no.6
    • /
    • pp.937-944
    • /
    • 2021
  • The problem of selecting variables is addressed in partial linear regression. Model selection for partial linear models is not easy since it involves nonparametric estimation such as smoothing parameter selection and estimation for linear explanatory variables. In this work, several approaches for variable selection are proposed using a fast forward selection algorithm, least angle regression (LARS). The proposed procedures use t-test, all possible regressions comparisons or stepwise selection process with variables selected by LARS. An example based on real data and a simulation study on the performance of the suggested procedures are presented.

Spatial Dispersion and Sampling of Adults of Citrus Red Mite, Panonychus citri(McGregor) (Acari: Tetranychidae) in Citrus Orchard in Autumn Season (감귤원에서 가을철 귤응애 성충의 공간분포와 표본조사)

  • 송정흡;김수남;류기중
    • Korean journal of applied entomology
    • /
    • v.42 no.1
    • /
    • pp.29-34
    • /
    • 2003
  • Dispersion pattern for adult citrus red mite (CRM), Panonychus citri (McGregor) using by Taylor's power law (TPL) and Iwao's patchiness regression (IPR) was determined to develop a monitoring method on citrus orchards, on Jeju, in Autumn season, during 2001 and 2002.CRM population was sampled by collecting leaves and fruits. The relationships of CRM adults between leaf and fruit were analyzed by different season. The regression equation for CRM adults between leaf (X) and fruit (Y) was ln(Y+1) : 1.029 ln(X+1) ( $r^2$ : 0.80). The density of CRM was higher on fruit than on leaf according to fruit maturing level. TPL provided better description of mean-variance relation-ship for the dispersion indices compared to IPR. Slopes and intercepts of TPL from leaf and fruit samples did not differ between sample units and surveyed years. Fixed-precision levels (D) of a sequential sampling plan were developed using Taylor's power law parameters generated from adults of CRM in leaf sample. Sequential sampling plans for adults of CRM were developed for decision making CRM population level based on the different action threshold levels (2.0,2.5 and 3.0 mites per leaf) with 0.25 precision. The maximum number of trees and required number of trees sampled on fixed sample size plan on 2.0,2.5 and 3.0 thresholds with 0.25 precision level were 19, 16 and 15 and their critical values T$_{critical}$ at were 554,609 and 659, respectively. were 554,609 and 659, respectively.

Multiple Constrained Optimal Experimental Design

  • Jahng, Myung-Wook;Kim, Young Il
    • Communications for Statistical Applications and Methods
    • /
    • v.9 no.3
    • /
    • pp.619-627
    • /
    • 2002
  • It is unpractical for the optimal design theory based on the given model and assumption to be applied to the real-world experimentation. Particularly, when the experimenter feels it necessary to consider multiple objectives in experimentation, its modified version of optimality criteria is indeed desired. The constrained optimal design is one of many methods developed in this context. But when the number of constraints exceeds two, there always exists a problem in specifying the lower limit for the efficiencies of the constraints because the “infeasible solution” issue arises very quickly. In this paper, we developed a sequential approach to tackle this problem assuming that all the constraints can be ranked in terms of importance. This approach has been applied to the polynomial regression model.

The Detection and Testing of Multiple Outliers in Linear Regression

  • Park, Jin-Pyo;Zamar, Ruben H.
    • Journal of the Korean Data and Information Science Society
    • /
    • v.15 no.4
    • /
    • pp.921-934
    • /
    • 2004
  • We consider the problem of identifying and testing outliers in linear regression. First, we consider the scale-ratio tests for testing the null hypothesis of no outliers. A test based on the ratio of two residual scale estimates is proposed. We show the asymptotic distribution of test statistics and investigate the properties of the test. Next we consider the problem of identifying the outliers. A forward procedure based on the suggested test is proposed and shown to perform fairly well. The forward procedure is unaffected by masking and swamping effects because the test statistics used a robust scale estimate.

  • PDF

A procedure for simultaneous variable selection, variable transformation and outlier identification in linear regression (선형회귀에서 변수선택, 변수변환과 이상치 탐지의 동시적 수행을 위한 절차)

  • Seo, Han Son;Yoon, Min
    • The Korean Journal of Applied Statistics
    • /
    • v.33 no.1
    • /
    • pp.1-10
    • /
    • 2020
  • We propose a unified approach to variable selection, transformation and outliers in the linear model. The procedure includes a sequential method for outlier detection and a least trimmed squares estimator for variable transformation. It uses all possible subsets regressions for model selection. Some real data analyses and the simulation results are provided to show the efficiency of the methods in the context of the correct variable selection and the fitness of the estimated model.

Selection of Important Variables in the Classification Model for Successful Flight Training (조종사 비행훈련 성패예측모형 구축을 위한 중요변수 선정)

  • Lee, Sang-Heon;Lee, Sun-Doo
    • IE interfaces
    • /
    • v.20 no.1
    • /
    • pp.41-48
    • /
    • 2007
  • The main purpose of this paper is cost reduction in absurd pilot positive expense and human accident prevention which is caused by in the pilot selection process. We use classification models such as logistic regression, decision tree, and neural network based on aptitude test results of 505 ROK Air Force applicants in 2001~2004. First, we determine the reliability and propriety against the aptitude test system which has been improved. Based on this conference flight simulator test item was compared to the new aptitude test item in order to make additional yes or no decision from different models in terms of classification accuracy, ROC and Response Threshold side. Decision tree was selected as the most efficient for each sequential flight training result and the last flight training results predict excellent. Therefore, we propose that the standard of pilot selection be adopted by the decision tree and it presents in the aptitude test item which is new a conference flight simulator test.

Sequential Influence Diagnostics in Multiple Regression (축자적 회귀진단 절차의 개발)

  • 김복만;최성운
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.15 no.25
    • /
    • pp.97-101
    • /
    • 1992
  • This paper proposes a new procedures for assessing the influence of individual or groups of cases when any regressors are included. At first, various influence measures pickout influential cases when one regress-or is deleted. Next find influential subsets by using heuristic approach and perform group deletion. Retaining or removing any regressors may depend on the presence or absence of one or few cases. Then, we can identify the interrelationships that exist among regressors and cases and examine their impact on the fitted regression equation. We conclude with an example using fuel consumption data.

  • PDF

New explicit formulas for optimum design of concrete gravity dams

  • Habibi, Alireza;Zarei, Sajad;Khaledy, Nima
    • Computers and Concrete
    • /
    • v.27 no.2
    • /
    • pp.143-152
    • /
    • 2021
  • Large dams are a part of the infrastructure of any society, and a huge amount of resources are consumed to build them. Among the various types of dams, the optimum design of concrete gravity dams requires special attention because these types of dams require a huge amount of concrete for their construction. On the other hand, concrete gravity dams are among the structures whose design, regarding the acting forces, geometric parameters, and resistance and stability criteria, has some complexities. In the present study, an optimization methodology is proposed based on Sequential Quadratic Programming (SQP), and a computer program is developed to perform optimization of concrete gravity dams. The optimum results for 45 concrete gravity dams are studied and regression analyses are performed to obtain some explicit formulas for optimization of the gravity dams. The optimization of concrete gravity dams can be provided easily using the developed formulas, without the need to perform any more optimization process.

An Efficient Adaptive Digital Filtering Algorithm for Identification of Second Order Volterra Systems (이차 볼테라 시스템 인식을 위한 효율적인 적응 디지탈 필터링 알고리즘)

  • Hwang, Y.S.;Mathews, V.J.;Cha, I.W.;Youn, D.H.
    • The Journal of the Acoustical Society of Korea
    • /
    • v.7 no.4
    • /
    • pp.98-109
    • /
    • 1988
  • This paper introduces an adaptive nonlinear filtering algorithm that uses the sequential regression(SER) method to update the second order Volterra filter coefficients in a recursive way. Conventionally, the SER method has been used to invert large matrices which result from direct application of Wiener filter theory to the Volterra filter. However, the algorithm proposed in this paper uses the SER approach to update the least squares solution which is derived for Gaussian input signals. In such an algorithm, the size of the matrix to be inverted is smaller than that of conventional approaches, and hence the proposed method is computationally simpler than conventional nonlinear system identification techniques. Simulation results are presented to demonstrate the performance of the proposed algorithm.

  • PDF