• Title/Summary/Keyword: Least squares (LS)

Search Result 96, Processing Time 0.023 seconds

An Optimization Algorithm with Novel Flexible Grid: Applications to Parameter Decision in LS-SVM

  • Gao, Weishang;Shao, Cheng;Gao, Qin
    • Journal of Computing Science and Engineering
    • /
    • v.9 no.2
    • /
    • pp.39-50
    • /
    • 2015
  • Genetic algorithm (GA) and particle swarm optimization (PSO) are two excellent approaches to multimodal optimization problems. However, slow convergence or premature convergence readily occurs because of inappropriate and inflexible evolution. In this paper, a novel optimization algorithm with a flexible grid optimization (FGO) is suggested to provide adaptive trade-off between exploration and exploitation according to the specific objective function. Meanwhile, a uniform agents array with adaptive scale is distributed on the gird to speed up the calculation. In addition, a dominance centroid and a fitness center are proposed to efficiently determine the potential guides when the population size varies dynamically. Two types of subregion division strategies are designed to enhance evolutionary diversity and convergence, respectively. By examining the performance on four benchmark functions, FGO is found to be competitive with or even superior to several other popular algorithms in terms of both effectiveness and efficiency, tending to reach the global optimum earlier. Moreover, FGO is evaluated by applying it to a parameter decision in a least squares support vector machine (LS-SVM) to verify its practical competence.

Robust Real-time Intrusion Detection System

  • Kim, Byung-Joo;Kim, Il-Kon
    • Journal of Information Processing Systems
    • /
    • v.1 no.1 s.1
    • /
    • pp.9-13
    • /
    • 2005
  • Computer security has become a critical issue with the rapid development of business and other transaction systems over the Internet. The application of artificial intelligence, machine learning and data mining techniques to intrusion detection systems has been increasing recently. But most research is focused on improving the classification performance of a classifier. Selecting important features from input data leads to simplification of the problem, and faster and more accurate detection rates. Thus selecting important features is an important issue in intrusion detection. Another issue in intrusion detection is that most of the intrusion detection systems are performed by off-line and it is not a suitable method for a real-time intrusion detection system. In this paper, we develop the real-time intrusion detection system, which combines an on-line feature extraction method with the Least Squares Support Vector Machine classifier. Applying the proposed system to KDD CUP 99 data, experimental results show that it has a remarkable feature extraction and classification performance compared to existing off-line intrusion detection systems.

Permanent Magnet Synchronous Motor Control Algorithm Based on Stability Margin and Lyapunov Stability Analysis

  • Jie, Hongyu;Xu, Hongbing;Zheng, Yanbing;Xin, Xiaoshuai;Zheng, Gang
    • Journal of Power Electronics
    • /
    • v.19 no.6
    • /
    • pp.1505-1514
    • /
    • 2019
  • The permanent magnet synchronous motor (PMSM) is widely used in various fields and the proportional-integral (PI) controller is popular in PMSM control systems. However, the motor parameters are usually unknown, which can lead to a complicated PI controller design and poor performance. In order to design a PI controller with good performance when the motor parameters are unknown, a control algorithm based on stability margin is proposed in this paper. First of all, based on the mathematical model of the PMSM and the least squares (LS) method, motor parameters are estimated offline. Then based on the estimation values of the motor parameters, natural angular frequency and phase margin, a PI controller is designed. Performance indices including the natural angular frequency and the phase margin are used directly to design the PI controller in this paper. Scalar functions of the d-loop and the q-loop are selected. It can be seen that the designed controller parameters satisfy Lyapunov large scale asymptotic stability theory if the natural angular frequencies of the d-loop and the q-loop are large than 0. Experimental results show that the parameter estimation method has good accuracy and the designed PI controller proposed in this paper has good static and dynamic performances.

A Direction-of-Arrival Estimation Based Adaptive Beamforming Algorithm for OFDMA Smart Antenna Systems (OFDMA 스마트 안테나 시스템을 위한 도래각 추정 기반의 적응 빔 형성 알고리즘)

  • Yun, Young-Ho;Park, Yoon-Ok;Park, Hyung-Rae
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.31 no.12A
    • /
    • pp.1214-1222
    • /
    • 2006
  • In this paper, an efficient direction-r)f-arrival based adaptive beamforming algorithm for orthogonal frequency-division multiple-access smart antenna systems is proposed. The proposed algorithm provides a high performance by steering main beams to the directions of a desired signal, whereas steering nulls to the directions of the interference, using the estimated directions. The beamforming outputs obtained by steering the main beams to the distinct directions of resolvable multipath signals are combined in a maximal ratio manner to exploit angular diversity gain. The performance elf the proposed algorithm is finally evaluated in cellular mobile environments to verify its efficiency and is compared with that of least-squares beamforming algorithm, by taking the WiBro system as a target system.

A comparison study of various robust regression estimators using simulation (시뮬레이션을 통한 다양한 로버스트 회귀추정량의 비교 연구)

  • Jang, Soohee;Yoon, Jungyeon;Chun, Heuiju
    • The Korean Journal of Applied Statistics
    • /
    • v.29 no.3
    • /
    • pp.471-485
    • /
    • 2016
  • Least squares (LS) regression is a classic method for regression that is optimal under assumptions of regression and usual observations. However, the presence of unusual data in the LS method leads to seriously distorted estimates. Therefore, various robust estimation methods are proposed to circumvent the limitations of traditional LS regression. Among these, there are M-estimators based on maximum likelihood estimation (MLE), L-estimators based on linear combinations of order statistics and R-estimators based on a linear combinations of the ordered residuals. In this paper, robust regression estimators with high breakdown point and/or with high efficiency are compared under several simulated situations. The paper analyses and compares distributions of estimates as well as relative efficiencies calculated from mean squared errors (MSE) in the simulation study. We conclude that MM-estimators or GR-estimators are a good choice for the real data application.

A Curve-Fitting Channel Estimation Method for OFDM System in a Time-Varying Frequency-Selective Channel (시변 주파수 선택적 채널에서 OFDM시스템을 위한 Curve-Fitting 채널추정 방법)

  • Oh Seong-Keun;Nam Ki-Ho
    • Journal of the Institute of Electronics Engineers of Korea TC
    • /
    • v.43 no.3 s.345
    • /
    • pp.49-58
    • /
    • 2006
  • In this paper, a curve-fitting channel estimation method is proposed for orthogonal frequency division multiplexing (OFDM) system in a time-varying frequency-selective fading channel. The method can greatly improve channel state information (CSI) estimation accuracy by performing smoothing and interpolation through consecutive curve-fitting processes in both time domain and frequency domain. It first evaluates least-squares (LS) estimates using pilot symbols and then the estimates are approximated to a polynomial with proper degree in the LS error sense, starting from one preferred domain in which pilots we densely distributed. Smoothing, interpolation, and prediction are performed subsequently to obtain CSI estimates for data transmission. The channel estimation processes are completed by smoothing and interpolating CSI estimates in the other domain once again using the channel estimates obtained in one domain. The performance of proposed method is influenced heavily on the time variation and frequency selectivity of channel and pilot arrangement. Hence, a proper degree of polynomial and an optimum approximation interval according to various system and channel conditions are required for curve-fitting. From extensive simulation results in various channel environments, we see that the proposed method performs better than the conventional methods including the optimal Wiener filtering method, in terms of the mean square error (MSE) and bit error rate (BER).

Performance Comparison of Wave Information Retrieval Algorithms Based on 3D Image Analysis Using VTS Sensor (VTS 센서를 이용한 3D영상 분석에 기초한 파랑 정보 추출 알고리즘 성능 비교)

  • Ryu, Joong-seon;Lim, Dong-hee;Kim, Jin-soo;Lee, Byung-Gil
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.20 no.3
    • /
    • pp.519-526
    • /
    • 2016
  • As marine accidents happen frequently, it is required to establish a marine traffic monitoring system, which is designed to improve the safety and efficiency of navigation in VTS (Vessel Traffic Service). For this aim, recently, X-band marine radar is used for extracting the sea surface information and, it is necessary to retrieve wave information correctly and provide for the safe and efficient movement of vessel traffic within the VTS area. In this paper, three different current estimation algorithms including the classical least-squares (LS) fitting, a modified iterative least-square fitting routine and a normalized scalar product of variable current velocities are compared with buoy data and then, the iterative least-square method is modified to estimate wave information by improving the initial current velocity. Through several simulations with radar signals, it is shown that the proposed method is effective in retrieving the wave information compared to the conventional methods.

Low Complexity Hybrid Interpolation Algorithm using Weighted Edge Detector (가중치 윤곽선 검출기를 이용한 저 복잡도 하이브리드 보간 알고리듬)

  • Kwon, Hyeok-Jin;Jeon, Gwang-Gil;Jeong, Je-Chang
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.32 no.3C
    • /
    • pp.241-248
    • /
    • 2007
  • In predictive image coding, a LS (Least Squares)-based adaptive predictor is an efficient method to improve image edge predictions. This paper proposes a hybrid interpolation with weighted edge detector. A hybrid approach of switching between bilinear interpolation and EDI (Edge-Directed Interpolation) is proposed in order to reduce the overall computational complexity The objective and subjective quality is also similar to the bilinear interpolation and EDI. Experimental results demonstrate that this hybrid interpolation method that utilizes a weighted edge detector can achieve reduction in complexity with minimal degradation in the interpolation results.

A Study on Selection Criterions for Selection Diversity in WAVE Systems (WAVE 시스템에서 선택 다이버시티를 위한 선택 기준에 대한 연구)

  • Hong, Dae-Ki
    • Journal of the Semiconductor & Display Technology
    • /
    • v.14 no.2
    • /
    • pp.9-16
    • /
    • 2015
  • In this paper, selection criterions on selection diversity are researched. The diversity is applied to the multiple antenna system based on wireless access in vehicular environment (WAVE) standard for rapid varying channel. Least squares (LS) based decision feedback equalizer (DFE) are used for channel equalization. Received signal is regenerated by means of the decision feedback path. In the selection diversity, the regenerated signal as well as the received signal is selected according to selection criterion. The decision feedback algorithm can follow the fast speed of WAVE fading channel. To control the tracking speed of the time-varying channel, simple low pass filter is used. Finally, the estimated channel value recovers the distorted payloads. Signal power before automatic gain control (AGC) in analog stage can be used as a selection criterion. In the digital stage, signal power after AGC, noise power after AGC, signal to noise ratio after AGC and cross-correlation method can be used as selection criterions. According to the simulation results, the performance of the selection diversity is improved in comparison with that of the combining diversity for the WAVE fading channel.

Gauss-Newton Based Emitter Location Method Using Successive TDOA and FDOA Measurements (연속 측정된 TDOA와 FDOA를 이용한 Gauss-Newton 기법 기반의 신호원 위치추정 방법)

  • Kim, Yong-Hee;Kim, Dong-Gyu;Han, Jin-Woo;Song, Kyu-Ha;Kim, Hyoung-Nam
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.7
    • /
    • pp.76-84
    • /
    • 2013
  • In the passive emitter localization using instantaneous TDOA (time difference of arrival) and FDOA (frequency difference of arrival) measurements, the estimation accuracy can be improved by collecting additional measurements. To achieve this goal, it is required to increase the number of the sensors. However, in electronic warfare environment, a large number of sensors cause the loss of military strength due to high probability of intercept. Also, the additional processes should be considered such as the data link and the clock synchronization between the sensors. Hence, in this paper, the passive localization of a stationary emitter is presented by using the successive TDOA and FDOA measurements from two moving sensors. In this case, since an independent pair of sensors is added in the data set at every instant of measurement, each pair of sensors does not share the common reference sensor. Therefore, the QCLS (quadratic correction least squares) methods cannot be applied, in which all pairs of sensor should include the common reference sensor. For this reason, a Gauss-Newton algorithm is adopted to solve the non-linear least square problem. In addition, to show the performance of the proposed method, we compare the RMSE (root mean square error) of the estimates with CRLB (Cramer-Rao lower bound) and derived the CEP (circular error probable) planes to analyze the expected estimation performance on the 2-dimensional space.