• Title/Summary/Keyword: Model Generalization

Search Result 434, Processing Time 0.032 seconds

A Study on Customer Segmentation Prediction Model using Support Vector Machine (Support Vector Machine을 이용한 고객이탈 예측모형에 관한 연구)

  • Seo Kwang Kyu
    • Journal of the Korea Safety Management & Science
    • /
    • v.7 no.1
    • /
    • pp.199-210
    • /
    • 2005
  • Customer segmentation prediction has attracted a lot of research interests in previous literature, and recent studies have shown that artificial neural networks (ANN) method achieved better performance than traditional statistical ones. However, ANN approaches have suffered from difficulties with generalization, producing models that can overfit the data. This paper employs a relatively new machine learning technique, support vector machines (SVM), to the customer segmentation prediction problem in an attempt to provide a model with better explanatory power. To evaluate the prediction accuracy of SVM, we compare its performance with logistic regression analysis and ANN. The experiment results with real data of insurance company show that SVM superiors to them.

Design of Fuzzy-Neural Networks Structure using Optimization Algorithm and an Aggregate Weighted Performance Index (최적 알고리즘과 합성 성능지수에 의한 퍼지-뉴럴네트워크구조의 설계)

  • Yoon, Ki-Chan;Oh, Sung-Kwun;Park, Jong-Jin
    • Proceedings of the KIEE Conference
    • /
    • 1999.07g
    • /
    • pp.2911-2913
    • /
    • 1999
  • This paper suggest an optimal identification method to complex and nonlinear system modeling that is based on Fuzzy-Neural Network(FNN). The FNN modeling implements parameter identification using HCM algorithm and optimal identification algorithm structure combined with two types of optimization theories for nonlinear systems, we use a HCM Clustering Algorithm to find initial parameters of membership function. The parameters such as parameters of membership functions, learning rates and momentum coefficients are adjusted using optimal identification algorithm. The proposed optimal identification algorithm is carried out using both a genetic algorithm and the improved complex method. Also, an aggregate objective function(performance index) with weighted value is proposed to achieve a sound balance between approximation and generalization abilities of the model. To evaluate the performance of the proposed model, we use the time series data for gas furnace, the data of sewage treatment process and traffic route choice process.

  • PDF

Evaluation Factor related to Thinking Skills and Strategies based on Mathematical Thinking Process (수학적 사고 과정 관련의 평가 요소 탐색)

  • 황혜정
    • The Mathematical Education
    • /
    • v.40 no.2
    • /
    • pp.253-263
    • /
    • 2001
  • Developing mathematical thinking skills is one of the most important goals of school mathematics. In particular, recent performance based on assessment has focused on the teaching and learning environment in school, emphasizing student's self construction of their learning and its process. Because of this reason, people related to mathematics education including math teachers are taught to recognize the fact that the degree of students'acquisition of mathematical thinking skills and strategies(for example, inductive and deductive thinking, critical thinking, creative thinking) should be estimated formally in math class. However, due to the lack of an evaluation tool for estimating the degree of their thinking skills, efforts at evaluating student's degree of mathematics thinking skills and strategy acquisition failed. Therefore, in this paper, mathematical thinking was studied, and using the results of study as the fundamental basis, mathematical thinking process model was developed according to three types of mathematical thinking - fundamental thinking skill, developing thinking skill, and advanced thinking strategies. Finally, based on the model, evaluation factors related to essential thinking skills such as analogy, deductive thinking, generalization, creative thinking requested in the situation of solving mathematical problems were developed.

  • PDF

Heart Attack Prediction using Neural Network and Different Online Learning Methods

  • Antar, Rayana Khaled;ALotaibi, Shouq Talal;AlGhamdi, Manal
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.6
    • /
    • pp.77-88
    • /
    • 2021
  • Heart Failure represents a critical pathological case that is challenging to predict and discover at an early age, with a notable increase in morbidity and mortality. Machine Learning and Neural Network techniques play a crucial role in predicting heart attacks, diseases and more. These techniques give valuable perspectives for clinicians who may then adjust their diagnosis for each individual patient. This paper evaluated neural network models for heart attacks predictions. Several online learning methods were investigated to automatically and accurately predict heart attacks. The UCI dataset was used in this work to train and evaluate First Order and Second Order Online Learning methods; namely Backpropagation, Delta bar Delta, Levenberg Marquardt and QuickProp learning methods. An optimizer technique was also used to minimize the random noise in the database. A regularization concept was employed to further improve the generalization of the model. Results show that a three layers' NN model with a Backpropagation algorithm and Nadam optimizer achieved a promising accuracy for the heart attach prediction tasks.

On Two Mathematical Models and Their Appli-cations for the Estmation of Population (산業社會의 人口移動推定을 위한 數理模型의 適용: 특히 1975년도 Census人口에 立脚한 將來人口推計)

  • J.H.Koo;C.K.Im;B.M.Jun;K.W.Jong
    • Journal of the Korean Statistical Society
    • /
    • v.7 no.2
    • /
    • pp.131-142
    • /
    • 1978
  • This study aims to find out a suitable mathematical models for the estimation of population size and improve it for the estimation of social increase of population at urban areas. This study shows that Model (I) is obtained by the generalization of Kabak's Wild Life Management Model together with some other useful results as follows: a) By the transition matrix P, it is known that the interregional migrations have shown greater rise than those of five years ago. b) The invariant population vector $\alpha$ predicts that the Kyonggi area will have a share of 48%, the Choongcheong area of 10%, the Honam area of 12%, and the Youngnam area of 17% of the total population of Korea. c) The estimated population of the Special City of Seoul (Metropolitan) will be above ten millon in 1983. d) The estimated optmum population of Korea will be 53,850,000 in 2000 A.D.

  • PDF

Mathematics Inquiring Based on Pattern Similarity

  • Yanhui Xu
    • Research in Mathematical Education
    • /
    • v.26 no.3
    • /
    • pp.147-166
    • /
    • 2023
  • Mathematics is a science of pattern. Mathematics is a subject of inquiring which aims at discovering the models hidden behind the world. Pattern is abstraction and generalization of the model. Mathematical pattern is a higher level of mathematical model. Mathematics patterns are often hidden in pattern similarity. Creation of mathematics lies largely in discovering the pattern similarity among the various components of mathematics. Inquiring is the core and soul of mathematics teaching. It is very important for students to study mathematics like mathematicians' exploring and discovering mathematics based on pattern similarity. The author describes an example about how to guide students to carry out mathematics inquiring based on pattern similarity in classroom.

Air Pollutants Tracing Model using Perceptron Neural Network and Non-negative Least Square

  • Yu, Suk-Hyun;Kwon, Hee-Yong
    • Journal of Korea Multimedia Society
    • /
    • v.16 no.12
    • /
    • pp.1465-1474
    • /
    • 2013
  • In this paper, air pollutant tracing models using perceptron neural network(PNN) and non-negative least square(NNLS) are proposed. When the measured values of the air pollution and the contribution concentration of each source by chemical transport modeling are given, they estimate and trace the amount of the air pollutants emission from each source. Two kinds of emissions data are used in the experiments : CH4 and N2O of Geumgo-dong landfill greenhouse gas, and PM10 of 17 areas in Northeast Asia and eight regions of the Korean Peninsula. Emission values were calculated using pseudo inverse method, PNN and NNLS. Pseudo inverse method could be used for the model, but it may have negative emission values. In order to deal with the problem, we used the PNN and NNLS methods. As a result, the estimation using the NNLS is closer to the measured values than that using PNN. The proposed tracing models have better utilization and generalization than those of conventional pseudo inverse model. It could be used more efficiently for air quality management and air pollution reduction.

Design of FNN architecture based on HCM Clustering Method (HCM 클러스터링 기반 FNN 구조 설계)

  • Park, Ho-Sung;Oh, Sung-Kwun
    • Proceedings of the KIEE Conference
    • /
    • 2002.07d
    • /
    • pp.2821-2823
    • /
    • 2002
  • In this paper we propose the Multi-FNN (Fuzzy-Neural Networks) for optimal identification modeling of complex system. The proposed Multi-FNNs is based on a concept of FNNs and exploit linear inference being treated as generic inference mechanisms. In the networks learning, backpropagation(BP) algorithm of neural networks is used to updata the parameters of the network in order to control of nonlinear process with complexity and uncertainty of data, proposed model use a HCM(Hard C-Means)clustering algorithm which carry out the input-output dat a preprocessing function and Genetic Algorithm which carry out optimization of model The HCM clustering method is utilized to determine the structure of Multi-FNNs. The parameters of Multi-FNN model such as apexes of membership function, learning rates, and momentum coefficients are adjusted using genetic algorithms. An aggregate performance index with a weighting factor is proposed in order to achieve a sound balance between approximation and generalization abilities of the model. NOx emission process data of gas turbine power plant is simulated in order to confirm the efficiency and feasibility of the proposed approach in this paper.

  • PDF

Study on the Generalization of the Equivalent Point Method for Thermal Evaluation (Equivalent Point Method의 일반적 이용을 위한 연구)

  • Rhim, Jong-Whan
    • Korean Journal of Food Science and Technology
    • /
    • v.22 no.5
    • /
    • pp.575-581
    • /
    • 1990
  • The existence of the equivalent point for a thermal processing system was demonstrated using arbitrarily chosen ideal direct heating curves. i.e. isothermal heating curves at $120^{\circ}C$ for 10min and at $135^{\circ}C$ for 10sec. Under these conditions, G-values and F-values were calculated at various values of Ea- and z-values by applying the Arrhenius and the Bigelow models respectively. The equivalent time and equivalent temperature were determined by both line intersection and linear regression methods. The equivalent points estimated by both the line intersection and the linear regression methods were consistent and their values were the same as the heating time and temperature of the ideal direct heating curves.

  • PDF

Identification of Fuzzy Systems by means of the Extended GMDH Algorithm

  • Park, Chun-Seong;Park, Jae-Ho;Oh, Sung-Kwun
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1998.10a
    • /
    • pp.254-259
    • /
    • 1998
  • A new design methology is proposed to identify the structure and parameters of fuzzy model using PNN and a fuzzy inference method. The PNN is the extended structure of the GMDH(Group Method of Data Handling), and uses several types of polynomials such as linear, quadratic and cubic besides the biquadratic polynomial used in the GMDH. The FPNN(Fuzzy Polynomial Neural Networks) algorithm uses PNN(Polynomial Neural networks) structure and a fuzzy inference method. In the fuzzy inference method, the simplified and regression polynomial inference methods are used. Here a regression polynomial inference is based on consequence of fuzzy rules with a polynomial equations such as linear, quadratic and cubic equation. Each node of the FPNN is defined as fuzzy rules and its structure is a kind of neuro-fuzzy architecture. In this paper, we will consider a model that combines the advantage of both FPNN and PNN. Also we use the training and testing data set to obtain a balance between the approximation and generalization of process model. Several numerical examples are used to evaluate the performance of the our proposed model.

  • PDF