• 한국정밀공학회지
• /
• 제12권6호
• /
• pp.120-127
• /
• 1995

A nonlinear empirical state-space model of the Artificial Neural Network(ANN) has been developed. The nonlinear model structure incorporates characteristic, so as to enable identification of the transient response, as well as the steady-state response of a dynamic system. A hybrid feedfoward/feedback neural network, namely a Local Time Delayed Recurrent Multi-layer Perception(RMLP), is the model structure developed in this paper. RMLP is used to identify nonlinear dynamic system in an input/output sense. The feedfoward protion of the network architecture provides with the well-known curve fitting factor, while local recurrent and cross-talk connections provides the dynamics of the system. A dynamic learning algorithm is used to train the proposed network in a supervised manner. The derived dynamic learning algorithm exhibit a computationally desirable characteristic; both network sweep involved in the algorithm are performed forward, enhancing its parallel implementation. RMLP state-space and its associate learning algorithm is demonstrated through a simple examples. The simulation results are very encouraging.

• Journal of Periodontal and Implant Science
• /
• 제53권1호
• /
• pp.38-53
• /
• 2023

Purpose: The current Classification of Periodontal and Peri-Implant Diseases and Conditions, published and disseminated in 2018, involves some difficulties and causes diagnostic conflicts due to its criteria, especially for inexperienced clinicians. The aim of this study was to design a decision system based on machine learning algorithms by using clinical measurements and radiographic images in order to determine and facilitate the staging and grading of periodontitis. Methods: In the first part of this study, machine learning models were created using the Python programming language based on clinical data from 144 individuals who presented to the Department of Periodontology, Faculty of Dentistry, Süleyman Demirel University. In the second part, panoramic radiographic images were processed and classification was carried out with deep learning algorithms. Results: Using clinical data, the accuracy of staging with the tree algorithm reached 97.2%, while the random forest and k-nearest neighbor algorithms reached 98.6% accuracy. The best staging accuracy for processing panoramic radiographic images was provided by a hybrid network model algorithm combining the proposed ResNet50 architecture and the support vector machine algorithm. For this, the images were preprocessed, and high success was obtained, with a classification accuracy of 88.2% for staging. However, in general, it was observed that the radiographic images provided a low level of success, in terms of accuracy, for modeling the grading of periodontitis. Conclusions: The machine learning-based decision system presented herein can facilitate periodontal diagnoses despite its current limitations. Further studies are planned to optimize the algorithm and improve the results.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제5권3호
• /
• pp.560-574
• /
• 2011

In this paper, we propose a hybrid method of Machine Learning (ML) algorithm and a rule-based algorithm to implement a lightweight Named Entity (NE) extraction system for Korean SMS text. NE extraction from Korean SMS text is a challenging theme due to the resource limitation on a mobile phone, corruptions in input text, need for extension to include personal information stored in a mobile phone, and sparsity of training data. The proposed hybrid method retaining the advantages of statistical ML and rule-based algorithms provides fully-automated procedures for the combination of ML approaches and their correction rules using a threshold-based soft decision function. The proposed method is applied to Korean SMS texts to extract person's names as well as location names which are key information in personal appointment management system. Our proposed system achieved 80.53% in F-measure in this domain, superior to those of the conventional ML approaches.

• Advances in concrete construction
• /
• 제13권1호
• /
• pp.11-23
• /
• 2022

Conventional concrete needs some improvement in the mechanical properties, which can be obtained by different admixtures. However, making concrete samples costume always time and money. In this paper, different types of hybrid algorithms are applied to develop predictive models for forecasting compressive strength (CS) of concretes containing metakaolin (MK) and fly ash (FA). In this regard, three different algorithms have been used, namely multilayer perceptron (MLP), radial basis function (RBF), and support vector machine (SVR), to predict CS of concretes by considering most influencers input variables. These algorithms integrated with the grey wolf optimization (GWO) algorithm to increase the model's accuracy in predicting (GWMLP, GWRBF, and GWSVR). The proposed MLP models were implemented and evaluated in three different layers, wherein each layer, GWO, fitted the best neuron number of the hidden layer. Correspondingly, the key parameters of the SVR model are identified using the GWO method. Also, the optimization algorithm determines the hidden neurons' number and the spread value to set the RBF structure. The results show that the developed models all provide accurate predictions of the CS of concrete incorporating MK and FA with R² larger than 0.9972 and 0.9976 in the learning and testing stage, respectively. Regarding GWMLP models, the GWMLP1 model outperforms other GWMLP networks. All in all, GWSVR has the worst performance with the lowest indices, while the highest score belongs to GWRBF.

• Asia pacific journal of information systems
• /
• 제29권4호
• /
• pp.752-770
• /
• 2019

The purpose of this study is to incorporate telemarketing processes to improve telemarketing performance. For this application, we have attempted to mix the model of machine learning to extract potential customers with personalisation techniques to derive recommended products from actual contact. Most of traditional recommendation systems were mainly in ways such as collaborative filtering, which predicts items with a high likelihood of future purchase, based on existing purchase transactions or preferences for products. But, under these systems, new users or items added to the system do not have sufficient information, and generally cause problems such as a cold start that can not obtain satisfactory recommendation items. Also, indiscriminate telemarketing attempts can backfire as they increase the dissatisfaction and fatigue of customers who do not want to be contacted. To this purpose, this study presented a multi-purpose hybrid recommendation algorithm to achieve two goals: to select customers with high possibility of contact, and to recommend products to selected customers. In addition, we used subscription data from telemarketing agency that handles insurance products to derive realistic applicability of the proposed recommendation system. Our proposed recommendation system would certainly solve the cold start and scarcity problem of existing recommendation algorithm by using contents information such as customer master information and telemarketing history. Also. the model could show excellent performance not only in terms of overall performance but also in terms of the recommendation success rate of the unpopular product.

• 한국정보처리학회논문지
• /
• 제7권2호
• /
• pp.552-557
• /
• 2000

본 논문에서는 신경망의 초기 파라미터(가중치, 바이어스) 값을 최적화 시키는 GA-BP(Genetic Algorithm-Backpropagation Network) 혼합 알고리즘을 이용하여 얼굴을 인식하는 방법을 제안하였다. 입력 영상의 각 픽셀들을 신경망의 입력으로 사용하고 고정 소수점 실수값으로 이루어진 신경망의 초기 파리미터 값은 유전자 알고리즘의 개체로 사용하기 위해 비트 스트링으로 변환한다. 신경망의 오차가 최소가 되는 값을 적합도로 정의한 뒤 새롭게 정의된 적응적 재학습 연산자를 이용하여 이를 평가해 최적의 진환된 신경망을 구성한 뒤 얼굴을 인식하는 실험을 하였다. 실험 결과 학습 수렴 속도의 비교에서는 오류 역전과 알고리즘 단독으로 실행한 수렴 속도보다 제안된 알고리즘의 수렴 속도가 향상된 결과를 보였고 인식률에서 오류 역전과 알고리즘 단독으로 실행한 방법보다 2.9% 향상된 것으로 나타났다.

• Computers and Concrete
• /
• 제32권6호
• /
• pp.577-594
• /
• 2023

Engineered cementitious composites with calcined clay limestone cement (LC³-ECC) as a kind of green, low-carbon and high toughness concrete, has recently received significant investigation. However, the complicated relationship between potential influential factors and LC³-ECC compressive strength makes the prediction of LC³-ECC compressive strength difficult. Regarding this, the machine learning-based prediction models for the compressive strength of LC³-ECC concrete is firstly proposed and developed. Models combine three novel meta-heuristic algorithms (golden jackal optimization algorithm, butterfly optimization algorithm and whale optimization algorithm) with support vector regression (SVR) to improve the accuracy of prediction. A new dataset about LC³-ECC compressive strength was integrated based on 156 data from previous studies and used to develop the SVR-based models. Thirteen potential factors affecting the compressive strength of LC³-ECC were comprehensively considered in the model. The results show all hybrid SVR prediction models can reach the Coefficient of determination (R²) above 0.95 for the testing set and 0.97 for the training set. Radar and Taylor plots also show better overall prediction performance of the hybrid SVR models than several traditional machine learning techniques, which confirms the superiority of the three proposed methods. The successful development of this predictive model can provide scientific guidance for LC³-ECC materials and further apply to such low-carbon, sustainable cement-based materials.

• 한국정보과학회논문지:컴퓨팅의 실제 및 레터
• /
• 제9권6호
• /
• pp.693-698
• /
• 2003

야구는 매 경기마다 다양한 기록을 생성하며, 이러한 기록을 기반으로 다음 경기에 대한 승패예측이 이루어진다. 프로야구 승패 예측에 대한 연구는 많은 사람들에 의해 행해져 왔으나 아직 이렇다할 결과를 얻지 못하고 있는 상태이다. 이처럼 승패 예측이 어려운 이유는 많은 경기 기록들 중 승패 예측에 영향을 주는 요소의 선별이 어렵고, 예측에 사용된 자료들 간의 중복 요인으로 인해 학습 모델의 복잡도만 증가시킬 뿐 좋은 성능을 보이지 못하고 있다. 이에 본 논문에서는 전문가들의 의견을 바탕으로 학습 요소들을 선택하고, 선택된 자료들을 이용하여 휴리스틱 함수를 구성하였다. 요소들 간의 조합을 통해 예측에 영향을 줄 수 있는 새로운 값을 산출함과 동시에 학습 알고리즘에 사용될 입력 값의 차원을 줄일 수 있는 혼합형 모델을 제안하였다. 그 결과, 학습 알고리즘으로 사용된 역전파 알고리즘의 복잡도를 감소시키고, 프로야구 경기 승패 예측에 있어서도 정확성이 향상되었다.

• 정보기술응용연구
• /
• 제1권
• /
• pp.173-211
• /
• 1999

The task of classification permeates all walks of life, from business and economics to science and public policy. In this context, nonlinear techniques from artificial intelligence have often proven to be more effective than the methods of classical statistics. The objective of knowledge discovery and data mining is to support decision making through the effective use of information. The automated approach to knowledge discovery is especially useful when dealing with large data sets or complex relationships. For many applications, automated software may find subtle patterns which escape the notice of manual analysis, or whose complexity exceeds the cognitive capabilities of humans. This paper explores the utility of a collaborative learning approach involving integrated models in the preprocessing and postprocessing stages. For instance, a genetic algorithm effects feature-weight optimization in a preprocessing module. Moreover, an inductive tree, artificial neural network (ANN), and k-nearest neighbor (kNN) techniques serve as postprocessing modules. More specifically, the postprocessors act as second0order classifiers which determine the best first-order classifier on a case-by-case basis. In addition to the second-order models, a voting scheme is investigated as a simple, but efficient, postprocessing model. The first-order models consist of statistical and machine learning models such as logistic regression (logit), multivariate discriminant analysis (MDA), ANN, and kNN. The genetic algorithm, inductive decision tree, and voting scheme act as kernel modules for collaborative learning. These ideas are explored against the background of a practical application relating to financial fraud management which exemplifies a binary classification problem.

• 대한전기학회논문지:전력기술부문A
• /
• 제48권10호
• /
• pp.1293-1302
• /
• 1999

In this paper, an on-line process scheme is presented for implementation of a intelligent on-line modeling of nonlinear complex system. The proposed on-line process scheme is composed of FNN-based model algorithm and PLC-based simulator, Here, an adaptive fuzzy-neural networks and HCM(Hard C-Means) clustering method are used as an intelligent identification algorithm for on-line modeling. The adaptive fuzzy-neural networks consists of two distinct modifiable sturctures such as the premise and the consequence part. The parameters of two structures are adapted by a combined hybrid learning algorithm of gradient decent method and least square method. Also we design an interface S/W between PLC(Proguammable Logic Controller) and main PC computer, and construct a monitoring and control simulator for real process system. Accordingly the on-line identification algorithm and interface S/W are used to obtain the on-line FNN model structure and to accomplish the on-line modeling. And using some I/O data gathered partly in the field(plant), computer simulation is carried out to evaluate the performance of FNN model structure generated by the on-line identification algorithm. This simulation results show that the proposed technique can produce the optimal fuzzy model with higher accuracy and feasibility than other works achieved previously.