• Title/Summary/Keyword: Stochastic Learning

Search Result 142, Processing Time 0.021 seconds

A Study on the Fast Enrollment of Text-Independent Speaker Verification for Vehicle Security (차량 보안을 위한 어구독립 화자증명의 등록시간 단축에 관한 연구)

  • Lee, Tae-Seung;Choi, Ho-Jin
    • Journal of Advanced Navigation Technology
    • /
    • v.5 no.1
    • /
    • pp.1-10
    • /
    • 2001
  • Speech has a good characteristics of which car drivers busy to concern with miscellaneous operation can make use in convenient handling and manipulating of devices. By utilizing this, this works proposes a speaker verification method for protecting cars from being stolen and identifying a person trying to access critical on-line services. In this, continuant phonemes recognition which uses language information of speech and MLP(mult-layer perceptron) which has some advantages against previous stochastic methods are adopted. The recognition method, though, involves huge computation amount for learning, so it is somewhat difficult to adopt this in speaker verification application in which speakers should enroll themselves at real time. To relieve this problem, this works presents a solution that introduces speaker cohort models from speaker verification score normalization technique established before, dividing background speakers into small cohorts in advance. As a result, this enables computation burden to be reduced through classifying the enrolling speaker into one of those cohorts and going through enrollment for only that cohort.

  • PDF

Application of Resampling Method based on Statistical Hypothesis Test for Improving the Performance of Particle Swarm Optimization in a Noisy Environment (노이즈 환경에서 입자 군집 최적화 알고리즘의 성능 향상을 위한 통계적 가설 검정 기반 리샘플링 기법의 적용)

  • Choi, Seon Han
    • Journal of the Korea Society for Simulation
    • /
    • v.28 no.4
    • /
    • pp.21-32
    • /
    • 2019
  • Inspired by the social behavior models of a bird flock or fish school, particle swarm optimization (PSO) is a popular metaheuristic optimization algorithm and has been widely used from solving a complex optimization problem to learning a artificial neural network. However, PSO is difficult to apply to many real-life optimization problems involving stochastic noise, since it is originated in a deterministic environment. To resolve this problem, this paper incorporates a resampling method called the uncertainty evaluation (UE) method into PSO. The UE method allows the particles to converge on the accurate optimal solution quickly in a noisy environment by selecting the particles' global best position correctly, one of the significant factors in the performance of PSO. The results of comparative experiments on several benchmark problems demonstrated the improved performance of the propose algorithm compared to the existing studies. In addition, the results of the case study emphasize the necessity of this work. The proposed algorithm is expected to be effectively applied to optimize complex systems through digital twins in the fourth industrial revolution.

Big Data and Knowledge Generation in Tertiary Education in the Philippines

  • Fadul, Jose A.
    • Journal of Contemporary Eastern Asia
    • /
    • v.13 no.1
    • /
    • pp.5-18
    • /
    • 2014
  • This exploratory study investigates the use of a computational knowledge engine (WolframAlpha) and social networking sites (Gmail, Yahoo and Facebook) by 200 students at De La Salle-College of Saint Benilde, their "friends" and their "friends of friends" during the 2009 through 2013 school years, and how this appears to have added value in knowledge generation. The primary aim is to identify what enhances productiveness in knowledge generation in Philippine Tertiary Education. The phenomenological approach is used, therefore there are no specific research questions or hypotheses proposed in this paper. Considering that knowledge generation is a complex phenomenon, a stochastic modelling approach is also used for the investigation that was developed specifically to study un-deterministic complex systems. A list of salient features for knowledge generation is presented as a result. In addition to these features, various problem types are identified from literature. These are then integrated to provide a proposed framework of inclusive (friendly) and innovative social networks, for knowledge generation in Philippine tertiary education. Such a framework is necessarily multidisciplinary and useful for problem-solving in a globalized and pluralist reality. The implementation of this framework is illustrated in the three parts of the study: Part 1: Online lessons, discussions, and examinations in General Psychology, Introduction to Sociology, and Life and Works of Jose Rizal, for the author's students in De La Salle-College of Saint Benilde; Part 2: Facebook Report analytics of students and teachers, their friends and their friends of friends via WolframAlpha; and Part 3: Social Network Analysis of the people and groups influencing the courses' scope-and-sequence in the new General Education Curriculum for Tertiary Schools and Institutions in the Philippines.

A Simple Stereo Matching Algorithm using PBIL and its Alternative (PBIL을 이용한 소형 스테레오 정합 및 대안 알고리즘)

  • Han Kyu-Phil
    • The KIPS Transactions:PartB
    • /
    • v.12B no.4 s.100
    • /
    • pp.429-436
    • /
    • 2005
  • A simple stereo matching algorithm using population-based incremental learning(PBIL) is proposed in this paper to decrease the general problem of genetic algorithms, such as memory consumption and inefficiency of search. PBIL is a variation of genetic algorithms using stochastic search and competitive teaming based on a probability vector. The structure of PBIL is simpler than that of other genetic algorithm families, such as serial and parallel ones, due to the use of a probability vector. The PBIL strategy is simplified and adapted for stereo matching circumstances. Thus, gene pool, chromosome crossover, and gene mutation we removed, while the evolution rule, that fitter chromosomes should have higher survival probabilities, is preserved. As a result, memory space is decreased, matching rules are simplified and computation cost is reduced. In addition, a scheme controlling the distance of neighbors for disparity smoothness is inserted to obtain a wide-area consistency of disparities, like a result of coarse-to-fine matchers. Because of this scheme, the proposed algorithm can produce a stable disparity map with a small fixed-size window. Finally, an alterative version of the proposed algorithm without using probability vector is also presented for simpler set-ups.

Stochastic Real-time Demand Prediction for Building and Charging and Discharging Technique of ESS Based on Machine-Learning (머신러닝기반 확률론적 실시간 건물에너지 수요예측 및 BESS충방전 기법)

  • Yang, Seung Kwon;Song, Taek Ho
    • KEPCO Journal on Electric Power and Energy
    • /
    • v.5 no.3
    • /
    • pp.157-163
    • /
    • 2019
  • K-BEMS System was introduced to reduce peak load and to save total energy of the 120 buildings that KEPCO headquarter and branch offices use. K-BEMS system is composed of PV, battery, and hybrid PCS. In this system, ESS, PV, lighting is used to save building energy based on demand prediction. Currently, neural network technique for short past data is applied to demand prediction, and fixed scheduling method by operator for ESS charging/discharging is used. To enhance this system, KEPCO research institute has carried out this K-BEMS research project for 3 years since January 2016. As the result of this project, we developed new real-time highly reliable building demand prediction technique with error free and optimized automatic ESS charging/discharging technique. Through several field test, we can certify the developed algorithm performance successfully. So we will describe the details in this paper.

Mid-Term Energy Demand Forecasting Using Conditional Restricted Boltzmann Machine (조건적 제한된 볼츠만머신을 이용한 중기 전력 수요 예측)

  • Kim, Soo-Hyun;Sun, Young-Ghyu;Lee, Dong-gu;Sim, Is-sac;Hwang, Yu-Min;Kim, Hyun-Soo;Kim, Hyung-suk;Kim, Jin-Young
    • Journal of IKEEE
    • /
    • v.23 no.1
    • /
    • pp.127-133
    • /
    • 2019
  • Electric power demand forecasting is one of the important research areas for future smart grid introduction. However, It is difficult to predict because it is affected by many external factors. Traditional methods of forecasting power demand have been limited in making accurate prediction because they use raw power data. In this paper, a probability-based CRBM is proposed to solve the problem of electric power demand prediction using raw power data. The stochastic model is suitable to capture the probabilistic characteristics of electric power data. In order to compare the mid-term power demand forecasting performance of the proposed model, we compared the performance with Recurrent Neural Network(RNN). Performance comparison using electric power data provided by the University of Massachusetts showed that the proposed algorithm results in better performance in mid-term energy demand forecasting.

Ensembles of neural network with stochastic optimization algorithms in predicting concrete tensile strength

  • Hu, Juan;Dong, Fenghui;Qiu, Yiqi;Xi, Lei;Majdi, Ali;Ali, H. Elhosiny
    • Steel and Composite Structures
    • /
    • v.45 no.2
    • /
    • pp.205-218
    • /
    • 2022
  • Proper calculation of splitting tensile strength (STS) of concrete has been a crucial task, due to the wide use of concrete in the construction sector. Following many recent studies that have proposed various predictive models for this aim, this study suggests and tests the functionality of three hybrid models in predicting the STS from the characteristics of the mixture components including cement compressive strength, cement tensile strength, curing age, the maximum size of the crushed stone, stone powder content, sand fine modulus, water to binder ratio, and the ratio of sand. A multi-layer perceptron (MLP) neural network incorporates invasive weed optimization (IWO), cuttlefish optimization algorithm (CFOA), and electrostatic discharge algorithm (ESDA) which are among the newest optimization techniques. A dataset from the earlier literature is used for exploring and extrapolating the STS behavior. The results acquired from several accuracy criteria demonstrated a nice learning capability for all three hybrid models viz. IWO-MLP, CFOA-MLP, and ESDA-MLP. Also in the prediction phase, the prediction products were in a promising agreement (above 88%) with experimental results. However, a comparative look revealed the ESDA-MLP as the most accurate predictor. Considering mean absolute percentage error (MAPE) index, the error of ESDA-MLP was 9.05%, while the corresponding value for IWO-MLP and CFOA-MLP was 9.17 and 13.97%, respectively. Since the combination of MLP and ESDA can be an effective tool for optimizing the concrete mixture toward a desirable STS, the last part of this study is dedicated to extracting a predictive formula from this model.

A Unicode based Deep Handwritten Character Recognition model for Telugu to English Language Translation

  • BV Subba Rao;J. Nageswara Rao;Bandi Vamsi;Venkata Nagaraju Thatha;Katta Subba Rao
    • International Journal of Computer Science & Network Security
    • /
    • v.24 no.2
    • /
    • pp.101-112
    • /
    • 2024
  • Telugu language is considered as fourth most used language in India especially in the regions of Andhra Pradesh, Telangana, Karnataka etc. In international recognized countries also, Telugu is widely growing spoken language. This language comprises of different dependent and independent vowels, consonants and digits. In this aspect, the enhancement of Telugu Handwritten Character Recognition (HCR) has not been propagated. HCR is a neural network technique of converting a documented image to edited text one which can be used for many other applications. This reduces time and effort without starting over from the beginning every time. In this work, a Unicode based Handwritten Character Recognition(U-HCR) is developed for translating the handwritten Telugu characters into English language. With the use of Centre of Gravity (CG) in our model we can easily divide a compound character into individual character with the help of Unicode values. For training this model, we have used both online and offline Telugu character datasets. To extract the features in the scanned image we used convolutional neural network along with Machine Learning classifiers like Random Forest and Support Vector Machine. Stochastic Gradient Descent (SGD), Root Mean Square Propagation (RMS-P) and Adaptative Moment Estimation (ADAM)optimizers are used in this work to enhance the performance of U-HCR and to reduce the loss function value. This loss value reduction can be possible with optimizers by using CNN. In both online and offline datasets, proposed model showed promising results by maintaining the accuracies with 90.28% for SGD, 96.97% for RMS-P and 93.57% for ADAM respectively.

Classification of Transport Vehicle Noise Events in Magnetotelluric Time Series Data in an Urban area Using Random Forest Techniques (Random Forest 기법을 이용한 도심지 MT 시계열 자료의 차량 잡음 분류)

  • Kwon, Hyoung-Seok;Ryu, Kyeongho;Sim, Ickhyeon;Lee, Choon-Ki;Oh, Seokhoon
    • Geophysics and Geophysical Exploration
    • /
    • v.23 no.4
    • /
    • pp.230-242
    • /
    • 2020
  • We performed a magnetotelluric (MT) survey to delineate the geological structures below the depth of 20 km in the Gyeongju area where an earthquake with a magnitude of 5.8 occurred in September 2016. The measured MT data were severely distorted by electrical noise caused by subways, power lines, factories, houses, and farmlands, and by vehicle noise from passing trains and large trucks. Using machine-learning methods, we classified the MT time series data obtained near the railway and highway into two groups according to the inclusion of traffic noise. We applied three schemes, stochastic gradient descent, support vector machine, and random forest, to the time series data for the highspeed train noise. We formulated three datasets, Hx, Hy, and Hx & Hy, for the time series data of the large truck noise and applied the random forest method to each dataset. To evaluate the effect of removing the traffic noise, we compared the time series data, amplitude spectra, and apparent resistivity curves before and after removing the traffic noise from the time series data. We also examined the frequency range affected by traffic noise and whether artifact noise occurred during the traffic noise removal process as a result of the residual difference.

Development of A Dynamic Departure Time Choice Model based on Heterogeneous Transit Passengers (이질적 지하철승객 기반의 동적 출발시간선택모형 개발 (도심을 목적지로 하는 단일 지하철노선을 중심으로))

  • 김현명;임용택;신동호;백승걸
    • Journal of Korean Society of Transportation
    • /
    • v.19 no.5
    • /
    • pp.119-134
    • /
    • 2001
  • This paper proposed a dynamic transit vehicle simulation model and a dynamic transit passengers simulation model, which can simultaneously simulate the transit vehicles and passengers traveling on a transit network, and also developed an algorithm of dynamic departure time choice model based on individual passenger. The proposed model assumes that each passenger's behavior is heterogeneous based on stochastic process by relaxing the assumption of homogeneity among passengers and travelers have imperfect information and bounded rationality to more actually represent and to simulate each passenger's behavior. The proposed model integrated a inference and preference reforming procedure into the learning and decision making process in order to describe and to analyze the departure time choices of transit passengers. To analyze and evaluate the model an example transit line heading for work place was used. Numerical results indicated that in the model based on heterogeneous passengers the travelers' preference influenced more seriously on the departure time choice behavior, while in the model based on homogeneous passengers it does not. The results based on homogeneous passengers seemed to be unrealistic in the view of rational behavior. These results imply that the aggregated travel demand models such as the traditional network assignment models based on user equilibrium, assuming perfect information on the network, homogeneity and rationality, might be different from the real dynamic travel demand patterns occurred on actual network.

  • PDF