• Title/Summary/Keyword: Weight Learning

Search Result 658, Processing Time 0.02 seconds

Utilization of age information for speaker verification using multi-task learning deep neural networks (멀티태스크 러닝 심층신경망을 이용한 화자인증에서의 나이 정보 활용)

  • Kim, Ju-ho;Heo, Hee-Soo;Jung, Jee-weon;Shim, Hye-jin;Kim, Seung-Bin;Yu, Ha-Jin
    • The Journal of the Acoustical Society of Korea
    • /
    • v.38 no.5
    • /
    • pp.593-600
    • /
    • 2019
  • The similarity in tones between speakers can lower the performance of speaker verification. To improve the performance of speaker verification systems, we propose a multi-task learning technique using deep neural network to learn speaker information and age information. Multi-task learning can improve generalization performances, because it helps deep neural networks to prevent hidden layers from overfitting into one task. However, we found in experiments that learning of age information does not work well in the process of learning the deep neural network. In order to improve the learning, we propose a method to dynamically change the objective function weights of speaker identification and age estimation in the learning process. Results show the equal error rate based on RSR2015 evaluation data set, 6.91 % for the speaker verification system without using age information, 6.77 % using age information only, and 4.73 % using age information when weight change technique was applied.

Design and Implementation of Fruit harvest time Predicting System based on Machine Learning (머신러닝 적용 과일 수확시기 예측시스템 설계 및 구현)

  • Oh, Jung Won;Kim, Hangkon;Kim, Il-Tae
    • Smart Media Journal
    • /
    • v.8 no.1
    • /
    • pp.74-81
    • /
    • 2019
  • Recently, machine learning technology has had a significant impact on society, particularly in the medical, manufacturing, marketing, finance, broadcasting, and agricultural aspects of human lives. In this paper, we study how to apply machine learning techniques to foods, which have the greatest influence on the human survival. In the field of Smart Farm, which integrates the Internet of Things (IoT) technology into agriculture, we focus on optimizing the crop growth environment by monitoring the growth environment in real time. KT Smart Farm Solution 2.0 has adopted machine learning to optimize temperature and humidity in the greenhouse. Most existing smart farm businesses mainly focus on controlling the growth environment and improving productivity. On the other hand, in this study, we are studying how to apply machine learning with respect to harvest time so that we will be able to harvest fruits of the highest quality and ship them at an excellent cost. In order to apply machine learning techniques to the field of smart farms, it is important to acquire abundant voluminous data. Therefore, to apply accurate machine learning technology, it is necessary to continuously collect large data. Therefore, the color, value, internal temperature, and moisture of greenhouse-grown fruits are collected and secured in real time using color, weight, and temperature/humidity sensors. The proposed FPSML provides an architecture that can be used repeatedly for a similar fruit crop. It allows for a more accurate harvest time as massive data is accumulated continuously.

RoutingConvNet: A Light-weight Speech Emotion Recognition Model Based on Bidirectional MFCC (RoutingConvNet: 양방향 MFCC 기반 경량 음성감정인식 모델)

  • Hyun Taek Lim;Soo Hyung Kim;Guee Sang Lee;Hyung Jeong Yang
    • Smart Media Journal
    • /
    • v.12 no.5
    • /
    • pp.28-35
    • /
    • 2023
  • In this study, we propose a new light-weight model RoutingConvNet with fewer parameters to improve the applicability and practicality of speech emotion recognition. To reduce the number of learnable parameters, the proposed model connects bidirectional MFCCs on a channel-by-channel basis to learn long-term emotion dependence and extract contextual features. A light-weight deep CNN is constructed for low-level feature extraction, and self-attention is used to obtain information about channel and spatial signals in speech signals. In addition, we apply dynamic routing to improve the accuracy and construct a model that is robust to feature variations. The proposed model shows parameter reduction and accuracy improvement in the overall experiments of speech emotion datasets (EMO-DB, RAVDESS, and IEMOCAP), achieving 87.86%, 83.44%, and 66.06% accuracy respectively with about 156,000 parameters. In this study, we proposed a metric to calculate the trade-off between the number of parameters and accuracy for performance evaluation against light-weight.

Weighted Kernel and it's Learning Method for Cancer Diagnosis System (암진단시스템을 위한 Weighted Kernel 및 학습방법)

  • Choi, Gyoo-Seok;Park, Jong-Jin;Jeon, Byoung-Chan;Park, In-Kyu;Ahn, Ihn-Seok;Nguyen, Ha-Nam
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.9 no.2
    • /
    • pp.1-6
    • /
    • 2009
  • One of the most important problems in bioinformatics is how to extract the useful information from a huge amount of data, and make a decision in diagnosis, prognosis, and medical treatment applications. This paper proposes a weighted kernel function for support vector machine and its learning method with a fast convergence and a good classification performance. We defined the weighted kernel function as the weighted sum of a set of different types of basis kernel functions such as neural, radial, and polynomial kernels, which are trained by a learning method based on genetic algorithm. The weights of basis kernel functions in proposed kernel are determined in learning phase and used as the parameters in the decision model in classification phase. The experiments on several clinical datasets such as colon cancer indicate that our weighted kernel function results in higher and more stable classification performance than other kernel functions.

  • PDF

Impaired Avoidance Learning and Increased hsp70 mRNA Expression in Pentylenetetrazol-treated Zebrafish

  • Kim, Yeon-Hwa;Lee, Yun-Kyoung;Lee, Han-Sol;Jung, Min-Whan;Lee, Chang-Joong
    • Animal cells and systems
    • /
    • v.13 no.3
    • /
    • pp.275-281
    • /
    • 2009
  • The effects of pentylenetetrazol (PTZ), a GABA receptor antagonist, were studied on passive avoidance learning and expression of heat shock protein 70 (hsp70), neuroglobin, and fatty acid binding protein-7 (fabp-7) genes. Zebrafish were trained to stay in a dark compartment to avoid a weight dropping in an acryl shuttle box with a central sliding door. In two training sessions of 2 h interval, each consisting of 3 trials, the crossing time was significantly increased from $43.2{\pm}14.4s$ to $149.3{\pm}38.5s$ in the first training session and remained $116.1{\pm}36.0s$ s in the first trial of the second training session in the control. In zebrafish treated with PTZ before the first training session, the crossing time was significantly increased neither in the first nor in the second training session. However, the increased crossing time was maintained in the second training session when 10 mM PTZ was treated three times for 10 min at 30 min intervals between the first and second training session. Quantitative real-time PCR showed that expression level of hsp70 mRNA increased two to eight fold over that of control in the brain at 0-24 h after termination of PTZ treatment. No change in expression of neuroglobin and fabp-7 mRNA was shown in PTZ-treated zebrafish. Our studies suggest that PTZ impairs learning ability in avoidance response and also modifies expression of genes related to the neuroprotection.

Maximum Torque Control of IPMSM with Adoptive Leaning Fuzzy-Neural Network (적응학습 퍼지-신경회로망에 의한 IPMSM의 최대토크 제어)

  • Chung, Dong-Hwa;Ko, Jae-Sub;Choi, Jung-Sik
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.21 no.5
    • /
    • pp.32-43
    • /
    • 2007
  • Interior permanent magnet synchronous motor(IPMSM) has become a popular choice in electric vehicle applications, due to their excellent power to weight ratio. This paper proposes maximum torque control of IPMSM drive using adaptive learning fuzzy neural network and artificial neural network. This control method is applicable over the entire speed range which considered the limits of the inverter's current and voltage rated value. This paper proposes speed control of IPMSM using adaptive learning fuzzy neural network and estimation of speed using artificial neural network. The back propagation neural network technique is used to provide a real time adaptive estimation of the motor speed. The proposed control algorithm is applied to IPMSM drive system controlled adaptive learning fuzzy neural network and artificial neural network, the operating characteristics controlled by maximum torque control are examined in detail. Also, this paper proposes the analysis results to verify the effectiveness of the adaptive learning fuzzy neural network and artificial neural network.

A Self-Learning based Adaptive Clustering in a Wireless Internet Proxy Server Environment (무선 인터넷 프록시 서버 환경에서 자체 학습 기반의 적응적 클러스터렁)

  • Kwak Hu-Keun;Chung Kyu-Sik
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.33 no.7
    • /
    • pp.399-412
    • /
    • 2006
  • A clustering based wireless internet proxy server with cooperative caching has a problem of minimizing overall performance because some servers become overloaded if client request pattern is Hot-Spot or uneven. We propose a self-learning based adaptive clustering scheme to solve the poor performance problems of the existing clustering in case of Hot-Spot or uneven client request pattern. In the proposed scheme, requests are dynamically redistributed to the other servers if some servers supposed to handle the requests become overloaded. This is done by a self-learning based method based dynamic weight adjustment algorithm so that it can be applied to a situation with even various request pattern or a cluster of hosts with different performance. We performed experiments in a clustering environment with 16 PCs and a load balancer. Experimental results show the 54.62% performance improvement of the proposed schemes compared to the existing schemes.

The effects of Quibitang on an Animal Model of Depression induced by Chronic Mild Stress (Chronic Mild Stress로 유발(誘發)된 우울증(憂鬱症) 모델 흰쥐에 대한 귀비탕(歸脾湯)의 실험적(實驗的) 연구(硏究))

  • Kim Jong-Woo;Whang Wei-Wan;Kwak So-Young;Kim Min-Jung;Park Eun-Hye;Lee Jeong-A
    • Journal of Oriental Neuropsychiatry
    • /
    • v.12 no.1
    • /
    • pp.123-135
    • /
    • 2001
  • Objective: This study was designed to assess antidepressant effects of Quibitang on an Animal Model of Depression induced by Chronic Mild Stress. Method: The consumption of 1% sucrose solution and active avoidance learning test were used to evaluate antidepressant effect of Quibitang. The consumption of 1% sucrose solution was measured every week for 8 weeks, and active avoidance learning test was executed after 4 weeks treatment of saline or Quibitang. Result: 1. The consumption of 1% sucrose solution was significantly reversed in test group (Quibitang-treated group) at 5th, 7th, 8th weeks, but there was no significant change in control group. 2. Chronic Mild Stress was found to suppress the increase of body weight at 5th, 6th, 7th, 8th weeks. Treatment of Quibitang did not enhanced the body weigt, but it enhanced the consumption of sucrose solution. 3. In order to measure the learning ability of rat which drived to be depressed, we executed active avoidance test. The result revealed that depressed rat showed impaired acquisition than control group, and the treatment of Quibitang restored the learning activity. Conclusion: These results suggest that Quibitang may have antidepressant effects on depression induced by chronic mild stress.

  • PDF

Application and Performance Analysis of Double Pruning Method for Deep Neural Networks (심층신경망의 더블 프루닝 기법의 적용 및 성능 분석에 관한 연구)

  • Lee, Seon-Woo;Yang, Ho-Jun;Oh, Seung-Yeon;Lee, Mun-Hyung;Kwon, Jang-Woo
    • Journal of Convergence for Information Technology
    • /
    • v.10 no.8
    • /
    • pp.23-34
    • /
    • 2020
  • Recently, the artificial intelligence deep learning field has been hard to commercialize due to the high computing power and the price problem of computing resources. In this paper, we apply a double pruning techniques to evaluate the performance of the in-depth neural network and various datasets. Double pruning combines basic Network-slimming and Parameter-prunning. Our proposed technique has the advantage of reducing the parameters that are not important to the existing learning and improving the speed without compromising the learning accuracy. After training various datasets, the pruning ratio was increased to reduce the size of the model.We confirmed that MobileNet-V3 showed the highest performance as a result of NetScore performance analysis. We confirmed that the performance after pruning was the highest in MobileNet-V3 consisting of depthwise seperable convolution neural networks in the Cifar 10 dataset, and VGGNet and ResNet in traditional convolutional neural networks also increased significantly.

An Efficient Deep Learning Ensemble Using a Distribution of Label Embedding

  • Park, Saerom
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.1
    • /
    • pp.27-35
    • /
    • 2021
  • In this paper, we propose a new stacking ensemble framework for deep learning models which reflects the distribution of label embeddings. Our ensemble framework consists of two phases: training the baseline deep learning classifier, and training the sub-classifiers based on the clustering results of label embeddings. Our framework aims to divide a multi-class classification problem into small sub-problems based on the clustering results. The clustering is conducted on the label embeddings obtained from the weight of the last layer of the baseline classifier. After clustering, sub-classifiers are constructed to classify the sub-classes in each cluster. From the experimental results, we found that the label embeddings well reflect the relationships between classification labels, and our ensemble framework can improve the classification performance on a CIFAR 100 dataset.