• Title/Summary/Keyword: Stochastic Gradient descent

Search Result 42, Processing Time 0.02 seconds

Application of Text-Classification Based Machine Learning in Predicting Psychiatric Diagnosis (텍스트 분류 기반 기계학습의 정신과 진단 예측 적용)

  • Pak, Doohyun;Hwang, Mingyu;Lee, Minji;Woo, Sung-Il;Hahn, Sang-Woo;Lee, Yeon Jung;Hwang, Jaeuk
    • Korean Journal of Biological Psychiatry
    • /
    • v.27 no.1
    • /
    • pp.18-26
    • /
    • 2020
  • Objectives The aim was to find effective vectorization and classification models to predict a psychiatric diagnosis from text-based medical records. Methods Electronic medical records (n = 494) of present illness were collected retrospectively in inpatient admission notes with three diagnoses of major depressive disorder, type 1 bipolar disorder, and schizophrenia. Data were split into 400 training data and 94 independent validation data. Data were vectorized by two different models such as term frequency-inverse document frequency (TF-IDF) and Doc2vec. Machine learning models for classification including stochastic gradient descent, logistic regression, support vector classification, and deep learning (DL) were applied to predict three psychiatric diagnoses. Five-fold cross-validation was used to find an effective model. Metrics such as accuracy, precision, recall, and F1-score were measured for comparison between the models. Results Five-fold cross-validation in training data showed DL model with Doc2vec was the most effective model to predict the diagnosis (accuracy = 0.87, F1-score = 0.87). However, these metrics have been reduced in independent test data set with final working DL models (accuracy = 0.79, F1-score = 0.79), while the model of logistic regression and support vector machine with Doc2vec showed slightly better performance (accuracy = 0.80, F1-score = 0.80) than the DL models with Doc2vec and others with TF-IDF. Conclusions The current results suggest that the vectorization may have more impact on the performance of classification than the machine learning model. However, data set had a number of limitations including small sample size, imbalance among the category, and its generalizability. With this regard, the need for research with multi-sites and large samples is suggested to improve the machine learning models.

Numerical Study of SPGD-based Phase Control of Coherent Beam Combining under Various Turbulent Atmospheric Conditions (대기외란에 따른 SPGD 기반 결맞음 빔결합 시스템 위상제어 동작성능 분석)

  • Kim, Hansol;Na, Jeongkyun;Jeong, Yoonchan
    • Korean Journal of Optics and Photonics
    • /
    • v.31 no.6
    • /
    • pp.247-258
    • /
    • 2020
  • In this paper, based on a stochastic parallel gradient descent (SPGD) algorithm we study phase control of a coherent-beam-combining system under turbulent atmospheric conditions. Based on the statistical theory of atmospheric turbulence, we carry out the analysis of the phase and wavefront distortion of a laser beam propagating through a turbulent atmospheric medium. We also conduct numerical simulations of a coherent-beam-combining system with 7- and 19-channel laser beams distorted by atmospheric turbulence. Through numerical simulations, we characterize the phase-control characteristics and efficiency of the coherent-beam-combining system under various degrees of atmospheric turbulence. It is verified that the SPGD algorithm is capable of realizing 7-channel coherent beam combining with a beam-combining efficiency of more than 90%, even under the turbulent atmospheric conditions up to cn2 of 10-13 m-2/3. In the case of 19-channel coherent beam combining, it is shown that the same turbulent atmospheric conditions result in a drastic reduction of the beam-combining efficiency down to 60%, due to the elevated impact of the corresponding refractive-index inhomogeneity. In addition, by putting together the number of iterations of the SPGD algorithm required for phase locking under atmospheric turbulence and the time intervals of atmospheric phenomena, which typically are of the order of ㎲, it is estimated that hundreds of MHz to a few GHz of computing bandwidth of SPGD-based phase control may be required for a coherent-beam-combining system to confront such turbulent atmospheric conditions. We expect the results of this paper to be useful for quantitatively analyzing and predicting the effects of atmospheric turbulence on the SPGD-based phase-control performance of a coherent-beam-combining system.