• Title/Summary/Keyword: operating characteristic curve

Search Result 577, Processing Time 0.023 seconds

Sentiment Analysis From Images - Comparative Study of SAI-G and SAI-C Models' Performances Using AutoML Vision Service from Google Cloud and Clarifai Platform

  • Marcu, Daniela;Danubianu, Mirela
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.9
    • /
    • pp.179-184
    • /
    • 2021
  • In our study we performed a sentiments analysis from the images. For this purpose, we used 153 images that contain: people, animals, buildings, landscapes, cakes and objects that we divided into two categories: images that suggesting a positive or a negative emotion. In order to classify the images using the two categories, we created two models. The SAI-G model was created with Google's AutoML Vision service. The SAI-C model was created on the Clarifai platform. The data were labeled in a preprocessing stage, and for the SAI-C model we created the concepts POSITIVE (POZITIV) AND NEGATIVE (NEGATIV). In order to evaluate the performances of the two models, we used a series of evaluation metrics such as: Precision, Recall, ROC (Receiver Operating Characteristic) curve, Precision-Recall curve, Confusion Matrix, Accuracy Score and Average precision. Precision and Recall for the SAI-G model is 0.875, at a confidence threshold of 0.5, while for the SAI-C model we obtained much lower scores, respectively Precision = 0.727 and Recall = 0.571 for the same confidence threshold. The results indicate a lower classification performance of the SAI-C model compared to the SAI-G model. The exception is the value of Precision for the POSITIVE concept, which is 1,000.

Cut-Off Values of the Post-Intensive Care Syndrome Questionnaire for the Screening of Unplanned Hospital Readmission within One Year

  • Kang, Jiyeon;Jeong, Yeon Jin;Hong, Jiwon
    • Journal of Korean Academy of Nursing
    • /
    • v.50 no.6
    • /
    • pp.787-798
    • /
    • 2020
  • Purpose: This study aimed to assign weights for subscales and items of the Post-Intensive Care Syndrome questionnaire and suggest optimal cut-off values for screening unplanned hospital readmissions of critical care survivors. Methods: Seventeen experts participated in an analytic hierarchy process for weight assignment. Participants for cut-off analysis were 240 survivors who had been admitted to intensive care units for more than 48 hours in three cities in Korea. We assessed participants using the 18-item Post-Intensive Care Syndrome questionnaire, generated receiver operating characteristic curves, and analysed cut-off values for unplanned readmission based on sensitivity, specificity, and positive likelihood ratios. Results: Cognitive, physical, and mental subscale weights were 1.13, 0.95, and 0.92, respectively. Incidence of unplanned readmission was 25.4%. Optimal cut-off values were 23.00 for raw scores and 23.73 for weighted scores (total score 54.00), with an area of under the curve (AUC) of .933 and .929, respectively. There was no significant difference in accuracy for original and weighted scores. Conclusion: The optimal cut-off value accuracy is excellent for screening of unplanned readmissions. We recommend that nurses use the Post-Intensive Care Syndrome Questionnaire to screen for readmission risk or evaluating relevant interventions for critical care survivors.

Predictive capability of fasting-state glucose and insulin measurements for abnormal glucose tolerance in women with polycystic ovary syndrome

  • Chun, Sungwook
    • Clinical and Experimental Reproductive Medicine
    • /
    • v.48 no.2
    • /
    • pp.156-162
    • /
    • 2021
  • Objective: The aim of the present study was to evaluate the predictive capability of fasting-state measurements of glucose and insulin levels alone for abnormal glucose tolerance in women with polycystic ovary syndrome (PCOS). Methods: In total, 153 Korean women with PCOS were included in this study. The correlations between the 2-hour postload glucose (2-hr PG) level during the 75-g oral glucose tolerance test (OGTT) and other parameters were evaluated using Pearson correlation coefficients and linear regression analysis. The predictive accuracy of fasting glucose and insulin levels and other fasting-state indices for assessing insulin sensitivity derived from glucose and insulin levels for abnormal glucose tolerance was evaluated using receiver operating characteristic (ROC) curve analysis. Results: Significant correlations were observed between the 2-hr PG level and most fasting-state parameters in women with PCOS. However, the area under the ROC curve values for each fasting-state parameter for predicting abnormal glucose tolerance were all between 0.5 and 0.7 in the study participants, which falls into the "less accurate" category for prediction. Conclusion: Fasting-state measurements of glucose and insulin alone are not enough to predict abnormal glucose tolerance in women with PCOS. A standard OGTT is needed to screen for impaired glucose tolerance and type 2 diabetes mellitus in women with PCOS.

Evaluation of maxillary sinusitis from panoramic radiographs and cone-beam computed tomographic images using a convolutional neural network

  • Serindere, Gozde;Bilgili, Ersen;Yesil, Cagri;Ozveren, Neslihan
    • Imaging Science in Dentistry
    • /
    • v.52 no.2
    • /
    • pp.187-195
    • /
    • 2022
  • Purpose: This study developed a convolutional neural network (CNN) model to diagnose maxillary sinusitis on panoramic radiographs(PRs) and cone-beam computed tomographic (CBCT) images and evaluated its performance. Materials and Methods: A CNN model, which is an artificial intelligence method, was utilized. The model was trained and tested by applying 5-fold cross-validation to a dataset of 148 healthy and 148 inflamed sinus images. The CNN model was implemented using the PyTorch library of the Python programming language. A receiver operating characteristic curve was plotted, and the area under the curve, accuracy, sensitivity, specificity, positive predictive value, and negative predictive values for both imaging techniques were calculated to evaluate the model. Results: The average accuracy, sensitivity, and specificity of the model in diagnosing sinusitis from PRs were 75.7%, 75.7%, and 75.7%, respectively. The accuracy, sensitivity, and specificity of the deep-learning system in diagnosing sinusitis from CBCT images were 99.7%, 100%, and 99.3%, respectively. Conclusion: The diagnostic performance of the CNN for maxillary sinusitis from PRs was moderately high, whereas it was clearly higher with CBCT images. Three-dimensional images are accepted as the "gold standard" for diagnosis; therefore, this was not an unexpected result. Based on these results, deep-learning systems could be used as an effective guide in assisting with diagnoses, especially for less experienced practitioners.

Deep Interpretable Learning for a Rapid Response System (긴급대응 시스템을 위한 심층 해석 가능 학습)

  • Nguyen, Trong-Nghia;Vo, Thanh-Hung;Kho, Bo-Gun;Lee, Guee-Sang;Yang, Hyung-Jeong;Kim, Soo-Hyung
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2021.11a
    • /
    • pp.805-807
    • /
    • 2021
  • In-hospital cardiac arrest is a significant problem for medical systems. Although the traditional early warning systems have been widely applied, they still contain many drawbacks, such as the high false warning rate and low sensitivity. This paper proposed a strategy that involves a deep learning approach based on a novel interpretable deep tabular data learning architecture, named TabNet, for the Rapid Response System. This study has been processed and validated on a dataset collected from two hospitals of Chonnam National University, Korea, in over 10 years. The learning metrics used for the experiment are the area under the receiver operating characteristic curve score (AUROC) and the area under the precision-recall curve score (AUPRC). The experiment on a large real-time dataset shows that our method improves compared to other machine learning-based approaches.

Prediction of karst sinkhole collapse using a decision-tree (DT) classifier

  • Boo Hyun Nam;Kyungwon Park;Yong Je Kim
    • Geomechanics and Engineering
    • /
    • v.36 no.5
    • /
    • pp.441-453
    • /
    • 2024
  • Sinkhole subsidence and collapse is a common geohazard often formed in karst areas such as the state of Florida, United States of America. To predict the sinkhole occurrence, we need to understand the formation mechanism of sinkhole and its karst hydrogeology. For this purpose, investigating the factors affecting sinkholes is an essential and important step. The main objectives of the presenting study are (1) the development of a machine learning (ML)-based model, namely C5.0 decision tree (C5.0 DT), for the prediction of sinkhole susceptibility, which accounts for sinkhole/subsidence inventory and sinkhole contributing factors (e.g., geological/hydrogeological) and (2) the construction of a regional-scale sinkhole susceptibility map. The study area is east central Florida (ECF) where a cover-collapse type is commonly reported. The C5.0 DT algorithm was used to account for twelve (12) identified hydrogeological factors. In this study, a total of 1,113 sinkholes in ECF were identified and the dataset was then randomly divided into 70% and 30% subsets for training and testing, respectively. The performance of the sinkhole susceptibility model was evaluated using a receiver operating characteristic (ROC) curve, particularly the area under the curve (AUC). The C5.0 model showed a high prediction accuracy of 83.52%. It is concluded that a decision tree is a promising tool and classifier for spatial prediction of karst sinkholes and subsidence in the ECF area.

The Cut Off Values for Diagnosing Cold Hypersensitivity of Hands by Using Digital Infrared Thermographic Imaging (적외선 체열 촬영을 이용한 수부냉증 진단의 절단값 산정)

  • Jo, Jun-Young;Park, Kyoung-Sun;Lee, Chang-Hoon;Jang, Jun-Bock;Lee, Kyung-Sub;Lee, Jin-Moo
    • The Journal of Korean Obstetrics and Gynecology
    • /
    • v.25 no.3
    • /
    • pp.95-102
    • /
    • 2012
  • Purpose: The purpose of this study is to define the cut off values of cold hypersensitivity of hands by using digital infrared thermographic imaging(DITI). Methods: Thermographic images of 130 patients with cold hypersensitivity of hands(CHHG, n=65) and non-cold hypersensitivity of hands(NCHHG, n=65) were retrospectively reviewed. We used the temperature difference the palm(PC8) and the upper arm(LU4) for diagnosing cold hypersensitivity of hands. The temperature differences of between two groups were analysed using independent samples t-tests. The cut off values were calculated by ROC curve analysis. Analyses were undertaken using SPSS version 17.0. P value of < 0.05 was considered significant. Results: The temperature difference the palm(PC8) and the upper arm(LU4) were significantly different between groups(p < 0.001). Using receiver operating characteristic curve analysis, the sensitivity, specificity, and area under the curve were 70.8%, 73.8%, respectively both hands. The AUC was 0.822 on right hand and 0.818 on left hand. The optimum cut-off value was defined as $-0.05^{\circ}C$. Conclusions: These results suggest that DITI is a reliable instrument for estimating the cold hypersensitivity of hands.

Multivariate Outlier Removing for the Risk Prediction of Gas Leakage based Methane Gas (메탄 가스 기반 가스 누출 위험 예측을 위한 다변량 특이치 제거)

  • Dashdondov, Khongorzul;Kim, Mi-Hye
    • Journal of the Korea Convergence Society
    • /
    • v.11 no.12
    • /
    • pp.23-30
    • /
    • 2020
  • In this study, the relationship between natural gas (NG) data and gas-related environmental elements was performed using machine learning algorithms to predict the level of gas leakage risk without directly measuring gas leakage data. The study was based on open data provided by the server using the IoT-based remote control Picarro gas sensor specification. The naturel gas leaks into the air, it is a big problem for air pollution, environment and the health. The proposed method is multivariate outlier removing method based Random Forest (RF) classification for predicting risk of NG leak. After, unsupervised k-means clustering, the experimental dataset has done imbalanced data. Therefore, we focusing our proposed models can predict medium and high risk so best. In this case, we compared the receiver operating characteristic (ROC) curve, accuracy, area under the ROC curve (AUC), and mean standard error (MSE) for each classification model. As a result of our experiments, the evaluation measurements include accuracy, area under the ROC curve (AUC), and MSE; 99.71%, 99.57%, and 0.0016 for MOL_RF respectively.

Life Risk Assessment of Landslide Disaster in Jinbu Area Using Logistic Regression Model (로지스틱 회귀분석모델을 활용한 평창군 진부 지역의 산사태 재해의 인명 위험 평가)

  • Rahnuma, Bintae Rashid Urmi;Al, Mamun;Jang, Dong-Ho
    • Journal of The Geomorphological Association of Korea
    • /
    • v.27 no.2
    • /
    • pp.65-80
    • /
    • 2020
  • This paper deals with risk assessment of life in a landslide-prone area by a GIS-based modeling method. Landslide susceptibility maps can provide a probability of landslide prone areas to mitigate or proper control this problems and to take any development plan and disaster management. A landslide inventory map of the study area was prepared based on past historical information and aerial photography analysis. A total of 550 landslides have been counted at the whole study area. The extracted landslides were randomly selected and divided into two different groups, 50% of the landslides were used for model calibration and the other were used for validation purpose. Eleven causative factors (continuous and thematic) such as slope, aspect, curvature, topographic wetness index, elevation, forest type, forest crown density, geology, land-use, soil drainage, and soil texture were used in hazard analysis. The correlation between landslides and these factors, pixels were divided into several classes and frequency ratio was also extracted. Eventually, a landslide susceptibility map was constructed using a logistic regression model based on entire events. Moreover, the landslide susceptibility map was plotted with a receiver operating characteristic (ROC) curve and calculated the area under the curve (AUC) and tried to extract a success rate curve. Based on the results, logistic regression produced an 85.18% accuracy, so we believed that the model was reliable and acceptable for the landslide susceptibility analysis on the study area. In addition, for risk assessment, vulnerability scale were added for social thematic data layer. The study area predictive landslide affected pixels 2,000 and 5,000 were also calculated for making a probability table. In final calculation, the 2,000 predictive landslide affected pixels were assumed to run. The total population causalities were estimated as 7.75 person that was relatively close to the actual number published in Korean Annual Disaster Report, 2006.

A Study on the Determination of Starting Head by Comparing The Generating Power in Single Action Tidal Power Plant (발전량 비교를 통한 창조식 조력발전의 기동낙차 결정에 관한 연구)

  • Kim, Hyun-Han;Kim, Kwang-Ho
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.67 no.5
    • /
    • pp.680-687
    • /
    • 2018
  • Because of its predictability of the energy cycle and huge scale power output, the ocean energy from tidal power utilization has always received attention as a great energy source, even though its development cost, including the embankment construction, is so much higher than that of any other energy source. Nevertheless, nowadays many projects are being planned on account of institutional support from the government and the recent advance of construction technology. In Korea, the new industry field operating and managing the tidal power plant has already opened. But we are facing a number of problems for optimal operation of tidal power plant that are a lack of operation experience and a skill of professional management and others. This paper suggests a novel way to determine the starting head of power generation by generating power comparison method For this new method, the paper discusses many factors including changing the volume of the basin, the number of operating turbines and gates and forecasting the tidal amplitude and the characteristic curve of turbine and gate. Finally we verified that it can increase about 2% an annual power generation compared with the conventional method using the original operational function made in the plant design process.