• Title/Summary/Keyword: 데이터 불확실성

Search Result 494, Processing Time 0.026 seconds

Analysis on Adequacy of the Satellite Soil Moisture Data (AMSR2, ASCAT, and ESACCI) in Korean Peninsula: With Classification of Freezing and Melting Periods (인공위성 기반 토양 수분 자료들(AMSR2, ASCAT, and ESACCI)의 한반도 적절성 분석: 동결과 융해 기간을 구분하여)

  • Baik, Jongjin;Cho, Seongkeun;Lee, Seulchan;Choi, Minha
    • Korean Journal of Remote Sensing
    • /
    • v.35 no.5_1
    • /
    • pp.625-636
    • /
    • 2019
  • Soil moisture is a representative factor that plays a key role in hydrological cycle. It is involved in the interaction between atmosphere and land surface, and is used in fields such as agriculture and water resources. Advanced Microwave Scanning Radiometer 2 (AMSR2), Advanced SCATterometer (ASCAT), and European Space Agency Climate Change Initiative (ESACCI) data were used to analyze the applicability and uncertainty of satellite soil moisture product in the Korean peninsula. Cumulative distribution function (CDF) matching and triple collocation (TC) analysis were carried out to investigate uncertainty and correction of satellite soil moisture data. Comparisons of pre-calibration satellite soil moisture data with the Automated Agriculture Observing System (AAOS) indicated that ESACCI and ASCAT data reflect the trend of AAOS well. On the other hand, AMSR2 satellite data showed overestimated values during the freezing period. Correction of satellite soil moisture data using CDF matching improved the error and correlation compared to those before correction. Finally, uncertainty analysis of soil moisture was carried out using TC method. Clearly, the uncertainty of the satellite soil moisture, corrected by CDF matching, was diminished in both freezing and thawing periods. Overall, it is expected that using ASCAT and ESACCI rather than AMSR2 soil moisture data will give more accurate soil moisture information when correction is performed on the Korean peninsula.

Analysis of the Uncertainty of Compressive Forces Acting on the Patella by Using Multi-Body Modeling and Muscle Mechanics (다물체 모델링과 근의 특성을 이용한 무릎뼈에 가해지는 압력의 불확실성 추정 연구)

  • NamGoong, Hong;Yoo, Hong-Hee
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.35 no.7
    • /
    • pp.785-790
    • /
    • 2011
  • The goal of this study is to estimate the force acting on the knee joint in the human body by using the Hilltype muscle model based on a musculoskeletal model of the human lower extremity in the sagittal plane. For estimating the force applied, the human leg is modeled using multi-body modeling. This leg model comprises biarticular muscles acting on two joints of the upper and lower limbs, and the muscles include some of the major muscles such as the hamstring. In order to analyze the uncertainty of the applied forces acting on the knee joint, statistical distributions of human body, leg part, parameters are required and to obtain the parameter's statistical characteristic of the part sample survey method is employed. Finally, by using the sensitivity information of the parameters, the force acting on the knee joint can be estimated.

Improving Dialogue Intent Classification Performance with Uncertainty Quantification based OOD Detection (불확실성 정량화 기반 OOD 검출을 통한 대화 의도 분류 모델의 성능 향상)

  • Jong-Hun Shin;Yohan Lee;Oh-Woog Kwon;Young-Kil Kim
    • Annual Conference on Human and Language Technology
    • /
    • 2022.10a
    • /
    • pp.517-520
    • /
    • 2022
  • 지능형 대화 시스템은 줄곧 서비스의 목표와 무관한 사용자 입력을 전달받아, 그 처리 성능을 의심받는다. 특히 종단간 대화 이해 생성 모델이나, 기계학습 기반 대화 이해 모델은 학습 시간대에 한정된 범위의 도메인 입력에만 노출됨으로, 사용자 발화를 자신이 처리 가능한 도메인으로 과신하는 경향이 있다. 본 연구에서는 대화 생성 모델이 처리할 수 없는 입력과 신뢰도가 낮은 생성 결과를 배제하기 위해 불확실성 정량화 기법을 대화 의도 분류 모델에 적용한다. 여러 번의 추론 샘플링이 필요 없는 실용적인 예측 신뢰도 획득 방법과 함께, 평가 시간대와 또다른 도메인으로 구성된 분포 외 입력 데이터를 학습에 노출시키는 것이 분포 외 입력을 구분하는데 도움이 되는지를 실험으로 확인한다.

  • PDF

Uncertainty Improvement of Incomplete Decision System using Bayesian Conditional Information Entropy (베이지언 정보엔트로피에 의한 불완전 의사결정 시스템의 불확실성 향상)

  • Choi, Gyoo-Seok;Park, In-Kyu
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.14 no.6
    • /
    • pp.47-54
    • /
    • 2014
  • Based on the indiscernible relation of rough set, the inevitability of superposition and inconsistency of data makes the reduction of attributes very important in information system. Rough set has difficulty in the difference of attribute reduction between consistent and inconsistent information system. In this paper, we propose the new uncertainty measure and attribute reduction algorithm by Bayesian posterior probability for correlation analysis between condition and decision attributes. We compare the proposed method and the conditional information entropy to address the uncertainty of inconsistent information system. As the result, our method has more accuracy than conditional information entropy in dealing with uncertainty via mutual information of condition and decision attributes of information system.

COVID-19 Korean Fake News Detection using Named Entity and User Reproliferation Information (개체명 및 사용자 재확산 정보를 이용한 한국어 COVID-19 가짜 뉴스 검출)

  • Park, Chaewon;Kang, Jiwon;Lee, Daeun;Lee, Munyoung;Han, Jinyoung
    • Annual Conference on Human and Language Technology
    • /
    • 2021.10a
    • /
    • pp.85-90
    • /
    • 2021
  • 코로나바이러스감염증-19로 인한 팬데믹 상황이 지속되면서 감염증 정보의 불확실성으로 인해 코로나 관련 루머가 온라인상에서 빠르게 전파되고 있다. 이러한 코로나 관련 가짜 뉴스를 사전에 탐지하기 위해, 본 연구에서는 한국어 코로나 가짜 뉴스 데이터셋을 구축하고, 개체명과 사용자 재확산 정보를 이용한 한국어 가짜 뉴스 탐지 모델을 제안한다. 가짜 뉴스 팩트체킹 언론인 서울대팩트체크센터에서 코로나 관련 루머 및 가짜 뉴스에 대한 검증 기사를 수집한 후, 기사로부터 개체명 추출 모델을 통해 주제 키워드를 추출하고, 이를 이용해 유튜브 상의 사용자 재확산 정보를 수집하여 데이터셋을 구성하였다. BERT 기반의 제안 모델을 다양한 비교군과 비교하였고, 특성 조합에 따른 실험을 통해 각 특성 정보(기사 텍스트, 개체명 데이터, 유튜브 데이터)가 가짜 뉴스 탐지 성능에 미치는 영향을 알아보았다.

  • PDF

Real-time private consumption prediction using big data (빅데이터를 이용한 실시간 민간소비 예측)

  • Seung Jun Shin;Beomseok Seo
    • The Korean Journal of Applied Statistics
    • /
    • v.37 no.1
    • /
    • pp.13-38
    • /
    • 2024
  • As economic uncertainties have increased recently due to COVID-19, there is a growing need to quickly grasp private consumption trends that directly reflect the economic situation of private economic entities. This study proposes a method of estimating private consumption in real-time by comprehensively utilizing big data as well as existing macroeconomic indicators. In particular, it is intended to improve the accuracy of private consumption estimation by comparing and analyzing various machine learning methods that are capable of fitting ultra-high-dimensional big data. As a result of the empirical analysis, it has been demonstrated that when the number of covariates including big data is large, variables can be selected in advance and used for model fit to improve private consumption prediction performance. In addition, as the inclusion of big data greatly improves the predictive performance of private consumption after COVID-19, the benefit of big data that reflects new information in a timely manner has been shown to increase when economic uncertainty is high.

Visual Analytics Approach for Performance Improvement of predicting youth physical growth model (청소년 신체 성장 예측 모델의 성능 향상을 위한 시각적 분석 방법)

  • Yeon, Hanbyul;Pi, Mingyu;Seo, Seongbum;Ha, Seoho;Oh, Byungjun;Jang, Yun
    • Journal of the Korea Computer Graphics Society
    • /
    • v.23 no.4
    • /
    • pp.21-29
    • /
    • 2017
  • Previous visual analytics researches has focused on reducing the uncertainty of predicted results using a variety of interactive visual data exploration techniques. The main purpose of the interactive search technique is to reduce the quality difference of the predicted results according to the level of the decision maker by understanding the relationship between the variables and choosing the appropriate model to predict the unknown variables. However, it is difficult to create a predictive model which forecast time series data whose overall trends is unknown such as youth physical growth data. In this paper, we pro pose a novel predictive analysis technique to forecast the physical growth value in small pieces of time series data with un certain trends. This model estimates the distribution of data at a particular point in time. We also propose a visual analytics system that minimizes the possible uncertainties in predictive modeling process.

Decision Analysis System for Job Guidance using Rough Set (러프집합을 통한 취업의사결정 분석시스템)

  • Lee, Heui-Tae;Park, In-Kyoo
    • Journal of Digital Convergence
    • /
    • v.11 no.10
    • /
    • pp.387-394
    • /
    • 2013
  • Data mining is the process of discovering hidden, non-trivial patterns in large amounts of data records in order to be used very effectively for analysis and forecasting. Because hundreds of variables give rise to a high level of redundancy and dimensionality with time complexity, they are more likely to have spurious relationships, and even the weakest relationships will be highly significant by any statistical test. Hence cluster analysis is a main task of data mining and is the task of grouping a set of objects in such a way that objects in the same group are more similar to each other than to those in other groups. In this paper system implementation is of great significance, which defines a new definition based on information-theoretic entropy and analyse the analogue behaviors of objects at hand so as to address the measurement of uncertainties in the classification of categorical data. The sources were taken from a survey aimed to identify of job guidance from students in high school pyeongtaek. we show how variable precision information-entropy based rough set can be used to group student in each section. It is proved that the proposed method has the more exact classification than the conventional in attributes more than 10 and that is more effective in job guidance for students.

A Fuzzy Clustering Algorithm for Clustering Categorical Data (범주형 데이터의 분류를 위한 퍼지 군집화 기법)

  • 김대원;이광형
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2003.09b
    • /
    • pp.63-66
    • /
    • 2003
  • 본 논문에서는 범주형(categorical) 데이터의 분류를 위한 새로운 기법을 제시한다. 기존의 대표적인 퍼지 군집화 방법인 fuzzy k-modes 알고리즘은 군집 (cluster)의 중심을 단일값으로 표현한 반면, 제안하는 기법에서는 이를 퍼지값으로 정의한다. 이와 같은 퍼지 중심 표현기법을 도입함으로써 범주형 데이터의 분류시에 발생하는 불확실성을 최소화할 수 있다. 기존의 대표적인 방법들과의 비교실험으로 통해 제안한 방법의 성능을 검증하였다.

  • PDF

Seismic Fragility of I-Shape Curved Steel Girder Bridge using Machine Learning Method (머신러닝 기반 I형 곡선 거더 단경간 교량 지진 취약도 분석)

  • Juntai Jeon;Bu-Seog Ju;Ho-Young Son
    • Journal of the Society of Disaster Information
    • /
    • v.18 no.4
    • /
    • pp.899-907
    • /
    • 2022
  • Purpose: Although many studies on seismic fragility analysis of general bridges have been conducted using machine learning methods, studies on curved bridge structures are insignificant. Therefore, the purpose of this study is to analyze the seismic fragility of bridges with I-shaped curved girders based on the machine learning method considering the material property and geometric uncertainties. Method: Material properties and pier height were considered as uncertainty parameters. Parameters were sampled using the Latin hypercube technique and time history analysis was performed considering the seismic uncertainty. Machine learning data was created by applying artificial neural network and response surface analysis method to the original data. Finally, earthquake fragility analysis was performed using original data and learning data. Result: Parameters were sampled using the Latin hypercube technique, and a total of 160 time history analyzes were performed considering the uncertainty of the earthquake. The analysis result and the predicted value obtained through machine learning were compared, and the coefficient of determination was compared to compare the similarity between the two values. The coefficient of determination of the response surface method was 0.737, which was relatively similar to the observed value. The seismic fragility curve also showed that the predicted value through the response surface method was similar to the observed value. Conclusion: In this study, when the observed value through the finite element analysis and the predicted value through the machine learning method were compared, it was found that the response surface method predicted a result similar to the observed value. However, both machine learning methods were found to underestimate the observed values.