• 제목/요약/키워드: Large language models

검색결과 155건 처리시간 0.02초

Diagnostic Value of Fluorescence in Situ Hybridization Assay in Malignant Mesothelioma: A Meta-analysis

  • Wan, Chun;Shen, Yong-Chun;Liu, Meng-Qi;Yang, Ting;Wang, Tao;Chen, Lei;Yi, Qun;Wen, Fu-Qiang
    • Asian Pacific Journal of Cancer Prevention
    • /
    • 제13권9호
    • /
    • pp.4745-4749
    • /
    • 2012
  • The diagnosis of malignant mesothelioma (MM) remains a clinical challenge and the fluorescence in situ hybridization (FISH) assay has been reported to be one promising tool. The present meta-analysis aimed to establish the overall diagnostic accuracy of FISH for diagnosing MM. After a systematic review of English language studies, the sensitivity, specificity and other measures of accuracy of FISH in the diagnosis of MM were pooled using random-effects models. Summary receiver operating characteristic curves were applied to summarize overall test performance. Nine studies met our inclusion criteria, the pooled sensitivity and specificity for FISH for diagnosing MM being 0.72 (95% CI 0.67-0.76) and 1.00 (95% CI 0.98-1.00), respectively. The positive likelihood ratio was 34.5 (95% CI 14.5-82.10), the negative likelihood ratio was 0.24 (95% CI 0.16-0.36), and the diagnostic odds ratio was 204.9 (95% CI 76.8-546.6), the area under the curve being 0.99. Our data suggest that the FISH assay is likely to be a useful diagnostic tool for confirming MM. However, considering the limited studies and patients included, further large scale studies are needed to confirm these findings.

Performance of ChatGPT on the Korean National Examination for Dental Hygienists

  • Soo-Myoung Bae;Hye-Rim Jeon;Gyoung-Nam Kim;Seon-Hui Kwak;Hyo-Jin Lee
    • 치위생과학회지
    • /
    • 제24권1호
    • /
    • pp.62-70
    • /
    • 2024
  • Background: This study aimed to evaluate ChatGPT's performance accuracy in responding to questions from the national dental hygienist examination. Moreover, through an analysis of ChatGPT's incorrect responses, this research intended to pinpoint the predominant types of errors. Methods: To evaluate ChatGPT-3.5's performance according to the type of national examination questions, the researchers classified 200 questions of the 49th National Dental Hygienist Examination into recall, interpretation, and solving type questions. The researchers strategically modified the questions to counteract potential misunderstandings from implied meanings or technical terminology in Korea. To assess ChatGPT-3.5's problem-solving capabilities in applying previously acquired knowledge, the questions were first converted to subjective type. If ChatGPT-3.5 generated an incorrect response, an original multiple-choice framework was provided again. Two hundred questions were input into ChatGPT-3.5 and the generated responses were analyzed. After using ChatGPT, the accuracy of each response was evaluated by researchers according to the types of questions, and the types of incorrect responses were categorized (logical, information, and statistical errors). Finally, hallucination was evaluated when ChatGPT provided misleading information by answering something that was not true as if it were true. Results: ChatGPT's responses to the national examination were 45.5% accurate. Accuracy by question type was 60.3% for recall and 13.0% for problem-solving type questions. The accuracy rate for the subjective solving questions was 13.0%, while the accuracy for the objective questions increased to 43.5%. The most common types of incorrect responses were logical errors 65.1% of all. Of the total 102 incorrectly answered questions, 100 were categorized as hallucinations. Conclusion: ChatGPT-3.5 was found to be limited in its ability to provide evidence-based correct responses to the Korean national dental hygiene examination. Therefore, dental hygienists in the education or clinical fields should be careful to use artificial intelligence-generated materials with a critical view.

협업적 추천 기반의 여행 계획 시스템 (Multi-day Trip Planning System with Collaborative Recommendation)

  • 프리스카;오경진;홍명덕;가명현;조근식
    • 지능정보연구
    • /
    • 제22권1호
    • /
    • pp.159-185
    • /
    • 2016
  • 여행을 계획하는 일은 매우 복잡하고 많은 시간을 필요로 한다. 여행 계획을 정할 때에는 보통 관심 지점(point of interests, POIs)을 선택하고 그에 따른 다양한 제약 조건들을 고려하여 일정을 계획 한다. 관심 지점을 선정할 때 친구들에게 의견을 묻거나 인터넷에서 직접 정보를 찾으며 여행사의 도움을 받기도 한다. 하지만 이러한 방법들은 다음과 같은 어려움이 있다. 친구들에게 의견을 묻는 경우에는 친구들이 방문해 보지 못한 장소에 대한 정보를 얻기 어렵고 인터넷에서 정보를 찾는 경우에는 오히려 너무 많은 여행 정보들 때문에 필요한 정보를 탐색하고 정리하는데 많은 시간이 필요하며 여행사의 도움을 받을 때에는 여행 일정이 여행을 제공해주는 업체들 쪽으로 편중될 우려가 있다. 이러한 문제를 해결하기 위해 본 논문에서는 여행 일정 계획 시스템인 CYTRIP을 제안한다. CYTRIP은 웹 기반의 추천 시스템으로써, 여행 정보를 공유할 수 있는 공간을 제공하고, 이를 통해 참여자들의 집단 지성에 따른 관심 지점을 추천 받는다. 그리고 PDDL3를 통해 추천된 지점들의 시간적, 공간적 제약조건 따라 여행 일정이 자동으로 생성되며 이렇게 생성된 일정은 지도 위에 표시되어 사용자에게 제공된다. 여행을 계획할 때에 정해진 기간 동안 모든 추천 관심지점을 방문할 수 없는 경우가 발생한다. 이러한 문제를 피하기 위해 정해진 시간에 방문 가능한 관심 지점들의 후보 집합을 선택하고 이 후보 집합들에 대한 여행 일정을 생성한다. 제안하는 시스템의 성능평가를 위해 사용자 평가를 실시하였다. 사용자 평가를 위해 한국관광공사에서 제공하는 데이터를 활용하였고 평가 결과 제안하는 시스템이 여러 참여자들의 집단 지성을 통해 여행 일정을 계획하는데 유용하다는 것을 알 수 있었다.

기업의 SNS 노출과 주식 수익률간의 관계 분석 (The Analysis on the Relationship between Firms' Exposures to SNS and Stock Prices in Korea)

  • 김태환;정우진;이상용
    • Asia pacific journal of information systems
    • /
    • 제24권2호
    • /
    • pp.233-253
    • /
    • 2014
  • Can the stock market really be predicted? Stock market prediction has attracted much attention from many fields including business, economics, statistics, and mathematics. Early research on stock market prediction was based on random walk theory (RWT) and the efficient market hypothesis (EMH). According to the EMH, stock market are largely driven by new information rather than present and past prices. Since it is unpredictable, stock market will follow a random walk. Even though these theories, Schumaker [2010] asserted that people keep trying to predict the stock market by using artificial intelligence, statistical estimates, and mathematical models. Mathematical approaches include Percolation Methods, Log-Periodic Oscillations and Wavelet Transforms to model future prices. Examples of artificial intelligence approaches that deals with optimization and machine learning are Genetic Algorithms, Support Vector Machines (SVM) and Neural Networks. Statistical approaches typically predicts the future by using past stock market data. Recently, financial engineers have started to predict the stock prices movement pattern by using the SNS data. SNS is the place where peoples opinions and ideas are freely flow and affect others' beliefs on certain things. Through word-of-mouth in SNS, people share product usage experiences, subjective feelings, and commonly accompanying sentiment or mood with others. An increasing number of empirical analyses of sentiment and mood are based on textual collections of public user generated data on the web. The Opinion mining is one domain of the data mining fields extracting public opinions exposed in SNS by utilizing data mining. There have been many studies on the issues of opinion mining from Web sources such as product reviews, forum posts and blogs. In relation to this literatures, we are trying to understand the effects of SNS exposures of firms on stock prices in Korea. Similarly to Bollen et al. [2011], we empirically analyze the impact of SNS exposures on stock return rates. We use Social Metrics by Daum Soft, an SNS big data analysis company in Korea. Social Metrics provides trends and public opinions in Twitter and blogs by using natural language process and analysis tools. It collects the sentences circulated in the Twitter in real time, and breaks down these sentences into the word units and then extracts keywords. In this study, we classify firms' exposures in SNS into two groups: positive and negative. To test the correlation and causation relationship between SNS exposures and stock price returns, we first collect 252 firms' stock prices and KRX100 index in the Korea Stock Exchange (KRX) from May 25, 2012 to September 1, 2012. We also gather the public attitudes (positive, negative) about these firms from Social Metrics over the same period of time. We conduct regression analysis between stock prices and the number of SNS exposures. Having checked the correlation between the two variables, we perform Granger causality test to see the causation direction between the two variables. The research result is that the number of total SNS exposures is positively related with stock market returns. The number of positive mentions of has also positive relationship with stock market returns. Contrarily, the number of negative mentions has negative relationship with stock market returns, but this relationship is statistically not significant. This means that the impact of positive mentions is statistically bigger than the impact of negative mentions. We also investigate whether the impacts are moderated by industry type and firm's size. We find that the SNS exposures impacts are bigger for IT firms than for non-IT firms, and bigger for small sized firms than for large sized firms. The results of Granger causality test shows change of stock price return is caused by SNS exposures, while the causation of the other way round is not significant. Therefore the correlation relationship between SNS exposures and stock prices has uni-direction causality. The more a firm is exposed in SNS, the more is the stock price likely to increase, while stock price changes may not cause more SNS mentions.

뉴럴 텐서 네트워크 기반 주식 개별종목 지식개체명 추출 방법에 관한 연구 (A Study on Knowledge Entity Extraction Method for Individual Stocks Based on Neural Tensor Network)

  • 양윤석;이현준;오경주
    • 지능정보연구
    • /
    • 제25권2호
    • /
    • pp.25-38
    • /
    • 2019
  • 정보화 시대의 넘쳐나는 콘텐츠들 속에서 사용자의 관심과 요구에 맞는 양질의 정보를 선별해내는 과정은 세대를 거듭할수록 더욱 중요해지고 있다. 정보의 홍수 속에서 사용자의 정보 요구를 단순한 문자열로 인식하지 않고, 의미적으로 파악하여 검색결과에 사용자 의도를 더 정확하게 반영하고자 하는 노력이 이루어지고 있다. 구글이나 마이크로소프트와 같은 대형 IT 기업들도 시멘틱 기술을 기반으로 사용자에게 만족도와 편의성을 제공하는 검색엔진 및 지식기반기술의 개발에 집중하고 있다. 특히 금융 분야는 끊임없이 방대한 새로운 정보가 발생하며 초기의 정보일수록 큰 가치를 지녀 텍스트 데이터 분석과 관련된 연구의 효용성과 발전 가능성이 기대되는 분야 중 하나이다. 따라서, 본 연구는 주식 관련 정보검색의 시멘틱 성능을 향상시키기 위해 주식 개별종목을 대상으로 뉴럴 텐서 네트워크를 활용한 지식 개체명 추출과 이에 대한 성능평가를 시도하고자 한다. 뉴럴 텐서 네트워크 관련 기존 주요 연구들이 추론을 통해 지식 개체명들 사이의 관계 탐색을 주로 목표로 하였다면, 본 연구는 주식 개별종목과 관련이 있는 지식 개체명 자체의 추출을 주목적으로 한다. 기존 관련 연구의 문제점들을 해결하고 모형의 실효성과 현실성을 높이기 위한 다양한 데이터 처리 방법이 모형설계 과정에서 적용되며, 객관적인 성능 평가를 위한 실증 분석 결과와 분석 내용을 제시한다. 2017년 5월 30일부터 2018년 5월 21일 사이에 발생한 전문가 리포트를 대상으로 실증 분석을 진행한 결과, 제시된 모형을 통해 추출된 개체명들은 개별종목이 이름을 약 69% 정확도로 예측하였다. 이러한 결과는 본 연구에서 제시하는 모형의 활용 가능성을 보여주고 있으며, 후속 연구와 모형 개선을 통한 성과의 제고가 가능하다는 것을 의미한다. 마지막으로 종목명 예측 테스트를 통해 본 연구에서 제시한 학습 방법이 새로운 텍스트 정보를 의미적으로 접근하여 관련주식 종목과 매칭시키는 목적으로 사용될 수 있는 가능성을 확인하였다.