• Title/Summary/Keyword: CLS

Search Result 146, Processing Time 0.032 seconds

Text Classification using Cloze Question based on KorBERT (KorBERT 기반 빈칸채우기 문제를 이용한 텍스트 분류)

  • Heo, Jeong;Lee, Hyung-Jik;Lim, Joon-Ho
    • Annual Conference on Human and Language Technology
    • /
    • 2021.10a
    • /
    • pp.486-489
    • /
    • 2021
  • 본 논문에서는 KorBERT 한국어 언어모델에 기반하여 텍스트 분류문제를 빈칸채우기 문제로 변환하고 빈칸에 적합한 어휘를 예측하는 방식의 프롬프트기반 분류모델에 대해서 소개한다. [CLS] 토큰을 이용한 헤드기반 분류와 프롬프트기반 분류는 사전학습의 NSP모델과 MLM모델의 특성을 반영한 것으로, 텍스트의 의미/구조적 분석과 의미적 추론으로 구분되는 텍스트 분류 태스크에서의 성능을 비교 평가하였다. 의미/구조적 분석 실험을 위해 KLUE의 의미유사도와 토픽분류 데이터셋을 이용하였고, 의미적 추론 실험을 위해서 KLUE의 자연어추론 데이터셋을 이용하였다. 실험을 통해, MLM모델의 특성을 반영한 프롬프트기반 텍스트 분류에서는 의미유사도와 토픽분류 태스크에서 우수한 성능을 보였고, NSP모델의 특성을 반영한 헤드기반 텍스트 분류에서는 자연어추론 태스크에서 우수한 성능을 보였다.

  • PDF

Aspect-Based Sentiment Analysis Using BERT: Developing Aspect Category Sentiment Classification Models (BERT를 활용한 속성기반 감성분석: 속성카테고리 감성분류 모델 개발)

  • Park, Hyun-jung;Shin, Kyung-shik
    • Journal of Intelligence and Information Systems
    • /
    • v.26 no.4
    • /
    • pp.1-25
    • /
    • 2020
  • Sentiment Analysis (SA) is a Natural Language Processing (NLP) task that analyzes the sentiments consumers or the public feel about an arbitrary object from written texts. Furthermore, Aspect-Based Sentiment Analysis (ABSA) is a fine-grained analysis of the sentiments towards each aspect of an object. Since having a more practical value in terms of business, ABSA is drawing attention from both academic and industrial organizations. When there is a review that says "The restaurant is expensive but the food is really fantastic", for example, the general SA evaluates the overall sentiment towards the 'restaurant' as 'positive', while ABSA identifies the restaurant's aspect 'price' as 'negative' and 'food' aspect as 'positive'. Thus, ABSA enables a more specific and effective marketing strategy. In order to perform ABSA, it is necessary to identify what are the aspect terms or aspect categories included in the text, and judge the sentiments towards them. Accordingly, there exist four main areas in ABSA; aspect term extraction, aspect category detection, Aspect Term Sentiment Classification (ATSC), and Aspect Category Sentiment Classification (ACSC). It is usually conducted by extracting aspect terms and then performing ATSC to analyze sentiments for the given aspect terms, or by extracting aspect categories and then performing ACSC to analyze sentiments for the given aspect category. Here, an aspect category is expressed in one or more aspect terms, or indirectly inferred by other words. In the preceding example sentence, 'price' and 'food' are both aspect categories, and the aspect category 'food' is expressed by the aspect term 'food' included in the review. If the review sentence includes 'pasta', 'steak', or 'grilled chicken special', these can all be aspect terms for the aspect category 'food'. As such, an aspect category referred to by one or more specific aspect terms is called an explicit aspect. On the other hand, the aspect category like 'price', which does not have any specific aspect terms but can be indirectly guessed with an emotional word 'expensive,' is called an implicit aspect. So far, the 'aspect category' has been used to avoid confusion about 'aspect term'. From now on, we will consider 'aspect category' and 'aspect' as the same concept and use the word 'aspect' more for convenience. And one thing to note is that ATSC analyzes the sentiment towards given aspect terms, so it deals only with explicit aspects, and ACSC treats not only explicit aspects but also implicit aspects. This study seeks to find answers to the following issues ignored in the previous studies when applying the BERT pre-trained language model to ACSC and derives superior ACSC models. First, is it more effective to reflect the output vector of tokens for aspect categories than to use only the final output vector of [CLS] token as a classification vector? Second, is there any performance difference between QA (Question Answering) and NLI (Natural Language Inference) types in the sentence-pair configuration of input data? Third, is there any performance difference according to the order of sentence including aspect category in the QA or NLI type sentence-pair configuration of input data? To achieve these research objectives, we implemented 12 ACSC models and conducted experiments on 4 English benchmark datasets. As a result, ACSC models that provide performance beyond the existing studies without expanding the training dataset were derived. In addition, it was found that it is more effective to reflect the output vector of the aspect category token than to use only the output vector for the [CLS] token as a classification vector. It was also found that QA type input generally provides better performance than NLI, and the order of the sentence with the aspect category in QA type is irrelevant with performance. There may be some differences depending on the characteristics of the dataset, but when using NLI type sentence-pair input, placing the sentence containing the aspect category second seems to provide better performance. The new methodology for designing the ACSC model used in this study could be similarly applied to other studies such as ATSC.

Quality Assurance of Volumetric Modulated Arc Therapy for Elekta Synergy (Elekta Synergy 선형가속기를 이용한 입체적세기조절회전방사선치료(VMAT) 정도관리)

  • Shim, Su-Jung;Shim, Jang-Bo;Lee, Sang-Hoon;Min, Chul-Kee;Cho, Kwang-Hwan;Shin, Dong-Oh;Choi, Jin-Ho;Park, Sung-Ill;Cho, Sam-Ju
    • Progress in Medical Physics
    • /
    • v.23 no.1
    • /
    • pp.33-41
    • /
    • 2012
  • For applying the quality assurance (QA) of volumetric modulated arc therapy (VMAT) introduced in Eulji Hospital, we classify it into three different QA steps, treatment planning QA, pretreatment delivering QA, and treatment verifying QA. These steps are based on the existing intensity modulated radiation therapy (IMRT) QA that is currently used in our hospital. In each QA step, the evaluated items that are from QA program are configured and documented. In this study, QA program is not only applied to actual patient treatment, but also evaluated to establish a reference of clinical acceptance in pretreatment delivering QA. As a result, the confidence limits (CLs) in the measurements for the high-dose and low-dose regions are similar to the conventional IMRT level, and the clinical acceptance references in our hospital are determined to be 3 to 5% for the high-dose and the low-dose regions, respectively. Due to the characteristics of VMAT, evaluation of the intensity map was carried out using an ArcCheck device that was able to measure the intensity map in all directions, $360^{\circ}$. With a couple of dosimetric devices, the gamma index was evaluated and analyzed. The results were similar to the result of individual intensity maps in IMRT. Mapcheck, which is a 2-dimensional (2D) array device, was used to display the isodose distributions and gave very excellent local CL results. Thus, in our hospital, the acceptance references used in practical clinical application for the intensity maps of $360^{\circ}$ directions and the coronal isodose distributions were determined to be 93% and 95%, respectively. To reduce arbitrary uncertainties and system errors, we had to evaluate the local CLs by using a phantom and to cooperate with multiple organizations to participate in this evaluation. In addition, we had to evaluate the local CLs by dividing them into different sections about the patient treatment points in practical clinics.

In vitro Study of the Antagonistic Effect of Low-dose Liquiritigenin on Gemcitabine-induced Capillary Leak Syndrome in Pancreatic Adenocarcinoma via Inhibiting ROS-Mediated Signalling Pathways

  • Wu, Wei;Xia, Qing;Luo, Rui-Jie;Lin, Zi-Qi;Xue, Ping
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.16 no.10
    • /
    • pp.4369-4376
    • /
    • 2015
  • Background: To investigate in-vitro antagonistic effect of low-dose liquiritigenin on gemcitabine-induced capillary leak syndrome (CLS) in pancreatic adenocarcinoma via inhibiting reactive oxygen species (ROS)-mediated signalling pathways. Materials and Methods: Human pancreatic adenocarcinoma Panc-1 cells and human umbilical vein endothelial cells (HUVECs) were pre-treated using low-dose liquiritigenin for 24 h, then added into gemcitabine and incubated for 48 h. Cell viability, apoptosis rate and ROS levels of Panc-1 cells and HUVECs were respectively detected through methylthiazolyldiphenyl-tetrazoliumbromide (MTT) and flow cytometry. For HUVECs, transendothelial electrical resistance (TEER) and transcellular and paracellular leak were measured using transwell assays, then poly (ADP-ribose) polymerase 1 (PARP-1) and metal matrix proteinase-9 (MMP9) activity were assayed via kits, mRNA expressions of p53 and Rac-1 were determined through quantitative polymerase chain reaction (qPCR); The expressions of intercellular adhesion molecule 1 (ICAM-1), vascular cell adhesion molecule-1 (VCAM-1) and PARP-1 were measured via western blotting. Results: Low-dose liquiritigenin exerted no effect on gemcitabine-induced changes of cell viability, apoptosis rate and ROS levels in Panc-1 cells, but for HUVECs, liquiritigenin ($3{\mu}M$) could remarkably elevate gemcitabine-induced decrease of cell viability, transepithelial electrical resistance (TEER), pro-MMP9 level and expression of ICAM-1 and VCAM-1 (p<0.01). Meanwhile, it could also significantly decrease gemcitabine-induced increase of transcellular and paracellular leak, ROS level, PARP-1 activity, Act-MMP9 level, mRNA expressions of p53 and Rac-1, expression of PARP-1 and apoptosis rate (p<0.01). Conclusions: Low-dose liquiritigenin exerts an antagonistic effect on gemcitabine-induced leak across HUVECs via inhibiting ROS-mediated signalling pathways, but without affecting gemcitabine-induced Panc-1 cell apoptosis. Therefore, low-dose liquiritigenin might be beneficial to prevent the occurrence of gemcitabine-induced CLS in pancreatic adenocarcinoma.

Structural Design and Thermal Analysis of a Module Coil for a 750 kW-Class High Temperature Superconducting Generator for Wind Turbine (풍력 터빈용 750 kW 급 고온초전도 발전기 모듈의 코일 구조 설계 및 열 해석)

  • Tuvdensuren, Oyunjargal;Go, Byeong-Soo;Sung, Hae-Jin;Park, Min-Won
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.24 no.2
    • /
    • pp.33-40
    • /
    • 2019
  • Many companies have tried to develop wind power generators with a larger capacity, smaller size and lighter weight. High temperature superconducting (HTS) generators are more suitable for wind power systems because they can reduce volume and weight compared with conventional generators. However, the HTS generator has problems such as huge vacuum vessel and the difficulty of repairing the HTS field coils. These problems can be overcome through the modularization of the HTS field coil. The HTS module coil require a current leads (CLs) for deliver DC current, which causes a large heat transfer load. Therefore, CLs should be designed optimally for reducing the conduction and Joule heat loads. This paper deals with a structural design and thermal analysis of a module coil for a 750 kW-class HTS generator. The conduction and radiation heat loads of the module coils were analysed using a 3D finite element method program. As a result, the total thermal load was less than the cooling capacity of the cryo-cooler. The design results can be effectively utilized to develop a superconducting generator for wind power generation systems.

Improving the Wettability of Polymeric Surfaces and Surface Modification of Ceramic by Ion Beam in Reactive gases Environments (반응성 가스 분위기하에서 이온빔을 이용한 폴리머 표면의 친수성 증대 및 세라믹표 면개질)

  • 손용배
    • Journal of the Microelectronics and Packaging Society
    • /
    • v.3 no.1
    • /
    • pp.11-24
    • /
    • 1996
  • 부분압이 다른 여러 가지 반응성 가스분위기하에서 이른곤 이온을 이용하여 PC, PET PMMA 그리고 PTFE 폴리머 표면의 삼차 증류수에대한 진수성을 증대하였다. 폴리머 표면의 친수성의 변화는 여러 가지 반응성 가스 분위기하에서 아르곤 이온의 조사량을 1014 부터 1x1017cm2까지 변화하면서 조사하였다. 접촉감은 아르곤 이온이 조사되는 폴리머 표면 근처에 유입된 가스의 방응성(O2>N2>H2)에 따라 많이 감소하였다, 폴리머 표면에 형성된 친수성기는 XPS Cls, Ols, 그리고 Nls 스펙트럼을 분석하여 확인하였다. 표면 개질된 PC와 PTFE에 대한 Al 금속의 접착력 증대를 Scotch tape와 인장실험을 통하여 확인하였다. 접착 력 증가는 표면 에너지 중 polar force의 증가에 의한 것으로 입증되었다. 에너지를 가진 아 르곤 입자 폴리머 체인 그리고 반응성 가스 사이의 반응기구는 2단계 모델로 설명가능하였 는데 그 기구는 첫 번째 이온의 조사에 의한 불안정한 폴리머 체인의 형성과 두 번째 단계 로 이렇게 형성된 폴리머 체인과 반응성 가스들 사이의 화학반응으로 이루어진다. 질화아루 미늄의 표면을 산소분위기하에서 아르곤 빔을 조사하여 표면개질한후 AlON층이 새롭게 형 성된 것을 XPS를 이용하여 확인할수 있었다. 개질된 질화알루미늄과 구리금속 박막간의 접 착력을 scratch 실험을 통하여 조사하였다.

A study on the hardening characterstics of the TiC layer formed by the reactive deposition technique (반응석출법에 의해 피복된 TiC의 경화거동에 관한 연구)

  • Nam, K.S.;Byon, E.S.;Lee, G.H.;Kim, D.H.
    • Journal of the Korean Society for Heat Treatment
    • /
    • v.7 no.4
    • /
    • pp.288-297
    • /
    • 1994
  • In this study, lattice parameter, binding energy and microstructures of TiC layer according to the addition of Fe, Cr were investigated in the reactive deposition coating. From the results, the lattice parameters of the TiC layers by using ferro-titanium as a precursor were 4.329~4.339A but the lattice parameters of the TiC layers formed by ferro-titanium and ferro-chromium decreased to 4.316~4.330A. The hardness of the former's was HV(100g) 3,000~3,400kg/mm and the hardness of the latter's was HV (100g) 3,800~3,900. But, regardless of Cr and Fe, the binding energy of TiC layers were 454.75 eV for $Ti2p_{3/2}$ and were 281.85 eV for Cls. Meanwhile, the TiC layers were densified by addition of Fe, Cr and internal defects were reduced Therefore. it can be concluded that the remarkable hardness increment was obtained by the improvement of microstructures of TiC rather than the increase of bond strength or Peierls stress.

  • PDF

Maskless Fabrication of the Silicon Stamper for PDMS Nano/Micro Channel (나노/마이크로 PDMS 채널 제작을 위한 마스크리스 실리콘 스템퍼 제작 및 레오로지 성형으로의 응용)

  • 윤성원;강충길
    • Transactions of Materials Processing
    • /
    • v.13 no.4
    • /
    • pp.326-333
    • /
    • 2004
  • The nanoprobe based on lithography, mainly represented by SPM based technologies, has been recognized as a potential application to fabricate the surface nanosctructures because of its operational versatility and simplicity. However, nanoprobe based on lithography itself is not suitable for mass production because it is time a consuming method and not economical for commercial applications. One solution is to fabricate a mold that will be used for mass production processes such as nanoimprint, PDMS casting, and others. The objective of this study is to fabricate the silicon stamper for PDMS casting process by a mastless fabrication technique using the combination of nano/micro machining by Nanoindenter XP and KOH wet etching. Effect of the Berkovich tip alignment on the deformation was investigated. Grooves were machined on a silicon surface, which has native oxide on it, by constant load scratch (CLS), and they were etched in KOH solutions to investigate chemical characteristics of the machined silicon surface. After the etching process, the convex structures was made because of the etch mask effect of the mechanically affected layer generated by nanoscratch. On the basis of this fact, some line patterns with convex structures were fabricated. Achieved groove and convex structures were used as a stamper for PDMS casting process.

QoS Guaranteed Secure Network Service Realization using Global User Management Framework (GUMF);Service Security Model for Privacy

  • Choi, Byeong-Cheol;Kim, Kwang-Sik;Seo, Dong-Il
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.1586-1589
    • /
    • 2005
  • GUMF (Global User Management Framework) that is proposed in this research can be applied to next generation network such as BcN (Broadband convergence Network), it is QoS guaranteed security framework for user that can solve present Internet's security vulnerability. GUMF offers anonymity for user of service and use the user's real-name or ID for management of service and it is technology that can realize secure QoS. GUMF needs management framework, UMS (User Management System), VNC (Virtual Network Controller) etc. UMS consists of root UMS in country dimension and Local UMS in each site dimension. VNC is network security equipment including VPN, QoS and security functions etc., and it achieves the QoSS (Quality of Security Service) and CLS(Communication Level Switching) functions. GUMF can offer safety in bandwidth consumption attacks such as worm propagation and DoS/DDoS, IP spoofing attack, and current most attack such as abusing of private information because it can offer the different QoS guaranteed network according to user's grades. User's grades are divided by 4 levels from Level 0 to Level 3, and user's security service level is decided according to level of the private information. Level 3 users that offer bio-information can receive secure network service that privacy is guaranteed. Therefore, GUMF that is proposed in this research can offer profit model to ISP and NSP, and can be utilized by strategy for secure u-Korea realization.

  • PDF

Approximated Constrained Least Squares Filter for Real-Time Directionally Adaptive Image Restoration (제약적 최소 제곱 필터의 근사화를 이용한 실시간 방향 적응적 영상복원)

  • Cho, Changhun;Jeon, Jaehwan;Paik, Joonki
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.12
    • /
    • pp.150-158
    • /
    • 2013
  • In this paper we present approximated constrained least squares filter for real-time directionally adaptive image restoration. The proposed method makes a hardware implementation easier for real-time image restoration because of reducing the filter size. Furthermore, for directional adaptive image restoration, this paper estimates the local orientation by analyzing the covariance matrix and applies to approximated constrained least squares filter. Experimental results show that the proposed method is sharper and less artifacts than existing methods.