• Title/Summary/Keyword: Transformer Models

Search Result 157, Processing Time 0.022 seconds

Partial Discharge Pattern Recognition of Cast Resin Current Transformers Using Radial Basis Function Neural Network

  • Chang, Wen-Yeau
    • Journal of Electrical Engineering and Technology
    • /
    • v.9 no.1
    • /
    • pp.293-300
    • /
    • 2014
  • This paper proposes a novel pattern recognition approach based on the radial basis function (RBF) neural network for identifying insulation defects of high-voltage electrical apparatus arising from partial discharge (PD). Pattern recognition of PD is used for identifying defects causing the PD, such as internal discharge, external discharge, corona, etc. This information is vital for estimating the harmfulness of the discharge in the insulation. Since an insulation defect, such as one resulting from PD, would have a corresponding particular pattern, pattern recognition of PD is significant means to discriminate insulation conditions of high-voltage electrical apparatus. To verify the proposed approach, experiments were conducted to demonstrate the field-test PD pattern recognition of cast resin current transformer (CRCT) models. These tests used artificial defects created in order to produce the common PD activities of CRCTs by using feature vectors of field-test PD patterns. The significant features are extracted by using nonlinear principal component analysis (NLPCA) method. The experimental data are found to be in close agreement with the recognized data. The test results show that the proposed approach is efficient and reliable.

Precise Modeling and Adaptive Feed-Forward Decoupling of Unified Power Quality Conditioners

  • Wang, Yingpin;Obwoya, Rubangakene Thomas;Li, Zhibo;Li, Gongjie;Qu, Yi;Shi, Zeyu;Zhang, Feng;Xie, Yunxiang
    • Journal of Power Electronics
    • /
    • v.19 no.2
    • /
    • pp.519-528
    • /
    • 2019
  • The unified power quality conditioner (UPQC) is an effective custom power device that is used at the point of common coupling to protect loads from voltage and current-related PQ issues. Currently, most researchers have studied series unit and parallel unit models and an idealized transformer model. However, the interactions of the series and parallel converters in AC-link are difficult to analyze. This study utilizes an equivalent transformer model to accomplish an electric connection of series and parallel converters in the AC-link and to establishes a precise unified mathematical model of the UPQC. The strong coupling interactions of series and parallel units are analyzed, and they show a remarkable dependence on the excitation impedance of transformers. Afterward, a feed-forward decoupling method based on a unified model that contains the uncertainty components of the load impedance is applied. Thus, this study presents an adaptive method to estimate load impedance. Furthermore, simulation and experimental results verify the accuracy of the proposed modeling and decoupling algorithm.

A Transformer-Based Emotion Classification Model Using Transfer Learning and SHAP Analysis (전이 학습 및 SHAP 분석을 활용한 트랜스포머 기반 감정 분류 모델)

  • Subeen Leem;Byeongcheon Lee;Insu Jeon;Jihoon Moon
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2023.05a
    • /
    • pp.706-708
    • /
    • 2023
  • In this study, we embark on a journey to uncover the essence of emotions by exploring the depths of transfer learning on three pre-trained transformer models. Our quest to classify five emotions culminates in discovering the KLUE (Korean Language Understanding Evaluation)-BERT (Bidirectional Encoder Representations from Transformers) model, which is the most exceptional among its peers. Our analysis of F1 scores attests to its superior learning and generalization abilities on the experimental data. To delve deeper into the mystery behind its success, we employ the powerful SHAP (Shapley Additive Explanations) method to unravel the intricacies of the KLUE-BERT model. The findings of our investigation are presented with a mesmerizing text plot visualization, which serves as a window into the model's soul. This approach enables us to grasp the impact of individual tokens on emotion classification and provides irrefutable, visually appealing evidence to support the predictions of the KLUE-BERT model.

A label-free high precision automated crack detection method based on unsupervised generative attentional networks and swin-crackformer

  • Shiqiao Meng;Lezhi Gu;Ying Zhou;Abouzar Jafari
    • Smart Structures and Systems
    • /
    • v.33 no.6
    • /
    • pp.449-463
    • /
    • 2024
  • Automated crack detection is crucial for structural health monitoring and post-earthquake rapid damage detection. However, realizing high precision automatic crack detection in the absence of corresponding manual labeling presents a formidable challenge. This paper presents a novel crack segmentation transfer learning method and a novel crack segmentation model called Swin-CrackFormer. The proposed method facilitates efficient crack image style transfer through a meticulously designed data preprocessing technique, followed by the utilization of a GAN model for image style transfer. Moreover, the proposed Swin-CrackFormer combines the advantages of Transformer and convolution operations to achieve effective local and global feature extraction. To verify the effectiveness of the proposed method, this study validates the proposed method on three unlabeled crack datasets and evaluates the Swin-CrackFormer model on the METU dataset. Experimental results demonstrate that the crack transfer learning method significantly improves the crack segmentation performance on unlabeled crack datasets. Moreover, the Swin-CrackFormer model achieved the best detection result on the METU dataset, surpassing existing crack segmentation models.

Partial Discharge Process and Characteristics of Oil-Paper Insulation under Pulsating DC Voltage

  • Bao, Lianwei;Li, Jian;Zhang, Jing;Jiang, Tianyan;Li, Xudong
    • Journal of Electrical Engineering and Technology
    • /
    • v.11 no.2
    • /
    • pp.436-444
    • /
    • 2016
  • Oil-paper insulation of valve-side windings in converter transformers withstand electrical stresses combining with AC, DC and strong harmonic components. This paper presents the physical mechanisms and experimental researches on partial discharge (PD) of oil-paper insulation at pulsating DC voltage. Theoretical analysis showed that the phase-resolved distributions of PDs generated from different insulated models varied as the increase of the applied voltages following a certain rule. Four artificial insulation defect models were designed to generate PD signals at pulsating DC voltages. Theoretical statements and experimental results show that the PD pulses first appear at the maximum value of the applied pulsating DC voltage, and the resolved PD phase distribution became wider as the applied voltage increased. The PD phase-resolved distributions generated from the different discharge models are also different in the phase-resolved distributions and development progress. It implies that the theoretical analysis is suitable for interpretation of PD at pulsating DC voltage.

Breakdown Characteristics and Survival Probability of Turn-to- Turn Models for a HTS Transformer

  • Cheon H.G.;Baek S.M.;Seong K.C.;Kim H.J.;Kim S.H.
    • Progress in Superconductivity and Cryogenics
    • /
    • v.7 no.2
    • /
    • pp.21-26
    • /
    • 2005
  • Breakdown characteristics and survival probability of turn-to-turn models were investigated under ac and impulse voltage at 77K. For experiments, two test electrode models were fabricated: One is point contact model and the other is surface contact model. Both are made of copper wrapped by O.025mm thick polyimide film(Kapton). The experimental results were analyzed statistically using Weibull distribution in order to examine the wrapping number effects on voltage-time characteristics under ac voltage as well as under impulse voltage in LN$_{2}$. Also survival analysis were performed according to the Kaplan-Meier method. The breakdown voltages of surface contact model are lower than that of point contact model, because the contact area of surface contact model is wider than that of point contact model. Besides, the shape parameter of point contact model is a little bit larger than that of surface contact model. The time to breakdown t$_{50}$ is decreased as the applied voltage is increased, and the lifetime indices slightly are increased as the number of layers is increased. According to the increasing applied voltage and decreasing wrapping number, the survival probability is increased.

Zero-anaphora resolution in Korean based on deep language representation model: BERT

  • Kim, Youngtae;Ra, Dongyul;Lim, Soojong
    • ETRI Journal
    • /
    • v.43 no.2
    • /
    • pp.299-312
    • /
    • 2021
  • It is necessary to achieve high performance in the task of zero anaphora resolution (ZAR) for completely understanding the texts in Korean, Japanese, Chinese, and various other languages. Deep-learning-based models are being employed for building ZAR systems, owing to the success of deep learning in the recent years. However, the objective of building a high-quality ZAR system is far from being achieved even using these models. To enhance the current ZAR techniques, we fine-tuned a pretrained bidirectional encoder representations from transformers (BERT). Notably, BERT is a general language representation model that enables systems to utilize deep bidirectional contextual information in a natural language text. It extensively exploits the attention mechanism based upon the sequence-transduction model Transformer. In our model, classification is simultaneously performed for all the words in the input word sequence to decide whether each word can be an antecedent. We seek end-to-end learning by disallowing any use of hand-crafted or dependency-parsing features. Experimental results show that compared with other models, our approach can significantly improve the performance of ZAR.

Robust Sentiment Classification of Metaverse Services Using a Pre-trained Language Model with Soft Voting

  • Haein Lee;Hae Sun Jung;Seon Hong Lee;Jang Hyun Kim
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.9
    • /
    • pp.2334-2347
    • /
    • 2023
  • Metaverse services generate text data, data of ubiquitous computing, in real-time to analyze user emotions. Analysis of user emotions is an important task in metaverse services. This study aims to classify user sentiments using deep learning and pre-trained language models based on the transformer structure. Previous studies collected data from a single platform, whereas the current study incorporated the review data as "Metaverse" keyword from the YouTube and Google Play Store platforms for general utilization. As a result, the Bidirectional Encoder Representations from Transformers (BERT) and Robustly optimized BERT approach (RoBERTa) models using the soft voting mechanism achieved a highest accuracy of 88.57%. In addition, the area under the curve (AUC) score of the ensemble model comprising RoBERTa, BERT, and A Lite BERT (ALBERT) was 0.9458. The results demonstrate that the ensemble combined with the RoBERTa model exhibits good performance. Therefore, the RoBERTa model can be applied on platforms that provide metaverse services. The findings contribute to the advancement of natural language processing techniques in metaverse services, which are increasingly important in digital platforms and virtual environments. Overall, this study provides empirical evidence that sentiment analysis using deep learning and pre-trained language models is a promising approach to improving user experiences in metaverse services.

Twin models for high-resolution visual inspections

  • Seyedomid Sajedi;Kareem A. Eltouny;Xiao Liang
    • Smart Structures and Systems
    • /
    • v.31 no.4
    • /
    • pp.351-363
    • /
    • 2023
  • Visual structural inspections are an inseparable part of post-earthquake damage assessments. With unmanned aerial vehicles (UAVs) establishing a new frontier in visual inspections, there are major computational challenges in processing the collected massive amounts of high-resolution visual data. We propose twin deep learning models that can provide accurate high-resolution structural components and damage segmentation masks efficiently. The traditional approach to cope with high memory computational demands is to either uniformly downsample the raw images at the price of losing fine local details or cropping smaller parts of the images leading to a loss of global contextual information. Therefore, our twin models comprising Trainable Resizing for high-resolution Segmentation Network (TRS-Net) and DmgFormer approaches the global and local semantics from different perspectives. TRS-Net is a compound, high-resolution segmentation architecture equipped with learnable downsampler and upsampler modules to minimize information loss for optimal performance and efficiency. DmgFormer utilizes a transformer backbone and a convolutional decoder head with skip connections on a grid of crops aiming for high precision learning without downsizing. An augmented inference technique is used to boost performance further and reduce the possible loss of context due to grid cropping. Comprehensive experiments have been performed on the 3D physics-based graphics models (PBGMs) synthetic environments in the QuakeCity dataset. The proposed framework is evaluated using several metrics on three segmentation tasks: component type, component damage state, and global damage (crack, rebar, spalling). The models were developed as part of the 2nd International Competition for Structural Health Monitoring.

A Study on the Application of the DVR in AC Electric Traction System (전기철도계통에 순간전압강하 보상장치 적용에 관한 연구)

  • 최준호;김태수;김재철;문승일;남해곤;정일엽;박성우
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.17 no.6
    • /
    • pp.95-104
    • /
    • 2003
  • The electric traction systems are quite differ from general power systems which is single-phase and heavy load. Therefore, there are inevitably power quality problems such as steady state or transient voltage drop, voltage imbalance and harmonic distortion. Among these problems, since steady-state volatge drop is the one of most important factor in electric power quality, many researches about on the compensation of volatge drop by using SVC(Static Var Compensator) and/or STACOM(Static Compensator) have been studied and proposed Also, it is expected that transient voltage drop(voltage sag) could affect the control and safety of high speed traction load. In this paper, voltage sag compensation of AT(Auto Transformer) feeding system are studied The detailed transient models of utility source, scott transformer, AT, and traction load are estabilished. The application of DVR(Dynamic Voltage Restorer) in electric traction system is proposed to compensate the voltage sag of traction network which is occured by the fault of utility source. It can be shown that application of the DVR in electric traction system is very useful to compensate the volatge sag from the result of related simulation works.