• 제목/요약/키워드: Head-Tail

검색결과 387건 처리시간 0.027초

Transformer를 이용한 한국어 Head-Tail 품사 태거 (Korean Head-Tail POS-Tagger by using Transformer)

  • 김정민;서현재;강승식
    • 한국정보과학회 언어공학연구회:학술대회논문집(한글 및 한국어 정보처리)
    • /
    • 한국정보과학회언어공학연구회 2021년도 제33회 한글 및 한국어 정보처리 학술대회
    • /
    • pp.544-547
    • /
    • 2021
  • 한국어의 품사 태깅 문제는 입력 어절의 형태소 분석 후보들로부터 통계적으로 적절한 품사 태그를 가지는 후보들을 찾는 방식으로 해결하여 왔다. 어절을 형태소 단위로 분리하고 품사를 부착하는 기존의 방식은 품사태그 정보를 딥러닝 feature로 사용할 때 문장의 의미를 이해하는데 복잡도를 증가시키는 요인이 된다. 본 연구에서는 품사 태깅 문제를 단순화 하여 한 어절을 Head와 Tail이라는 두 가지 유형의 형태소 토큰으로 분리하여 Head와 Tail에 대해 품사를 부착한다. Head-Tail 품사 태깅 방법을 Sequence-to-Sequence 문제로 정의하여 Transformer를 이용한 Head-Tail 품사 태거를 설계하고 구현하였다. 학습데이터로는 KCC150 말뭉치의 품사 태깅 말뭉치 중에서 788만 문장을 사용하고, 실험 데이터로는 10만 문장을 사용하였다. 실험 결과로 토큰 정확도는 99.75%, 태그 정확도는 99.39%, 토큰-태그 정확도는 99.31%로 나타났다.

  • PDF

Head-Tail 토큰화 기법을 이용한 한국어 품사 태깅 (Korean Part-Of-Speech Tagging by using Head-Tail Tokenization)

  • 서현재;김정민;강승식
    • 스마트미디어저널
    • /
    • 제11권5호
    • /
    • pp.17-25
    • /
    • 2022
  • 기존의 한국어 품사 태깅 방식은 복합어를 단위 형태소들로 분해하여 품사를 부착하므로 형태소 태그가 세분화되어 있어서 태거의 활용 목적에 따라 불필요하게 복잡하고 다양한 어절 유형들이 생성되는 단점이 있다. 딥러닝 언어처리에서는 키워드 추출 목적으로 품사 태거를 사용할 때 복합조사, 복합어미 등 문법 형태소들을 단위 형태소로 분할하지 않는 토큰화 방식이 효율적이다. 본 연구에서는 어절을 형태소 단위로 토큰화할 때 어휘형태소 부분과 문법형태소 부분 두 가지 유형의 토큰으로만 분할하는 Head-Tail 토큰화 기법을 사용하여 품사 태깅 문제를 단순화함으로써 어절이 과도하게 분해되는 문제점을 보완하였다. Head-Tail 토큰화된 데이터에 대해 통계적 기법과 딥러닝 모델로 품사 태깅을 시도하여 각 모델의 품사 태깅 정확도를 실험하였다. 통계 기반 품사 태거인 TnT 태거와 딥러닝 기반 품사 태거인 Bi-LSTM 태거를 사용하여 Head-Tail 토큰화된 데이터셋에 대한 품사 태깅을 수행하였다. TnT 태거와 Bi-LSTM 태거를 Head-Tail 토큰화된 데이터셋에 대해 학습하여 품사 태깅 정확도를 측정하였다. 그 결과로, TnT 태거는 97.00%인데 비해 Bi-LSTM 태거는 99.52%의 높은 정확도로 품사 태깅을 수행할 수 있음을 확인하였다.

딥러닝을 이용한 한국어 Head-Tail 토큰화 기법과 품사 태깅 (Korean Head-Tail Tokenization and Part-of-Speech Tagging by using Deep Learning)

  • 김정민;강승식;김혁만
    • 대한임베디드공학회논문지
    • /
    • 제17권4호
    • /
    • pp.199-208
    • /
    • 2022
  • Korean is an agglutinative language, and one or more morphemes are combined to form a single word. Part-of-speech tagging method separates each morpheme from a word and attaches a part-of-speech tag. In this study, we propose a new Korean part-of-speech tagging method based on the Head-Tail tokenization technique that divides a word into a lexical morpheme part and a grammatical morpheme part without decomposing compound words. In this method, the Head-Tail is divided by the syllable boundary without restoring irregular deformation or abbreviated syllables. Korean part-of-speech tagger was implemented using the Head-Tail tokenization and deep learning technique. In order to solve the problem that a large number of complex tags are generated due to the segmented tags and the tagging accuracy is low, we reduced the number of tags to a complex tag composed of large classification tags, and as a result, we improved the tagging accuracy. The performance of the Head-Tail part-of-speech tagger was experimented by using BERT, syllable bigram, and subword bigram embedding, and both syllable bigram and subword bigram embedding showed improvement in performance compared to general BERT. Part-of-speech tagging was performed by integrating the Head-Tail tokenization model and the simplified part-of-speech tagging model, achieving 98.99% word unit accuracy and 99.08% token unit accuracy. As a result of the experiment, it was found that the performance of part-of-speech tagging improved when the maximum token length was limited to twice the number of words.

열연 공정에서의 영상을 이용한 캠버 및 최적 절단선 검출 알고리즘 (Vision-Based Camber and Optimal Cutting Line Detection Algorithm for Hot-Rolling Process)

  • 공남웅;문정혜;박부견
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2007년도 심포지엄 논문집 정보 및 제어부문
    • /
    • pp.155-156
    • /
    • 2007
  • This paper presents the vision-based camber and optimal cutting line detection algorithm for hot-rolling process. It is important to measure the camber of head and tail part of strips because many problems are caused by the camber in the hot-rolling process. The hot-rolling process has time constraints. The camber detection algorithm of head and tail parts requires fast and less complex for satisfying time constraints. The proposed algorithm consists of two parts: measurement of the camber in the head and tail part of strips and decision part of the optimal cutting line of hot-rolled strip. First, we obtain the camber value of the strip from the difference between the real center line and the center line of head, tail part. Second, the head and tail part of strips isn't suitable for strips connections. Therefore, the cutting process is needed in the hot-rolling process. The optimal cutting line is determined by the head and tail images obtained from cameras. The algorithm is applied into the vision system with two area cameras, Matrox image processing board and host PC for verification.

  • PDF

POLARIZATION OBSERVATIONS OF RADIO SOURCES IN THE FIELD CONTAINING ABELL 695

  • Kim, Kwang-Tae
    • 천문학회지
    • /
    • 제21권2호
    • /
    • pp.117-132
    • /
    • 1988
  • Multi-frequency polarization observations of Abell 695 are reported here. The brightest radio source 0838+325, which was previously classified as a wide angled head-tail radio source, is, in the present observations, resolved into two separable sources, a head-tail source 0838+325 AB and a diffuse one 0838+325C. The radio-tail shows high degree of linear polarization(${\sim}50$-25%) along the radio-tail, suggesting that the interaction with its surrounding intracluster medium (ICM) is not highly turbulent. With the present data, thermal particle densities at the locations of these sources are estimated to be n > $10^{-5}\;cm^{-3}$.

  • PDF

Bacillus thuringiensis phage의 분포와 형태에 관한 연구 (The distribution and Morphology of Bacillus thuringiensis Phages in Korea)

  • 이태우;안경준
    • Applied Microscopy
    • /
    • 제12권1호
    • /
    • pp.33-40
    • /
    • 1982
  • Several phages of Bacillus thuringiensis distributed in Korea were isolated. The distribution and morphological characteristics of phages were studied. The results are as follows; 1. The isolated phages were highly specific for Bacillus thuringiensis var. thuringiensis. They were classified as YM series phages and designated as phage YM-1, YM-2 and YM-3 according to their morphological characteristics. 2. Most of these YM series phages were isolated from compost including domestic animal dung and soil under sewage. 3. The YM-1 phage was similar to Bacillus subtilis ${\phi}25$ in morphology. It has 94nm x 86nm head, contractile tail sheath and base plate with four cornered structure. 4. The YM-2 phage was similar to Bacillus subtilis GA-1 phage in morphology. It had 70nm x 56nm head and tail without contractile tail sheath. 5. The YM-3 phage was similar to Bacillus subtilis ${\phi}29$ phage. It had 56nm x 43nm head and tail with distal enlargement.

  • PDF

열연강판 선후단부 폭 정밀도 개선을 위한 최적 엣저롤 개도 제어 (Dynamic Edger Control for the Precise Width Control at the Head, and Tail Ends of Hot Strip)

  • 천명식;이준정;문영훈
    • 대한기계학회논문집A
    • /
    • 제23권7호
    • /
    • pp.1196-1204
    • /
    • 1999
  • adaption of the model predictions is highly desirable. In general, the width deviation at the head and tail ends of strip may be different from that of the steady state region. Therefore, the dynamic edger corrections can be used to compensate the width deviations which would otherwise occur. For the precise width control, the effect of edger roll gap and rolling conditions on the width deviation of head and tail ends of strip has been investigated and the effective method to decrease width deviation has been proposed. On-line application of dynamic edger control method in this study shows about 50% width compensation at the head end of the strip, and near perfect compensation at the tail end of strip.

영상정보를 이용한 돼지의 비접촉 체중계측시스템 인자 구명 (Identification of Discrimination Factors for a Pig Noncontact Weighing System Using Image Data)

  • 장동일;임영일;임정택;장요한;장홍희
    • 한국축산시설환경학회지
    • /
    • 제5권2호
    • /
    • pp.93-100
    • /
    • 1999
  • Pig's original image data was transformed to a binary image, an image excluding head and tail portion from the whole binary image, and a projected image associated with pig's height. Then the length of body, width of shoulder, and area of pig were calculated and the relationships among the above characteristics and pig's weight were analyzed. The results obtained from this study were as follows: 1. Whole binary image data was considered to be improper to determine the pig's weight because the movement of pig's head and tail portion affected the image data. 2. Binary image data excluding head and tail portion from the whole binary image showed a better estimation of the pig's weight than the whole binary image. 3. Pig's should width was analyzed to be improper factor to determine the pig's weight. 4. The projected image associated with pig's height showed the highest correlation between the pig's area of the image and pig's weight(R2=0.9965). From this research the projected image associated with pig's height, which is excluding head and tail portion from the whole body of pig's image, was considered to be the prime factor to measure the pig's weight by the noncontact measurement.

카라신과 어류 3종의 수정란 난막 미세구조에 대한 비교 연구 (A Comparative Study on the Ultrastructures of the Egg Envelope in Fertilized Eggs of Fishes, Characidae, Three Species)

  • 김동희;류동석;등영건
    • Applied Microscopy
    • /
    • 제26권3호
    • /
    • pp.277-291
    • /
    • 1996
  • The structures of the egg envelope in fertilized eggs of three species of characidae, head and tail light fish (Hemigrammus ocellifer), black tetra (Gymnocorymbus ternetzi), and buenos aires tetra (Hemigrammus caudovittatus) were studied using light and electron microscopes. The fertilized eggs in all species were colorless, transparent, spherical and non-floted type. The egg envelopes have a single micropyle resembling the pathway of sperm in the area of the animal pole. The micropyle was surrounded by protruded lines of the egg envelope in a radiated form. Egg envelopes of fertilized eggs in both head and tail light fish and buenos aires tetra consisted of three distinct layers; an outer layer, a middle layer and an inner layer. And that of blacktetra consisted of two layers; an outer layer and an inner layer. Also, an outer layers of both head and tail light fish and black tetra were adhesive types but, in that of buenous aires tetra was non-adhesive type. An outer surface of egg envelope in black tetra was arranged by pores regularly. In that of head and tail light fish and buenos aires tetra have a rough side. An inner layer of egg envelope in fertilized eggs consisted of lamellae alternating with interlamellae of lower electron density; an inner layer of fertilized eggs in head and tail light fish consisted of three layers, that of black tetra was four layers, and that of buenos aires tetra was five layers.

  • PDF

발화 내 페르소나 트리플 추출 방법 연구 (A Method for Extracting Persona Triples in Dialogue)

  • 장윤나;양기수;허윤아;임희석
    • 한국정보과학회 언어공학연구회:학술대회논문집(한글 및 한국어 정보처리)
    • /
    • 한국정보과학회언어공학연구회 2023년도 제35회 한글 및 한국어 정보처리 학술대회
    • /
    • pp.726-729
    • /
    • 2023
  • 본 논문에서는 대화 중 발화에서 페르소나 트리플을 추출하는 방법을 연구한다. 발화 문장과 그에 해당하는 트리플 쌍을 활용하여 발화 문장 혹은 페르소나 문장이 주어졌을 때 그로부터 페르소나 트리플을 추출하도록 모델을 멀티 태스크 러닝 방식으로 학습시킨다. 모델은 인코더-디코더 구조를 갖는 사전학습 언어모델 BART [1]와 T5 [2]를 활용하며 relation 추출과 tail 추출의 두 가지 태스크를 각각 인코더, 디코더 위에 head를 추가하여 학습한다. Relation 추출은 분류로, tail 추출은 생성 문제로 접근하도록 하여 최종적으로 head, relation, tail의 구조를 갖는 페르소나 트리플을 추출하도록 한다. 실험에서는 BART와 T5를 활용하여 각 태스크에 대해 다른 학습 가중치를 두어 훈련시켰고, 두 모델 모두 relation과 tail을 추출하는 태스크 정확도에 있어서 90% 이상의 높은 점수를 보임을 확인했다.

  • PDF