• Title/Summary/Keyword: Morphological model

Search Result 484, Processing Time 0.028 seconds

Linear-Time Korean Morphological Analysis Using an Action-based Local Monotonic Attention Mechanism

  • Hwang, Hyunsun;Lee, Changki
    • ETRI Journal
    • /
    • v.42 no.1
    • /
    • pp.101-107
    • /
    • 2020
  • For Korean language processing, morphological analysis is a critical component that requires extensive work. This morphological analysis can be conducted in an end-to-end manner without requiring a complicated feature design using a sequence-to-sequence model. However, the sequence-to-sequence model has a time complexity of O(n2) for an input length n when using the attention mechanism technique for high performance. In this study, we propose a linear-time Korean morphological analysis model using a local monotonic attention mechanism relying on monotonic alignment, which is a characteristic of Korean morphological analysis. The proposed model indicates an extreme improvement in a single threaded environment and a high morphometric F1-measure even for a hard attention model with the elimination of the attention mechanism formula.

A Reranking Model for Korean Morphological Analysis Based on Sequence-to-Sequence Model (Sequence-to-Sequence 모델 기반으로 한 한국어 형태소 분석의 재순위화 모델)

  • Choi, Yong-Seok;Lee, Kong Joo
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.7 no.4
    • /
    • pp.121-128
    • /
    • 2018
  • A Korean morphological analyzer adopts sequence-to-sequence (seq2seq) model, which can generate an output sequence of different length from an input. In general, a seq2seq based Korean morphological analyzer takes a syllable-unit based sequence as an input, and output a syllable-unit based sequence. Syllable-based morphological analysis has the advantage that unknown words can be easily handled, but has the disadvantages that morpheme-based information is ignored. In this paper, we propose a reranking model as a post-processor of seq2seq model that can improve the accuracy of morphological analysis. The seq2seq based morphological analyzer can generate K results by using a beam-search method. The reranking model exploits morpheme-unit embedding information as well as n-gram of morphemes in order to reorder K results. The experimental results show that the reranking model can improve 1.17% F1 score comparing with the original seq2seq model.

Time Dependent Morphological Changes around the Closure Gap in Saemankeum (새만금 방조제 물막이 구간 주변에서의 지형변화예측(수공))

  • 박영욱;어대수;박상현
    • Proceedings of the Korean Society of Agricultural Engineers Conference
    • /
    • 2000.10a
    • /
    • pp.365-370
    • /
    • 2000
  • Sea dike construction for the tidal flat reclamation works in estuary and coast may change the characteristics of tidal motion and wave conditions in the region. In turn, a new hydraulic condition provides the impacts on sediment transport pattern and forms a new morphological environment. Also, morphological changes during the closure works of sea dike are closely related with a safy of sea dike. Therefore, the prediction of morphological changes is required secure the safe closure work and the economic design of sea dikes. To investigate morphological changes due to sea dike construction, hydrodynamic changes of tides and waves have to be evaluated, then sediment transport and sea bottom changes are computed. Mathematical modelling is required for representation of interrelation of tidal motion, wave and sediment transport. In this study, numerical model MORSYS is applied to compute the hydrodynamics and morphological changes around the closure gap for Saemankuem dike. This model allows a flexible integration of the module for waves, currents, sediment transport and bottom changes.

  • PDF

MADE: Morphological Analyzer Development Environment (MADE : 형태소 분석기 개발환경)

  • Shim, Kwang-Seob
    • Journal of Internet Computing and Services
    • /
    • v.8 no.4
    • /
    • pp.159-171
    • /
    • 2007
  • This paper proposes a software tool MADE that is useful to develop a practical Korean morphological analyzer. A morphological analysis is performed by using adjacency conditions provided by a morphological dictionary. This means that developing a morphological analyzer is reduced merely to constructing a morphological dictionary. No programming skill is required in this process, MADE provides with useful functions that facilitate the construction of a dictionary. Once a dictionary is constructed, the morphological analysis engine embedded in MADE may be used as a stand-alone morphological analyzer or be integrated into an application software which requires a Korean morphological analysis module.

  • PDF

Urban Model for Mean Flow and Turbulence (평균풍속 및 난류 예측을 위한 도심지 모델)

  • Kim, Byung-Gu;Lee, Chang-Hoon;Kim, Seog-Cheol;Jang, Dong-Du;Joo, Seok-Jun;Shim, Woo-Sup
    • Proceedings of the KSME Conference
    • /
    • 2007.05b
    • /
    • pp.2923-2928
    • /
    • 2007
  • The study of model for velocity and turbulence within the urban canopy was carried out. To evaluate existing urban model we conducted wind tunnel experiment and large-eddy simulation (LES). Mean velocity profile and turbulence are measured within simple three different obstacle arrays. To obtain supplemental data and to verify morphological model large-eddy simulation was performed. Several methods have been used to achieve embodying the flow field in urban area. Recently, morphological method obtaining flow parameters from the statistical or physical representation of obstacle elements is a arising method. It was found that all morphological model, evaluated in this study, over predict the friction velocity, most sensitive one among the flow parameters. Velocity and turbulence in the urban canopy layer were improved by the correction using 'true' friction velocity.

  • PDF

Cloning of Korean Morphological Analyzers using Pre-analyzed Eojeol Dictionary and Syllable-based Probabilistic Model (기분석 어절 사전과 음절 단위의 확률 모델을 이용한 한국어 형태소 분석기 복제)

  • Shim, Kwangseob
    • KIISE Transactions on Computing Practices
    • /
    • v.22 no.3
    • /
    • pp.119-126
    • /
    • 2016
  • In this study, we verified the feasibility of a Korean morphological analyzer that uses a pre-analyzed Eojeol dictionary and syllable-based probabilistic model. For the verification, MACH and KLT2000, Korean morphological analyzers, were cloned with a pre-analyzed eojeol dictionary and syllable-based probabilistic model. The analysis results were compared between the cloned morphological analyzer, MACH, and KLT2000. The 10 million Eojeol Sejong corpus was segmented into 10 sets for cross-validation. The 10-fold cross-validated precision and recall for cloned MACH and KLT2000 were 97.16%, 98.31% and 96.80%, 99.03%, respectively. Analysis speed of a cloned MACH was 308,000 Eojeols per second, and the speed of a cloned KLT2000 was 436,000 Eojeols per second. The experimental results indicated that a Korean morphological analyzer that uses a pre-analyzed eojeol dictionary and syllable-based probabilistic model could be used in practical applications.

Morphological Processing with LR Techniques (LR 테크닉을 이용한 형태소 분석)

  • 이강혁
    • Korean Journal of Cognitive Science
    • /
    • v.4 no.2
    • /
    • pp.115-143
    • /
    • 1994
  • In this paper,I present an extended two-level model using LR parsing techniques.The LR-based two-level model not only guarantees effcient morphological processing but also achieves a higher degree of descriptive adequacy than Koskenniemi's original model.The two-level model is augmented with an independent morphosyntactic module based on feature-based CF word grammar.By adopting a CF word grammar,our model is capable of dealing with complex words with discontinuous dependencies without having duplicate lexicons.It is shown how LR predictions manifested in the parsing table can help the morphological processor to minimize the dictionary lookup process.

PC-KIMMO-based Description of Mongolian Morphology

  • Jaimai, Purev;Zundui, Tsolmon;Chagnaa, Altangerel;Ock, Cheol-Young
    • Journal of Information Processing Systems
    • /
    • v.1 no.1 s.1
    • /
    • pp.41-48
    • /
    • 2005
  • This paper presents the development of a morphological processor for the Mongolian language, based on the two-level morphological model which was introduced by Koskenniemi. The aim of the study is to provide Mongolian syntactic parsers with more effective information on word structure of Mongolian words. First hand written rules that are the core of this model are compiled into finite-state transducers by a rule tool. Output of the compiler was edited to clarity by hand whenever necessary. The rules file and lexicon presented in the paper describe the morphology of Mongolian nouns, adjectives and verbs. Although the rules illustrated are not sufficient for accounting all the processes of Mongolian lexical phonology, other necessary rules can be easily added when new words are supplemented to the lexicon file. The theoretical consideration of the paper is concluded in representation of the morphological phenomena of Mongolian by the general, language-independent framework of the two-level morphological model.

Color Image Segmentation Based on Morphological Operation and a Gaussian Mixture Model (모폴로지 연산과 가우시안 혼합 모형에 기반한 컬러 영상 분할)

  • Lee Myung-Eun;Park Soon-Young;Cho Wan-Hyun
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.43 no.3 s.309
    • /
    • pp.84-91
    • /
    • 2006
  • In this paper, we present a new segmentation algorithm for color images based on mathematical morphology and a Gaussian mixture model(GMM). We use the morphological operations to determine the number of components in a mixture model and to detect their modes of each mixture component. Next, we have adopted the GMM to represent the probability distribution of color feature vectors and used the deterministic annealing expectation maximization (DAEM) algorithm to estimate the parameters of the GMM that represents the multi-colored objects statistically. Finally, we segment the color image by using posterior probability of each pixel computed from the GMM. The experimental results show that the morphological operation is efficient to determine a number of components and initial modes of each component in the mixture model. And also it shows that the proposed DAEM provides a global optimal solution for the parameter estimation in the mixture model and the natural color images are segmented efficiently by using the GMM with parameters estimated by morphological operations and the DAEM algorithm.

Modeling of Fine Sediment Transport under Multiple Breakwaters of Surface-Piercing Type

  • Lee, J. L.;Oh, M. R.
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2004.05b
    • /
    • pp.557-562
    • /
    • 2004
  • A surface-piercing barrier model is presented for understanding morphological development in the sheltered region and investigating the main factors causing the severe accumulation. Surface-piercing structures like vertical barriers, surface docks and floating breakwaters are recently favored from the point of view of a marine scenario since they do not in general partition the natural sea. The numerical solutions are compared with experimental data on wave profiles and morphological change rates within a rectangular harbor of a constant depth protected by surface-piercing thin breakwaters as a simplified problem. Our numerical study involves several modules: 1) wave dynamics analyzed by a plane-wave approximation, 2) suspended sediment transport combined with sediment erosion-deposition model, and 3) concurrent morphological changes. Scattering waves are solved by using a plane wave method without inclusion of evanescent modes. Evanescent modes are only considered in predicting the reflection ratio against the vertical barrier and energy losses due to vortex shedding from the lower edge of plate are taken into account. A new relationship to relate the near-bed concentration to the depth-mean concentration is presented by analyzing the vertical structure of concentration. The numerical solutions were also compared with experimental data on morphological changes within a rectangular harbor of constant water depth. Through the numerical experiments, the vortex-induced flow appears to be not ignorable in predicting the morphological changes although the immersion depth of a plate is not deep.

  • PDF