• Title/Summary/Keyword: Language Model Network

Search Result 386, Processing Time 0.03 seconds

Network Traffic Analysis System Based on Data Engineering Methodology (데이터 엔지니어링 방법론을 기반으로한 네트워크 트래픽 분석 시스템)

  • Han, Young-Shin;Kim, Tae-Kyu;Jung, Jason J.;Jung, Chan-Ki;Lee, Chil-Gee
    • Journal of the Korea Society for Simulation
    • /
    • v.18 no.1
    • /
    • pp.27-34
    • /
    • 2009
  • Currently network users, especially the number of internet users, increase rapidly. Also, high quality of service is required and this requirement results a sudden network traffic increment. As a result, an efficient management system for huge network traffic becomes an important issue. Ontology/data engineering based context awareness using the System Entity Structure (SES) concepts enables network administrators to access traffic data easily and efficiently. The network traffic analysis system, which is studied in this paper, is designed and implemented based on a model and simulation using data engineering methodology to be avaiable in evaluating large network traffic data. Extensible Markup Language (XML) is used for metadata language in this system. The information which is extracted from the network traffic analysis system could be modeled and simulated in Discrete Event Simulation (DEVS) methodology for further works such as post simulation evaluation, web services, and etc.

Enhancing Recommender Systems by Fusing Diverse Information Sources through Data Transformation and Feature Selection

  • Thi-Linh Ho;Anh-Cuong Le;Dinh-Hong Vu
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.5
    • /
    • pp.1413-1432
    • /
    • 2023
  • Recommender systems aim to recommend items to users by taking into account their probable interests. This study focuses on creating a model that utilizes multiple sources of information about users and items by employing a multimodality approach. The study addresses the task of how to gather information from different sources (modalities) and transform them into a uniform format, resulting in a multi-modal feature description for users and items. This work also aims to transform and represent the features extracted from different modalities so that the information is in a compatible format for integration and contains important, useful information for the prediction model. To achieve this goal, we propose a novel multi-modal recommendation model, which involves extracting latent features of users and items from a utility matrix using matrix factorization techniques. Various transformation techniques are utilized to extract features from other sources of information such as user reviews, item descriptions, and item categories. We also proposed the use of Principal Component Analysis (PCA) and Feature Selection techniques to reduce the data dimension and extract important features as well as remove noisy features to increase the accuracy of the model. We conducted several different experimental models based on different subsets of modalities on the MovieLens and Amazon sub-category datasets. According to the experimental results, the proposed model significantly enhances the accuracy of recommendations when compared to SVD, which is acknowledged as one of the most effective models for recommender systems. Specifically, the proposed model reduces the RMSE by a range of 4.8% to 21.43% and increases the Precision by a range of 2.07% to 26.49% for the Amazon datasets. Similarly, for the MovieLens dataset, the proposed model reduces the RMSE by 45.61% and increases the Precision by 14.06%. Additionally, the experimental results on both datasets demonstrate that combining information from multiple modalities in the proposed model leads to superior outcomes compared to relying on a single type of information.

Network Management Script Construction in Delegation Model (위임 모델에서의 네트워크 관리 스크립트 작성에 관한 연구)

  • 한순희;이기현;조국현
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.17 no.11
    • /
    • pp.1228-1237
    • /
    • 1992
  • Network management represents those activities which control and moitor the use of resources. Remote delegation model supports flexible and effective distribution of management functions among managers and agents, and it may cause an reliable network management in a relatively complex and high-speed networks. in this model, managers delegate to agents execution of management programs as prescribed in a management scripting language. In addition, primitives included in the management programs enable agents to monitor and control localmanaged objects effectively. We suggest management algorithms in which management scripts are delegated from managers to agents and partiality implement OSI fault management. This mans gement algorithm can effectively support delegation and control concurrent accesses to management information. Moreover, it can be easily translated into object-based concurrent programming language: ABCL. In this paper, we will scrutinize some essential aspects of this management.

  • PDF

A Study on Image Generation from Sentence Embedding Applying Self-Attention (Self-Attention을 적용한 문장 임베딩으로부터 이미지 생성 연구)

  • Yu, Kyungho;No, Juhyeon;Hong, Taekeun;Kim, Hyeong-Ju;Kim, Pankoo
    • Smart Media Journal
    • /
    • v.10 no.1
    • /
    • pp.63-69
    • /
    • 2021
  • When a person sees a sentence and understands the sentence, the person understands the sentence by reminiscent of the main word in the sentence as an image. Text-to-image is what allows computers to do this associative process. The previous deep learning-based text-to-image model extracts text features using Convolutional Neural Network (CNN)-Long Short Term Memory (LSTM) and bi-directional LSTM, and generates an image by inputting it to the GAN. The previous text-to-image model uses basic embedding in text feature extraction, and it takes a long time to train because images are generated using several modules. Therefore, in this research, we propose a method of extracting features by using the attention mechanism, which has improved performance in the natural language processing field, for sentence embedding, and generating an image by inputting the extracted features into the GAN. As a result of the experiment, the inception score was higher than that of the model used in the previous study, and when judged with the naked eye, an image that expresses the features well in the input sentence was created. In addition, even when a long sentence is input, an image that expresses the sentence well was created.

Classification and prediction of the effects of nutritional intake on diabetes mellitus using artificial neural network sensitivity analysis: 7th Korea National Health and Nutrition Examination Survey

  • Kyungjin Chang;Songmin Yoo;Simyeol Lee
    • Nutrition Research and Practice
    • /
    • v.17 no.6
    • /
    • pp.1255-1266
    • /
    • 2023
  • BACKGROUND/OBJECTIVES: This study aimed to predict the association between nutritional intake and diabetes mellitus (DM) by developing an artificial neural network (ANN) model for older adults. SUBJECTS/METHODS: Participants aged over 65 years from the 7th (2016-2018) Korea National Health and Nutrition Examination Survey were included. The diagnostic criteria of DM were set as output variables, while various nutritional intakes were set as input variables. An ANN model comprising one input layer with 16 nodes, one hidden layer with 12 nodes, and one output layer with one node was implemented in the MATLAB® programming language. A sensitivity analysis was conducted to determine the relative importance of the input variables in predicting the output. RESULTS: Our DM-predicting neural network model exhibited relatively high accuracy (81.3%) with 11 nutrient inputs, namely, thiamin, carbohydrates, potassium, energy, cholesterol, sugar, vitamin A, riboflavin, protein, vitamin C, and fat. CONCLUSIONS: In this study, the neural network sensitivity analysis method based on nutrient intake demonstrated a relatively accurate classification and prediction of DM in the older population.

European Integration Processes for the Development of Future Foreign Language Specialists in the Information Society

  • Lazarenko, Natalia;Zadorozhna, Olga;Prybora, Tetiana;Shevchuk, Аndrii;Sulym, Volodymyr;Rudnytska, Nataliya
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.12spc
    • /
    • pp.427-436
    • /
    • 2021
  • The article reveals and theoretically substantiates the trends of foreign language teachers' professional training in universities of Ukraine in terms of European integration, which are systematized in three areas: macro-level (system of education), meso-level (universities) and micro-level (subjects of educational process). The article aims to substantiate the trends of foreign language teacher training in the context of European integration and the main directions of creative use of constructive ideas of European experience in the innovative development of education. The article lights up the system for improving foreign language teacher training in universities, which is based on updated goals, content and approaches to the implementation of basic concepts, principles and features of teacher training in European experience, enable us to improve the quality of teacher training, its competitiveness in the European labor market. In the article developed the conceptual model of strategic development of the university in the conditions of European integration. It is emphasized that information technologies provide great opportunities for the development of professional skills and intellectual potential of future professionals. At present, the computerization of the educational process in higher education institutions is considered as one of the first and most promising areas for improving the quality of education. The article offered directions of internationalization of educational activity of university in the conditions of European integration. Diagnostic tools for the development of the university in terms of integration into the European educational space, individual rating and ranking of structural units of the university have been developed; main directions of activity of the laboratory of the skill of the teacher of higher school and methodical recommendations on the creation and the organization of work of scientific laboratories.

A Study on Categorization of Korean News Article based on CNN using Doc2Vec (Doc2Vec을 활용한 CNN기반 한국어 신문기사 분류에 관한 연구)

  • Kim, Do-Woo;Koo, Myoung-Wan
    • Annual Conference on Human and Language Technology
    • /
    • 2016.10a
    • /
    • pp.67-71
    • /
    • 2016
  • 본 논문에서는 word2vec과 doc2vec을 함께 CNN에 적용한 문서 분류 방안을 제안한다. 먼저 어절, 형태소, WPM(Word Piece Model)을 각각 사용하여 생성한 토큰(token)으로 doc2vec을 활용하여 문서를 vector로 표현한 후, 초보적인 문서 분류에 적용한 결과 WPM이 분류율 79.5%가 되어 3가지 방법 중 최고 성능을 보였다. 다음으로 CNN의 입력자질로써 WPM을 이용하여 생성한 토큰을 활용한 word2vec을 범주 10개의 문서 분류에 사용한 실험과 doc2vec을 함께 사용한 실험을 수행하였다. 실험 결과 word2vec만을 활용하였을 때 86.89%의 분류율을 얻었고, doc2vec을 함께 적용한 결과 89.51%의 분류율을 얻었다. 따라서 제안한 모델을 통해서 분류율이 2.62% 향상됨을 확인하였다.

  • PDF

PASS: A Parallel Speech Understanding System

  • Chung, Sang-Hwa
    • Journal of Electrical Engineering and information Science
    • /
    • v.1 no.1
    • /
    • pp.1-9
    • /
    • 1996
  • A key issue in spoken language processing has become the integration of speech understanding and natural language processing(NLP). This paper presents a parallel computational model for the integration of speech and NLP. The model adopts a hierarchically-structured knowledge base and memory-based parsing techniques. Processing is carried out by passing multiple markers in parallel through the knowledge base. Speech-specific problems such as insertion, deletion, and substitution have been analyzed and their parallel solutions are provided. The complete system has been implemented on the Semantic Network Array Processor(SNAP) and is operational. Results show an 80% sentence recognition rate for the Air Traffic Control domain. Moreover, a 15-fold speed-up can be obtained over an identical sequential implementation with an increasing speed advantage as the size of the knowledge base grows.

  • PDF

Word Segmentation and POS tagging using Seq2seq Attention Model (seq2seq 주의집중 모델을 이용한 형태소 분석 및 품사 태깅)

  • Chung, Euisok;Park, Jeon-Gue
    • 한국어정보학회:학술대회논문집
    • /
    • 2016.10a
    • /
    • pp.217-219
    • /
    • 2016
  • 본 논문은 형태소 분석 및 품사 태깅을 위해 seq2seq 주의집중 모델을 이용하는 접근 방법에 대하여 기술한다. seq2seq 모델은 인코더와 디코더로 분할되어 있고, 일반적으로 RNN(recurrent neural network)를 기반으로 한다. 형태소 분석 및 품사 태깅을 위해 seq2seq 모델의 학습 단계에서 음절 시퀀스는 인코더의 입력으로, 각 음절에 해당하는 품사 태깅 시퀀스는 디코더의 출력으로 사용된다. 여기서 음절 시퀀스와 품사 태깅 시퀀스의 대응관계는 주의집중(attention) 모델을 통해 접근하게 된다. 본 연구는 사전 정보나 자질 정보와 같은 추가적 리소스를 배제한 end-to-end 접근 방법의 실험 결과를 제시한다. 또한, 디코딩 단계에서 빔(beam) 서치와 같은 추가적 프로세스를 배제하는 접근 방법을 취한다.

  • PDF

Some (Re)views on ELT Research: With Reference to World Englishes and/or English Lingua Franca

  • Cho, Myongwon
    • Korean Journal of English Language and Linguistics
    • /
    • v.2 no.1
    • /
    • pp.123-147
    • /
    • 2002
  • As far as the recent ELT research concerned, it seems to have been no hot ‘theoretical’ issues, but ‘practical’ ones in general: e.g., learners and learning, components of proficiency, correlates of L2 learning, etc. This paper focuses on the theme given above, with a special reference to the sub-title: specifically, 1) World English, world Englishes and world's lingua franca; 2) ENL, ESL and EFL; 3) Grammars, style manuals, dictionaries and media; 4) Pronunciation models: RP, BBC model and General American, Network Standard; 5) Lexical, grammatical variations and discourse grammars; 6) Beliefs and subjective theories in foreign language research; 7) Dilemma among radical, canonical and eclectic views. In conclusion, the author offers a modest proposal: we need to appeal to our own experience, intention, feeling and purpose, that is, our identity to express “our own selves” in our contexts toward the world anywhere, if not sounding authentic enough, but producing it plausibly well. It is time for us (with our ethno-cultural autonomy) to need to be complementary to and parallel with its native speakers' linguistic-cultural authenticity in terms of the broadest mutual understanding.

  • PDF