• Title/Summary/Keyword: Normal learning

Search Result 802, Processing Time 0.027 seconds

Comparative Study of Anomaly Detection Accuracy of Intrusion Detection Systems Based on Various Data Preprocessing Techniques (다양한 데이터 전처리 기법 기반 침입탐지 시스템의 이상탐지 정확도 비교 연구)

  • Park, Kyungseon;Kim, Kangseok
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.10 no.11
    • /
    • pp.449-456
    • /
    • 2021
  • An intrusion detection system is a technology that detects abnormal behaviors that violate security, and detects abnormal operations and prevents system attacks. Existing intrusion detection systems have been designed using statistical analysis or anomaly detection techniques for traffic patterns, but modern systems generate a variety of traffic different from existing systems due to rapidly growing technologies, so the existing methods have limitations. In order to overcome this limitation, study on intrusion detection methods applying various machine learning techniques is being actively conducted. In this study, a comparative study was conducted on data preprocessing techniques that can improve the accuracy of anomaly detection using NGIDS-DS (Next Generation IDS Database) generated by simulation equipment for traffic in various network environments. Padding and sliding window were used as data preprocessing, and an oversampling technique with Adversarial Auto-Encoder (AAE) was applied to solve the problem of imbalance between the normal data rate and the abnormal data rate. In addition, the performance improvement of detection accuracy was confirmed by using Skip-gram among the Word2Vec techniques that can extract feature vectors of preprocessed sequence data. PCA-SVM and GRU were used as models for comparative experiments, and the experimental results showed better performance when sliding window, skip-gram, AAE, and GRU were applied.

DoS/DDoS attacks Detection Algorithm and System using Packet Counting (패킷 카운팅을 이용한 DoS/DDoS 공격 탐지 알고리즘 및 이를 이용한 시스템)

  • Kim, Tae-Won;Jung, Jae-Il;Lee, Joo-Young
    • Journal of the Korea Society for Simulation
    • /
    • v.19 no.4
    • /
    • pp.151-159
    • /
    • 2010
  • Currently, by using the Internet, We can do varius things such as Web surfing, email, on-line shopping, stock trading on your home or office. However, as being out of the concept of security from the beginning, it is the big social issues that malicious user intrudes into the system through the network, on purpose to steal personal information or to paralyze system. In addition, network intrusion by ordinary people using network attack tools is bringing about big worries, so that the need for effective and powerful intrusion detection system becomes very important issue in our Internet environment. However, it is very difficult to prevent this attack perfectly. In this paper we proposed the algorithm for the detection of DoS attacks, and developed attack detection tools. Through learning in a normal state on Step 1, we calculate thresholds, the number of packets that are coming to each port, the median and the average utilization of each port on Step 2. And we propose values to determine how to attack detection on Step 3. By programing proposed attack detection algorithm and by testing the results, we can see that the difference between the median of packet mounts for unit interval and the average utilization of each port number is effective in detecting attacks. Also, without the need to look into the network data, we can easily be implemented by only using the number of packets to detect attacks.

Study on Image Use for Plant Disease Classification (작물의 병충해 분류를 위한 이미지 활용 방법 연구)

  • Jeong, Seong-Ho;Han, Jeong-Eun;Jeong, Seong-Kyun;Bong, Jae-Hwan
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.17 no.2
    • /
    • pp.343-350
    • /
    • 2022
  • It is worth verifying the effectiveness of data integration between data with different features. This study investigated whether the data integration affects the accuracy of deep neural network (DNN), and which integration method shows the best improvement. This study used two different public datasets. One public dataset was taken in an actual farm in India. And another was taken in a laboratory environment in Korea. Leaf images were selected from two different public datasets to have five classes which includes normal and four different types of plant diseases. DNN used pre-trained VGG16 as a feature extractor and multi-layer perceptron as a classifier. Data were integrated into three different ways to be used for the training process. DNN was trained in a supervised manner via the integrated data. The trained DNN was evaluated by using a test dataset taken in an actual farm. DNN shows the best accuracy for the test dataset when DNN was first trained by images taken in the laboratory environment and then trained by images taken in the actual farm. The results show that data integration between plant images taken in a different environment helps improve the performance of deep neural networks. And the results also confirmed that independent use of plant images taken in different environments during the training process is more effective in improving the performance of DNN.

Case Study on the Pre-Service Earth Science Teachers' Faults Discrimination on Geological Map using Eye Tracker (시선 추적기를 활용한 지질도에서 예비 지구과학교사들의 단층 판별에 대한 사례 연구)

  • Woong Hyeon Jeon;Duk Ho Chung;Chul Min Lee
    • Journal of the Korean earth science society
    • /
    • v.44 no.3
    • /
    • pp.210-221
    • /
    • 2023
  • The purpose of this study is to evaluate the content knowledge and problem solving process used by pre-service earth science teachers while discriminating faults on geological maps. For this, we collected and evaluated data on fixation duration and gaze plot, while pre-service earth science teachers (N=12) solved the problem on faults interpretation using an eye tracker (Tobii Pro Glass 2 model). The results were as follows. First, most of the pre-service earth science teachers know the concepts of the normal and reverse fault but they do not know the procedural knowledge essential for fault interpretation on geological maps. Second, the pre-service earth science teachers did not draw a geological cross-sectional map to interpret the fault on the geological map and interpreted the fault based on two-dimensional information collected from the geological map rather than three-dimensional information. Therefore, it is essential to improve the teaching and learning environment so that pre-service earth science teachers who will become earth science teachers in the future can learn procedural knowledge essential to comprehend natural phenomena including understanding natural phenomena. The results of this study can substantially help organize a new earth science curriculum or develop materials on teachers' education in the future.

Development of Agricultural Products Screening System through X-ray Density Analysis

  • Eunhyeok Baek;Young-Tae Kwak
    • Journal of the Korea Society of Computer and Information
    • /
    • v.28 no.4
    • /
    • pp.105-112
    • /
    • 2023
  • In this paper, we propose a new method for displaying colored defects by measuring the relative density with the wide-area and local densities of X-ray. The relative density of one pixel represents a relative difference from the surrounding pixels, and we also suggest a colorization of X-ray images representing these pixels as normal and defective. The traditional method mainly inspects materials such as plastics and metals, which have large differences in transmittance to the object. Our proposed method can be used to detect defects such as sprouts or holes in images obtained by an inspection machine that detects X-rays. In the experiment, the products that could not be seen with the naked eye were colored with pests or sprouts in a specific color so that they could be used in the agricultural product selection system. Products that are uniformly filled with a single ingredient inside, such as potatoes, carrots, and apples, can be detected effectively. However, it does not work well with bumpy products, such as peppers and paprika. The advantage of this method is that, unlike machine learning, it doesn't require large amounts of data. The proposed method could be applied to a screening system using X-rays and used not only in agricultural product screening systems but also in manufacturing processes such as processed food and parts manufacturing, so that it can be actively used to select defective products.

Mapping Mammalian Species Richness Using a Machine Learning Algorithm (머신러닝 알고리즘을 이용한 포유류 종 풍부도 매핑 구축 연구)

  • Zhiying Jin;Dongkun Lee;Eunsub Kim;Jiyoung Choi;Yoonho Jeon
    • Journal of Environmental Impact Assessment
    • /
    • v.33 no.2
    • /
    • pp.53-63
    • /
    • 2024
  • Biodiversity holds significant importance within the framework of environmental impact assessment, being utilized in site selection for development, understanding the surrounding environment, and assessing the impact on species due to disturbances. The field of environmental impact assessment has seen substantial research exploring new technologies and models to evaluate and predict biodiversity more accurately. While current assessments rely on data from fieldwork and literature surveys to gauge species richness indices, limitations in spatial and temporal coverage underscore the need for high-resolution biodiversity assessments through species richness mapping. In this study, leveraging data from the 4th National Ecosystem Survey and environmental variables, we developed a species distribution model using Random Forest. This model yielded mapping results of 24 mammalian species' distribution, utilizing the species richness index to generate a 100-meter resolution map of species richness. The research findings exhibited a notably high predictive accuracy, with the species distribution model demonstrating an average AUC value of 0.82. In addition, the comparison with National Ecosystem Survey data reveals that the species richness distribution in the high-resolution species richness mapping results conforms to a normal distribution. Hence, it stands as highly reliable foundational data for environmental impact assessment. Such research and analytical outcomes could serve as pivotal new reference materials for future urban development projects, offering insights for biodiversity assessment and habitat preservation endeavors.

LymphanaxTM Enhances Lymphangiogenesis in an Artificial Human Skin Model, Skin-lymph-on-a-chip (스킨-림프-칩 상에서 LymphanaxTM 의 림프 형성 촉진능)

  • Phil June Park;Minseop Kim;Sieun Choi;Hyun Soo Kim;Seok Chung
    • Journal of the Society of Cosmetic Scientists of Korea
    • /
    • v.50 no.2
    • /
    • pp.119-129
    • /
    • 2024
  • The cutaneous lymphatic system in humans plays a crucial role in draining interstitial fluid and activating the immune system. Environmental factors, such as ultraviolet light and natural aging, often affect structural changes of such lymphatic vessels, causing skin dysfunction. However, some limitations still exist because of no alternatives to animal testing. To better understand the skin lymphatic system, a biomimetic microfluidic platform, skin-lymph-on-a-chip, was fabricated to develop a novel in vitro skin lymphatic model of humans and to investigate the molecular and physiological changes involved in lymphangiogenesis, the formation of lymphatic vessels. Briefly, the platform involved co-culturing differentiated primary normal human epidermal keratinocytes (NHEKs) and dermal lymphatic endothelial cells (HDLECs) in vitro. Based on our system, LymphanaxTM, which is a condensed Panax ginseng root extract obtained through thermal conversion for 21 days, was applied to evaluate the lymphangiogenic effect, and the changes in molecular factors were analyzed using a deep-learning-based algorithm. LymphanaxTM promoted healthy lymphangiogenesis in skin-lymphon-a-chip and indirectly affected HDELCs as its components rarely penetrated differentiated NHEKs in the chip. Overall, this study provides a new perspective on LymphanaxTM and its effects using an innovative in vitro system.

The Case Study of SW Education for Slow Youth Learners (느린 학습자 청년 대상 소프트웨어교육 사례연구)

  • Ryoo Eunjin;Park juyeon
    • The Journal of the Convergence on Culture Technology
    • /
    • v.10 no.2
    • /
    • pp.127-131
    • /
    • 2024
  • SW education was conducted for slow youth learners. 6 learners participatd in 8 sessions of an introductory course using several plays and 3 learners who more interested in introductory course participated in deeper course using normal method. After education, we survey and interview from learners, instructors and heads of welfare organizations. Learners showed interest and participated in the fact that they were participating in SW education, which was widely talked about. Learners were found to be more satisfied with introductory course education using play such as board games, and although they initially appeared to participate in unfamiliar learning content with low efficacy, it was observed that their efficacy increased with repetition. Additionally, it was observed that young people with an IQ of 80 or higher had a higher level of interest or interest in SW education than those with an IQ of 80 or lower. we discussed that there were not many opportunities to directly use the SW education content for youth who are slow learners in work or real life. We suggest this should be a focus education on the use of digital media - online meeting apps, office SW etc.- to improve digital literacy for life and work and that research on this should continue.

Automatic Detection and Classification of Rib Fractures on Thoracic CT Using Convolutional Neural Network: Accuracy and Feasibility

  • Qing-Qing Zhou;Jiashuo Wang;Wen Tang;Zhang-Chun Hu;Zi-Yi Xia;Xue-Song Li;Rongguo Zhang;Xindao Yin;Bing Zhang;Hong Zhang
    • Korean Journal of Radiology
    • /
    • v.21 no.7
    • /
    • pp.869-879
    • /
    • 2020
  • Objective: To evaluate the performance of a convolutional neural network (CNN) model that can automatically detect and classify rib fractures, and output structured reports from computed tomography (CT) images. Materials and Methods: This study included 1079 patients (median age, 55 years; men, 718) from three hospitals, between January 2011 and January 2019, who were divided into a monocentric training set (n = 876; median age, 55 years; men, 582), five multicenter/multiparameter validation sets (n = 173; median age, 59 years; men, 118) with different slice thicknesses and image pixels, and a normal control set (n = 30; median age, 53 years; men, 18). Three classifications (fresh, healing, and old fracture) combined with fracture location (corresponding CT layers) were detected automatically and delivered in a structured report. Precision, recall, and F1-score were selected as metrics to measure the optimum CNN model. Detection/diagnosis time, precision, and sensitivity were employed to compare the diagnostic efficiency of the structured report and that of experienced radiologists. Results: A total of 25054 annotations (fresh fracture, 10089; healing fracture, 10922; old fracture, 4043) were labelled for training (18584) and validation (6470). The detection efficiency was higher for fresh fractures and healing fractures than for old fractures (F1-scores, 0.849, 0.856, 0.770, respectively, p = 0.023 for each), and the robustness of the model was good in the five multicenter/multiparameter validation sets (all mean F1-scores > 0.8 except validation set 5 [512 x 512 pixels; F1-score = 0.757]). The precision of the five radiologists improved from 80.3% to 91.1%, and the sensitivity increased from 62.4% to 86.3% with artificial intelligence-assisted diagnosis. On average, the diagnosis time of the radiologists was reduced by 73.9 seconds. Conclusion: Our CNN model for automatic rib fracture detection could assist radiologists in improving diagnostic efficiency, reducing diagnosis time and radiologists' workload.

Development of an Anomaly Detection Algorithm for Verification of Radionuclide Analysis Based on Artificial Intelligence in Radioactive Wastes (방사성폐기물 핵종분석 검증용 이상 탐지를 위한 인공지능 기반 알고리즘 개발)

  • Seungsoo Jang;Jang Hee Lee;Young-su Kim;Jiseok Kim;Jeen-hyeng Kwon;Song Hyun Kim
    • Journal of Radiation Industry
    • /
    • v.17 no.1
    • /
    • pp.19-32
    • /
    • 2023
  • The amount of radioactive waste is expected to dramatically increase with decommissioning of nuclear power plants such as Kori-1, the first nuclear power plant in South Korea. Accurate nuclide analysis is necessary to manage the radioactive wastes safely, but research on verification of radionuclide analysis has yet to be well established. This study aimed to develop the technology that can verify the results of radionuclide analysis based on artificial intelligence. In this study, we propose an anomaly detection algorithm for inspecting the analysis error of radionuclide. We used the data from 'Updated Scaling Factors in Low-Level Radwaste' (NP-5077) published by EPRI (Electric Power Research Institute), and resampling was performed using SMOTE (Synthetic Minority Oversampling Technique) algorithm to augment data. 149,676 augmented data with SMOTE algorithm was used to train the artificial neural networks (classification and anomaly detection networks). 324 NP-5077 report data verified the performance of networks. The anomaly detection algorithm of radionuclide analysis was divided into two modules that detect a case where radioactive waste was incorrectly classified or discriminate an abnormal data such as loss of data or incorrectly written data. The classification network was constructed using the fully connected layer, and the anomaly detection network was composed of the encoder and decoder. The latter was operated by loading the latent vector from the end layer of the classification network. This study conducted exploratory data analysis (i.e., statistics, histogram, correlation, covariance, PCA, k-mean clustering, DBSCAN). As a result of analyzing the data, it is complicated to distinguish the type of radioactive waste because data distribution overlapped each other. In spite of these complexities, our algorithm based on deep learning can distinguish abnormal data from normal data. Radionuclide analysis was verified using our anomaly detection algorithm, and meaningful results were obtained.