• Title/Summary/Keyword: Loss Rate

Search Result 5,214, Processing Time 0.029 seconds

A Study of Anomaly Detection for ICT Infrastructure using Conditional Multimodal Autoencoder (ICT 인프라 이상탐지를 위한 조건부 멀티모달 오토인코더에 관한 연구)

  • Shin, Byungjin;Lee, Jonghoon;Han, Sangjin;Park, Choong-Shik
    • Journal of Intelligence and Information Systems
    • /
    • v.27 no.3
    • /
    • pp.57-73
    • /
    • 2021
  • Maintenance and prevention of failure through anomaly detection of ICT infrastructure is becoming important. System monitoring data is multidimensional time series data. When we deal with multidimensional time series data, we have difficulty in considering both characteristics of multidimensional data and characteristics of time series data. When dealing with multidimensional data, correlation between variables should be considered. Existing methods such as probability and linear base, distance base, etc. are degraded due to limitations called the curse of dimensions. In addition, time series data is preprocessed by applying sliding window technique and time series decomposition for self-correlation analysis. These techniques are the cause of increasing the dimension of data, so it is necessary to supplement them. The anomaly detection field is an old research field, and statistical methods and regression analysis were used in the early days. Currently, there are active studies to apply machine learning and artificial neural network technology to this field. Statistically based methods are difficult to apply when data is non-homogeneous, and do not detect local outliers well. The regression analysis method compares the predictive value and the actual value after learning the regression formula based on the parametric statistics and it detects abnormality. Anomaly detection using regression analysis has the disadvantage that the performance is lowered when the model is not solid and the noise or outliers of the data are included. There is a restriction that learning data with noise or outliers should be used. The autoencoder using artificial neural networks is learned to output as similar as possible to input data. It has many advantages compared to existing probability and linear model, cluster analysis, and map learning. It can be applied to data that does not satisfy probability distribution or linear assumption. In addition, it is possible to learn non-mapping without label data for teaching. However, there is a limitation of local outlier identification of multidimensional data in anomaly detection, and there is a problem that the dimension of data is greatly increased due to the characteristics of time series data. In this study, we propose a CMAE (Conditional Multimodal Autoencoder) that enhances the performance of anomaly detection by considering local outliers and time series characteristics. First, we applied Multimodal Autoencoder (MAE) to improve the limitations of local outlier identification of multidimensional data. Multimodals are commonly used to learn different types of inputs, such as voice and image. The different modal shares the bottleneck effect of Autoencoder and it learns correlation. In addition, CAE (Conditional Autoencoder) was used to learn the characteristics of time series data effectively without increasing the dimension of data. In general, conditional input mainly uses category variables, but in this study, time was used as a condition to learn periodicity. The CMAE model proposed in this paper was verified by comparing with the Unimodal Autoencoder (UAE) and Multi-modal Autoencoder (MAE). The restoration performance of Autoencoder for 41 variables was confirmed in the proposed model and the comparison model. The restoration performance is different by variables, and the restoration is normally well operated because the loss value is small for Memory, Disk, and Network modals in all three Autoencoder models. The process modal did not show a significant difference in all three models, and the CPU modal showed excellent performance in CMAE. ROC curve was prepared for the evaluation of anomaly detection performance in the proposed model and the comparison model, and AUC, accuracy, precision, recall, and F1-score were compared. In all indicators, the performance was shown in the order of CMAE, MAE, and AE. Especially, the reproduction rate was 0.9828 for CMAE, which can be confirmed to detect almost most of the abnormalities. The accuracy of the model was also improved and 87.12%, and the F1-score was 0.8883, which is considered to be suitable for anomaly detection. In practical aspect, the proposed model has an additional advantage in addition to performance improvement. The use of techniques such as time series decomposition and sliding windows has the disadvantage of managing unnecessary procedures; and their dimensional increase can cause a decrease in the computational speed in inference.The proposed model has characteristics that are easy to apply to practical tasks such as inference speed and model management.

A Study on Development of New Products by Old Chicken Meat (노폐계(老廢鷄)를 이용(利用)한 육제품(肉製品) 개발(開發)에 관한 연구(硏究))

  • Han, Sung Wook;Lee, Kyu Seung;Chang, Kyu Sup;Jeon, Chang Kie
    • Korean Journal of Agricultural Science
    • /
    • v.7 no.2
    • /
    • pp.87-102
    • /
    • 1980
  • In order to investigate the utilization probability of two years old laying hen for W.L. and R.I.R. breeds, carcass weight and percentage were examined and dried old chicken meat products were manufactured for experiments. The results obtained are as follows. 1. Average living body weight were 1,635.40g for the W.L. breeds and 2,289.29g for the R.I.R. breeds and percentage carcass and lean meat for the W.L. were 58.73% and 43.95%, for the R.I.R. 60.34%, 41.98%, respectively. 2. In constitution percentage of carcass on different parts for W.L. and R.I.R. breeds, head were 4.13% and 3.94%, wing 9.97% and 8.62%, breast 32.54% and 20.94%, back 11.35% and 9.75%, thigh 30.75% and 31.34%, hypordermic fat 11.37% and 17.34%, respectively. 3. In constitution percentage of lean meat on different parts for W.L. and R.I.R. breeds, head were 4.03% and 3.95%, wing 9.47% and 9.79%, breast 39.37% and 38.14%, back 11.24% and 9.40%, thigh 36.16% and 38.74%, respectively. 4. In chemical composition of old chicken meat for W.L. breed, moisture was 68.18%, crude protein 22.80%, crude fat 2.70%, extract 5.15% and crude ash 1.18% and for R.I.R. breed, moisture was 68.04%, crude protein 22.18%, crude fat 3.13%, extract 5.45% and crude ash 1.21%. 5. Weight loss in steaming for W.L. at $121^{\circ}C$ for 30min., 60min., and 90min. were 54.91, 56.43 and 58.42%, respectively, and for R.I.R. were 45.23, 47.68 and 49.68%, respectively. 6. The yield of old chicken meat product per a hen were 253.01g for W.L. and 368.64g for R.I.R., the ratio for fresh meat weight and for carcass weight were 35.47% and 26.34% for W.L. breed and 38.25 and 26.83% for R.I.R. breed. 7. In chemical composition of old chicken meat product for W.L., moisture was 16.69%, crude protein 66.16%, crude fat 12.81%, crude ash 4.35%, and R.I.R., moisture 16.11%, crude protein 65.95%, crude fat 13.78% and crude ash 4.57%. 8. To investigate the physical properties which was main factor affecting the product quality, tensile strength, tear strength and elongation rate were measured. The adhesive force of the product made under pressure of $70kg/cm^2$ was similar to those of chipo which was the control product. 9. When measured the color of each protein product, lightness of the product pressed at $70kg/cm^2$ was better than that at $35kg/cm^2$, and the lightness of breast muscle product at $70kg/cm^2$ and chipo was not significant as 16.7% and 16.4%, respectively. Dominant wavelength of product pressed at $70kg/cm^2$ was very similar to chipo which was yellowish orange. 10. In the results of sensory evaluation test containing taste, color, chewing texture and oder of the meat product, when index of chipo as control product was 100, index of breast meat product was higher than that as 118.4, but miscellaneous product was 99.7 and thigh product was 96.2. 11. Summing up the results written above, the meat product utilizing two years old laying hen was compared favorably with its similar food such as chipo on the point of nutrition and physical properties as high protein food, therefore, it was thought that industrialization must be highly appropriate.

  • PDF

Clinical Characteristics of Pulmonary Aspergilloma (폐국균종의 임상적 고찰)

  • Kang, Tae-Kyung;Kim, Chang-Ho;Park, Jae-Yong;Jung, Tae-Hoon;Sohn, Jeong-Ho;Lee, Jun-Ho;Han, Seong-Beom;Jeon, Young-Jun;Kim, Ki-Beom;Chung, Jin-Hong;Lee, Kwan-Ho;Lee, Hyun-Woo;Shin, Hyeon-Soo;Lee, Sang-Chae;Kweon, Sam
    • Tuberculosis and Respiratory Diseases
    • /
    • v.44 no.6
    • /
    • pp.1308-1317
    • /
    • 1997
  • Background : Pulmonary aspergillomas usually arise from colonization and proliferation of Aspergillus in preexisting cavitary lung disease of any cause. About 15% of patients with tuberculous pulmonary cavities were found to have aspergilloma. We analyzed the clinical features and course of 91 patients with pulmonary aspergilloma. Method : During the ten-year period from June 1986 to May 1996, 91 patients whose condition was diagnosed as pulmonary aspergilloma at 4 university hospitals in Taegu city were reviewed. All patients fulfilled one of the following criteria : 1) histologic evidence of aspergilloma within abnormal air space in tissue sections, or 2) a positive Aspergillus serum precipitin test with the radiologic finding of a fungus ball. The histological diagno-sis was established in 81 patients(89.0%) and clinical diagnosis in 10 patients(11.0%). Results : 1) The age range was 22 to 65 years, with an average of 45 years. A male and female ratio was 1.7 : 1 (57 men and 34 women). 2) Hemoptysis was far the most frequent symptom(89%), followed by cough, dyspnea, weakness, weight loss, fever, chest pain. 3) In all but 14 cases(15.4%) there had been associated conditions. Pulmonary tuberculosis was far the most frequent underlying condition found(74.7%), followed by bronchiectasis (6.6%), cavitary neoplasm(2.2%), pulmonary sequestration(1.1%). 4) The involved area was usually in the upper lobes; the right upper lobe was involved in 39(42.9%), the left upper lobe in 31(34.1%), the left lower lobe in 13(14.3%), the right lower lobe in 7(7.7%), and the right middle lobe in 1(1.1%). 5) On standard chest roent geno gram the classic "bell-like" image of a fungus ball was found in 62.6% of the subjects. On CT scan, 88.1% of the subjects in which they were done. 6) The surgical therapy was undertaken in 76 patients, and medical therapy in 15 patients, including 4 patients with intracavitary instillation of amphotericin B. 7) The surgical modality was lobectomy in 55 patients(72.4%), segmentectomy in 16 patients(21.1%), pneumonectomy in 4 patients(5.3%), wedge resection in 1 patient(1.3%). The mortality rate was 3.9% (3 patients) ; 2 patients died of sepsis and 1 died of hemoptysis. The postoperative complications were encountered in 6 patients (7.9%), including each one patient with respiratory failure, bleeding, bronchopleural fistula, empyema, and vocal cord paralysis. 8) In the follow-up cases, each 2 patients of 71 patients with surgical treatment and 10 patients with medical treatment had recurrent hemoptysis. Conclusion : During follow-up of the chronic pulmonary disease with abnormal air space, if the standard chest roentgenograms are insufficient to detect a fungus ball, computed tomographic scan and serum precipitin test are likely to aid the diagnosis of patients with suspected pulmonary aspergilloma. A reasonable recommendation for management of a patient with aspergilloma would be to reserve surgical resection for those patients who have had severe, recurrent hemoptysis. And a well controlled cooperative study to the medical treatment such as intracavitary antifungal therapy is further needed.

  • PDF

A Study on the Forest Yield Regulation by Systems Analysis (시스템분석(分析)에 의(依)한 삼림수확조절(森林收穫調節)에 관(關)한 연구(硏究))

  • Cho, Eung-hyouk
    • Korean Journal of Agricultural Science
    • /
    • v.4 no.2
    • /
    • pp.344-390
    • /
    • 1977
  • The purpose of this paper was to schedule optimum cutting strategy which could maximize the total yield under certain restrictions on periodic timber removals and harvest areas from an industrial forest, based on a linear programming technique. Sensitivity of the regulation model to variations in restrictions has also been analyzed to get information on the changes of total yield in the planning period. The regulation procedure has been made on the experimental forest of the Agricultural College of Seoul National University. The forest is composed of 219 cutting units, and characterized by younger age group which is very common in Korea. The planning period is devided into 10 cutting periods of five years each, and cutting is permissible only on the stands of age groups 5-9. It is also assumed in the study that the subsequent forests are established immediately after cutting existing forests, non-stocked forest lands are planted in first cutting period, and established forests are fully stocked until next harvest. All feasible cutting regimes have been defined to each unit depending on their age groups. Total yield (Vi, k) of each regime expected in the planning period has been projected using stand yield tables and forest inventory data, and the regime which gives highest Vi, k has been selected as a optimum cutting regime. After calculating periodic yields and cutting areas, and total yield from the optimum regimes selected without any restrictions, the upper and lower limits of periodic yields(Vj-max, Vj-min) and those of periodic cutting areas (Aj-max, Aj-min) have been decided. The optimum regimes under such restrictions have been selected by linear programming. The results of the study may be summarized as follows:- 1. The fluctuations of periodic harvest yields and areas under cutting regimes selected without restrictions were very great, because of irregular composition of age classes and growing stocks of existing stands. About 68.8 percent of total yield is expected in period 10, while none of yield in periods 6 and 7. 2. After inspection of the above solution, restricted optimum cutting regimes were obtained under the restrictions of Amin=150 ha, Amax=400ha, $Vmin=5,000m^3$ and $Vmax=50,000m^3$, using LP regulation model. As a result, about $50,000m^3$ of stable harvest yield per period and a relatively balanced age group distribution is expected from period 5. In this case, the loss in total yield was about 29 percent of that of unrestricted regimes. 3. Thinning schedule could be easily treated by the model presented in the study, and the thinnings made it possible to select optimum regimes which might be effective for smoothing the wood flows, not to speak of increasing total yield in the planning period. 4. It was known that the stronger the restrictions becomes in the optimum solution the earlier the period comes in which balanced harvest yields and age group distribution can be formed. There was also a tendency in this particular case that the periodic yields were strongly affected by constraints, and the fluctuations of harvest areas depended upon the amount of periodic yields. 5. Because the total yield was decreased at the increasing rate with imposing stronger restrictions, the Joss would be very great where strict sustained yield and normal age group distribution are required in the earlier periods. 6. Total yield under the same restrictions in a period was increased by lowering the felling age and extending the range of cutting age groups. Therefore, it seemed to be advantageous for producing maximum timber yield to adopt wider range of cutting age groups with the lower limit at which the smallest utilization size of timber could be produced. 7. The LP regulation model presented in the study seemed to be useful in the Korean situation from the following point of view: (1) The model can provide forest managers with the solution of where, when, and how much to cut in order to best fulfill the owners objective. (2) Planning is visualized as a continuous process where new strateges are automatically evolved as changes in the forest environment are recognized. (3) The cost (measured as decrease in total yield) of imposing restrictions can be easily evaluated. (4) Thinning schedule can be treated without difficulty. (5) The model can be applied to irregular forests. (6) Traditional regulation methods can be rainforced by the model.

  • PDF