• IEMEK Journal of Embedded Systems and Applications
• /
• v.16 no.4
• /
• pp.145-151
• /
• 2021

In this paper, we propose a novel visualization technique to explain the predictions of deep neural networks. We use knowledge distillation (KD) to identify the interior of a black-box model for which we know only inputs and outputs. The information of the black box model will be transferred to a white box model that we aim to create through the KD. The white box model will learn the representation of the black-box model. Second, the white-box model generates attention maps for each of its layers using Grad-CAM. Then we combine the attention maps of different layers using the pixel-wise summation to generate a final saliency map that contains information from all layers of the model. The experiments show that the proposed technique found important layers and explained which part of the input is important. Saliency maps generated by the proposed technique performed better than those of Grad-CAM in deletion game.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.17 no.2
• /
• pp.335-352
• /
• 2023

When solving multi-objective optimization problems, the blindness of the evolution direction of the population gradually emerges with the increase in the number of objectives, and there are also problems of convergence and diversity that are difficult to balance. The many- objective optimization problem makes some classic multi-objective optimization algorithms face challenges due to the huge objective space. The sine cosine algorithm is a new type of natural simulation optimization algorithm, which uses the sine and cosine mathematical model to solve the optimization problem. In this paper, a knee-driven many-objective sine-cosine algorithm (MaSCA-KD) is proposed. First, the Latin hypercube population initialization strategy is used to generate the initial population, in order to ensure that the population is evenly distributed in the decision space. Secondly, special points in the population, such as nadir point and knee points, are adopted to increase selection pressure and guide population evolution. In the process of environmental selection, the diversity of the population is promoted through diversity criteria. Through the above strategies, the balance of population convergence and diversity is achieved. Experimental research on the WFG series of benchmark problems shows that the MaSCA-KD algorithm has a certain degree of competitiveness compared with the existing algorithms. The algorithm has good performance and can be used as an alternative tool for many-objective optimization problems.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2021.07a
• /
• pp.313-315
• /
• 2021

Timely and accurate diagnosis of lung diseases using Chest X-ray images has been gained much attention from the computer vision and medical imaging communities. Although previous studies have presented the capability of deep convolutional neural networks by achieving competitive binary classification results, their models were seemingly unreliable to effectively distinguish multiple disease groups using a large number of x-ray images. In this paper, we aim to build an advanced approach, so-called Ensemble Knowledge Distillation (EKD), to significantly boost the classification accuracies, compared to traditional KD methods by distilling knowledge from a cumbersome teacher model into an ensemble of lightweight student models with parallel branches trained with ground truth labels. Therefore, learning features at different branches of the student models could enable the network to learn diverse patterns and improve the qualify of final predictions through an ensemble learning solution. Although we observed that experiments on the well-established ChestX-ray14 dataset showed the classification improvements of traditional KD compared to the base transfer learning approach, the EKD performance would be expected to potentially enhance classification accuracy and model generalization, especially in situations of the imbalanced dataset and the interdependency of 14 weakly annotated thorax diseases.

• Pediatric Infection and Vaccine
• /
• v.4 no.1
• /
• pp.140-149
• /
• 1997

Purpose : Kawasaki Disease(KD) is a febrile disease with acute multisystemic vasculitis which is seen commonly in early childhood. The cause and etiologic agents are still unknown to identify using ordinary bacterial and viral culture, but the clinical labaratory studies suggest that KD is one of autoimmune disorder caused by infectious agents, but that is not proved yet. The study was performed to investigate the IgG subclasses in acute stage of KB before treatment of IVIG(Intravenous immunoglobulin). Method : The 35 cases in acute stage of KD before treatment of IVIG who were hospitalized from jan. 1995 to dec. 1996. The obtained sera were measured level of total IgG, IgM, IgA, IgE and IgG subclasses IgGl, IgG2, IgG3, IgG4 by using EIA and SRID method. Results : 1) The sex ratio is male to female is 1.5: 1.0, and male is prone to infected. 2) Total IgG, IgM, IgA and IgE level is normal range with age adjusted, but few cases are shown slight high level of total IgG compare to normal range of age adjusted. 3) acute phage reactants such as CRP, C3, ESR are all increased in acute stage of cases. 4) IgG subclasses IgGl, IgG2, IgG3 are shown normal range of age adjusted, but remarkably low level of IgG4 in all of cases. Conclusions : The low level of IgG4 is able to increasing the incidence of KD, and may use early diagnostic tools combine with other clinical symptoms and signs. But the resulsts of reported studies are different to each other, so it needs more times and cases to get final evaluation of changes of serum immnunoglobulin levels correlate to increase the incidence of high risk group of KD patients.

• Clinical and Experimental Pediatrics
• /
• v.49 no.6
• /
• pp.672-676
• /
• 2006

Purpose : Low dose aspirin is used due to its antiplatelet effect for the subacute phase of Kawasaki disease(KD). It is usually used for 6-8 weeks, then various hematologic laboratory tests and follow up echocardiography for evaluating coronary abnormalities are performed. Our review investigated the usefulness of various follow up laboratory tests performed at 6 weeks after the onset of KD. Methods : Two hundred eighty-two children diagnosed and hospitalized with KD were identified by reviewing patient's charts. Cases which were diagnosed between January 1997 and December 2004 were included in this study. We reviewed laboratory data including leukocytes, platelet counts, antistreptolysin O(ASO), erythrocyte sedimentation rate(ESR), C-reactive protein(CRP), aspartate aminotransferase(AST), alanine aminotransferase(ALT), urinalysis, and echocardiograms performed at admission and 6 weeks after the onset of KD. Paired t-test and Fisher's exact test, as well as logistic regression tests, were used for the statistical analysis. Results : At 6th week data, ESR and CRP were still elevated in 35(12.4 percent) and 12(4.3 percent) patients, respectively. Sterile pyuria were all normalized. But, 36 patients(12.8 percent) showed thrombocytosis, 22(7.8 percent) elevated AST, 15(5.3 percent) leukocytosis, and 6(2.1 percent) coronary abnormalities. Coronary abnormalities at the 6th week were only shown in patients with initial abnormalites. Younger age and initial thrombocytosis were risk factors for thrombocytosis at the 6th week. Conclusion : All children with initial coronary abonormalites should have an echocardiogram at 6 weeks after the onset of fever. In view of case-effectiveness, additional echocardiographic studies are justified only if abnormalities are present at admission. ESR, CRP, and urinalysis performed at the 6 weeks after onset of KD is not significant for clinical information of progression. Platelet count should be estimated at 6th week for a judgement of continuous antiplatelet therapy.

• Clinical and Experimental Pediatrics
• /
• v.49 no.10
• /
• pp.1093-1099
• /
• 2006

Purpose : Homocysteine is a strong and independent risk factor for cardiovascular disease. The deleterious effects of homocysteine included endothelial dysfunction, arterial intimal-medial thickening, wall stiffness and procoagulant activity. However, the precise mechanism responsible for homocysteine release in children with coronary artery disease is still unknown. The purpose of this study was to investigate serum homocysteine and tumor necrosis $factor(TNF)-{\alpha}$ levels and identify whether these levels had any association with the development of coronary artery lesions in Kawasaki disease(KD). Methods : Serum homocysteine and $TNF-{\alpha}$ levels were measured in 24 KD patients(group 1, eight patients with normal coronary artery; group 2, 16 patients with coronary artery lesions) and 21 controls(group 3, 10 afebrile controls; group 4, 11 febrile controls). Blood samples were drawn from each study group before and after intravenous immunoglobulin(IVIG) therapy and in the convalescent stage. Results : The homocysteine levels before IVIG therapy were significantly higher in group 1 than in group 3, and in group 2 than in group 3 and 4. The $TNF-{\alpha}$ levels before IVIG therapy were significantly higher in group 2 than group 3 and 4. Serum homocysteine and $TNF-{\alpha}$ levels were highest in group 2 before IVIG therapy. In the acute KD patients, serum homocysteine levels correlated significantly with $TNF-{\alpha}$ levels. Conclusion : The increased serum homocysteine levels in the acute stage increase the susceptibility to coronary arterial lesions in KD. $TNF-{\alpha}$ may also play an important role in the formation of coronary arterial lesions in KD.

• Clinical and Experimental Pediatrics
• /
• v.49 no.7
• /
• pp.790-795
• /
• 2006

Purpose : This study was performed to compare the therapeutic effects according to duration of medium-dose aspirin(50-60 mg/kg/day) therapy at the acute stage of Kawasaki disease(KD). Methods : Total 87 patients with KD were enrolled in this study. We performed retrospective analysis of clinical characteristics and echocardiographic findings based on medical records. Patient were randomly divided into 2 groups according to the duration of aspirin therapy at the acute stage of KD. Long-term group(LG, n=55) was administered medium-dose aspirin for 2 weeks after diagnosis of KD, and short-term group(SG, n=32) for 48 hours after intravenous immunoglobulin(IVIG) administration. The parameters of therapeutic effects were duration of fever after IVIG administration, incidence of unresponsive patients to single administration of IVIG, and development of transient dilatation or aneurysm of coronary arteries. Results : There was no significant difference in the duration of fever after IVIG between the both group(LG $1.7{\pm}1.1$ days, SG $1.8{\pm}1.1$ days; P=0.588). The incidences of unresponsive patient to the single administration of IVIG were 5.5 percent, 6.3 percent in the each group. Transient dilatation of coronary arteries occurred at 18.2 percent(10/55) in the LG, and 15.6 percent(5/32) in the SG(P=0.761). Prevalence of coronary aneurysm after subacute stage were 7.3 percent(4/55) in the LG, and 9.4 percent(3/32) in the SG(P=0.728). Conclusion : There was no significant difference in the therapeutic effects between long-term(2 weeks) and short-term(48 hours) administration of medium-dose aspirin at the acute stage of KD.

• Clinical and Experimental Pediatrics
• /
• v.48 no.2
• /
• pp.165-173
• /
• 2005

Purpose : We performed the study to evaluate the value of the follow-up echocardiogram performed 6 months to 1 year after the onset of Kawasaki disease(KD), as recommended by American Heart Association(AHA) guidelines, when echocardiograms in the convalescent period were normal. Methods : Patients were selected from 147 cases diagnosed with KD at Pusan Paik hospital from January 2000 to October 2003. A total of 45 KD patients belonged to AHA risk level I and II were performed follow-up echocardiography. The patient's medical records and echocardiogram were reviewed. Additionally, we sought the opinion of pediatric cardiologists on the subject by means of a multiple-choice survey. Results : 37 children were belonged to AHA risk level I and the remaining 8 patients were belonged to risk level II. Of these 45 children, none were noted to have abnormalities on later follow-up echocardiogram. In the results of questionnaire, 37 percent of the participants advocate no follow-up after convalescent period for risk level I, and 33.3 percent favor periodic follow-up with echocardiography for risk level II up to one year. But there were no consensus about the diagnostic criteria of coronary abnormalities and how to follow-up these patients. Conclusion : All children with KD should have an echocardiogram at present and a follow-up study 6 to 8 weeks after the onset of fever. However, additional echocardiographies are not justified if the 6- to 8-week follow-up echocardiogram is normal. We would recommend that the more reasonable diagnostic criteria for coronary abnormalities and the Korean guidelines for long-term cardiovascular management and follow-up of KD need to be established.

• Journal of Energy Engineering
• /
• v.23 no.3
• /
• pp.82-87
• /
• 2014

MLI(Multi-layer Insulation) is widely used to get highly insulating on cryogenic system in order to reduce heat loads. MLI for satellites thermal performance is changed by materials and laminated method. In this study, a composite multilayer insulation by application of heat stroage tank performance were compared with materials and laminated to change the way. Experimental methods of the KS C 9805 was used, the composite multilayer insulation and EPS was compared with the insulation performance. A method for analysis of experimental results is the equivalent thickness about CMI and the insulation performance were used to compare thermal conductance. As a results, the equivalnet thickenss and the thermal conductance of the composite multilayer insulation were smaller than the EPS and the thermal performance are more excellent. In addition, the configuration of the composite multilayer insulation materials and laminated method varies depending on the overall heat transfer coefficient was confirmed.

• Asian-Australasian Journal of Animal Sciences
• /
• v.11 no.1
• /
• pp.35-42
• /
• 1998

Whole faba beans (WFB) were dry roasted at different temperatures (110, 130, $150^{\circ}C$) for 15, 30, 45 minutes to determine the optimal heating conditions of time and temperature to increase nutritional value. Ruminant degradation characteristics of crude protein (CP) of WFB were determined by the nylon bag incubation technique in dairy cows fed 60% hay and 40% concentrate. Measured characteristics of crude protein (CP) were soluble (washable) fraction (S), undegradable fraction (U), lag time (T0), potentially degradable fraction (D) and the rate of degradation (Kd) of insoluble but degradable fraction. Based on measured characteristics, percentage bypass crude protein (%BCP) and bypass crude protein (BCP in g/kg) were calculated. Degradability of CP was reduced by dry roasting (p < 0.01). S was reduced rapidly with increasing time and temperature, from 49.0% in the raw WFB (RWFB) to 26.3% in $150^{\circ}C/45$ min. D varied from 50.7% in RWFB to 73.7% in $150^{\circ}C/45^{\prime}$. U varied from 0% in $130^{\circ}C/45^{\prime}$, $150^{\circ}/30^{\prime}$ and $150^{\circ}/45^{\prime}$ to 0.66% in $110^{\circ}/45^{\prime}$ (0.24% for the RWFB). Lag time (T0) varied from 1.58 h in $130^{\circ}C/30^{\prime}$ to 2.40 h in $150^{\circ}C/45^{\prime}$ (1.87 h for RWFB). Kd varied from 24.2% in the $110^{\circ}C/30^{\prime}$ to 4.3% in $150^{\circ}C/45^{\prime}$ (21.4% for the RWFB). Kd was significantly reduced with time and temperature. All these effects resulted in increasing % BCP from 8.9% in the $110^{\circ}C/45^{\prime}$, 11.3% in the RWFB to 43.1% in the $150^{\circ}C/45$. Therefore BCP increased from 31.3 and 39.9 to 148.4 g/kg respectively. Both %BCP and BCP at $150^{\circ}C/45$ increased nearly 4 times over the raw faba beans. The effects of dry roasting temperature and time on %BCP and BCP seemed to be linear up to the highest values tested. Therefore no optimal dry roasting conditions of time and temperature could be determined at this stage. It was concluded that dry roasting was effective in shifting crude protein degradation from rumen to intestine to reduce unnecessary nitrogen (N) loss in the rumen. To determine the optimal treatment, the digestibility of each treatment should be measured in the next trial using mobile bags technique.