• ETRI Journal
• /
• v.41 no.2
• /
• pp.242-253
• /
• 2019

We devise a layer-wise hint training method to improve the existing hint-based knowledge distillation (KD) training approach, which is employed for knowledge transfer in a teacher-student framework using a residual network (ResNet). To achieve this objective, the proposed method first iteratively trains the student ResNet and incrementally employs hint-based information extracted from the pretrained teacher ResNet containing several hint and guided layers. Next, typical softening factor-based KD training is performed using the previously estimated hint-based information. We compare the recognition accuracy of the proposed approach with that of KD training without hints, hint-based KD training, and ResNet-based layer-wise pretraining using reliable datasets, including CIFAR-10, CIFAR-100, and MNIST. When using the selected multiple hint-based information items and their layer-wise transfer in the proposed method, the trained student ResNet more accurately reflects the pretrained teacher ResNet's rich information than the baseline training methods, for all the benchmark datasets we consider in this study.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.54 no.5
• /
• pp.35-41
• /
• 2017

In this paper, we analyze the performance of the recently introduced Hint-knowledge distillation (KD) training approach based on the teacher-student framework for knowledge distillation and knowledge transfer. As a deep neural network (DNN) considered in this paper, the deep residual network (ResNet), which is currently regarded as the latest DNN, is used for the teacher-student framework. Therefore, when implementing the Hint-KD training, we investigate the impact on the weight of KD information based on the soften factor in terms of classification accuracy using the widely used open deep learning frameworks, Caffe. As a results, it can be seen that the recognition accuracy of the student model is improved when the fixed value of the KD information is maintained rather than the gradual decrease of the KD information during training.

• International Journal of Control, Automation, and Systems
• /
• v.4 no.1
• /
• pp.17-29
• /
• 2006

A novel inverse kinematics solution based on the back propagation neural network (NN) for redundant manipulators is developed for online obstacles avoidance. A laser transducer at the end-effctor is used for online planning the trajectory. Since the inverse kinematics in the present problem has infinite number of joint angle vectors, a fuzzy reasoning system is designed to generate an approximate value for that vector. This vector is fed into the NN as a hint input vector rather than as a training vector to guide the output of the NN. Simulations are implemented on both three- and four-link redundant planar manipulators to show the effectiveness of the proposed position control system.

• Journal of the Korean Institute of Educational Facilities
• /
• v.9 no.3
• /
• pp.23-34
• /
• 2002

This paper is to analyse the major impact of the new era of information technology on the changes being made in physical environment of existing corporate training centers through the case of on- and off-line LG academies. By the analysis, some interesting features are to be found which can be a hint for the future planning and design of corporate training centers. Unlike the expectation in the early stage of changes, the rapid growth of on-line education forms a very strong partnership with the existing in-house training programs at all levels. Understanding of such key issues surrounding the use of facilities is specific to the formation of an effective environment for training programmes. After all aspects of the facility uses-not just the class rooms, but also the residential, dining, recreational, and support areas, as well as on-line type of educational services-are carefully examined, a design guideline is identified as considerations for guestrooms, classrooms, public facilities, the recreational areas, and the audio-visual provisions.

• Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
• /
• v.7 no.2
• /
• pp.515-523
• /
• 2017

In the training field where literature is used as a tool, some excerpts from its text are used, instead of its full text. Therefore, it is necessary to have empirical guidelines for which part of the text should be used as Memory-Hint, a part that reminds its reader of certain memory, and for how the text can be introduced effectively. For the study, Hesse's whole life and his literary characters were examined from a therapeutic perspective. First, while Hesse's life was reviewed and his characters were analyzed, Hesse was recognized for Self-therapeutic Life. He also lived a life of multimedia in which he practiced writing, painting, playing musical instruments, meditation, walking, etc. Second, Contents of Literature Therapy using Hesse's works were applied to the schizophrenic patients. Media used for the clinical study were mostly extracted from Hesse's works. They began to show interest in others and express their empathy on others, in addition to expressing their sentimental empathy on Hesse's texts. How effectively Hesse utilized multimedia during his lifetime will be good literary resources in helping improving modern-day people's mental health and curing their pathological problems.