Analyzing weight distribution of neural networks

신경망의 웨이트 분포 분석

In this paper, we analyze weight distributions of neural networks. If we construct a vector containing all weights of a neural network, then training process can be viewed as finding a solution point in the weight space. In order to obtain insight into the training process of neural networks, we investigate the distribution of the solution points in the weight space Experiments provide some interesting results, showing that solution points tend to form clusters in the weight space and the information may be used to speed up the training process.