%0 Conference Proceedings
%T The Bonsai Hypothesis: An Efficient Network Pruning Technique
%+ Graduate School of Advanced Science and Engineering [Higashi-Hiroshima]
%+ Fujitsu Laboratories Ltd.
%A Ito, Yasuaki
%A Nakano, Koji
%A Kasagi, Akihiko
%Z Part 3: Deep Learning - Convolutional
%< avec comité de lecture
%@ 978-3-031-08332-7
%( IFIP Advances in Information and Communication Technology
%B 18th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI)
%C Hersonissos, Greece
%Y Ilias Maglogiannis
%Y Lazaros Iliadis
%Y John Macintyre
%Y Paulo Cortez
%I Springer International Publishing
%3 Artificial Intelligence Applications and Innovations
%V AICT-646
%N Part I
%P 229-241
%8 2022-06-17
%D 2022
%R 10.1007/978-3-031-08333-4_19
%K Model compression
%K Channel pruning
%K Machine learning
%K Convolutional neural network
%Z Computer Science [cs]Conference papers
%X Machine learning technology has made it possible to solve a variety of previously unfeasible problems. Accordingly, the size of network models has been increasing. Thus, research on model compression by network pruning has been conducted. Network pruning is usually performed on already-trained network models. However, it is often difficult to remove a large number of weights from a network while maintaining accuracy. We suppose that the reason for this is that well-trained networks have many weight parameters with complicated correlations among them, and such parameters make pruning difficult. Based on this supposition, in this paper, we state the bonsai hypothesis: pruning can be more effective when starting from untrained models than already trained models. To support the hypothesis, we present a simple and efficient channel pruning algorithm. We performed pruning of untrained and trained models using the proposed algorithm for VGG16 on CIFAR-10 and CIFAR-100. As a result, we found that the untrained models tend to reduce more channels than the already-trained models.
%G English
%Z TC 12
%Z WG 12.5
%2 https://inria.hal.science/hal-04317167/document
%2 https://inria.hal.science/hal-04317167/file/527511_1_En_19_Chapter.pdf
%L hal-04317167
%U https://inria.hal.science/hal-04317167
%~ IFIP
%~ IFIP-AICT
%~ IFIP-TC
%~ IFIP-WG
%~ IFIP-TC12
%~ IFIP-AIAI
%~ IFIP-WG12-5
%~ IFIP-AICT-646