历程

首次提出思路

Model compression

C. Buciluǎ, R. Caruana, and A. Niculescu-Mizil.

https://www.cs.cornell.edu/~caruana/compression.kdd06.pdf

首次提出概念

Distilling the Knowledge in a Neural Network

Geoffrey Hinton, Oriol Vinyals, Jeff Dean

https://arxiv.org/abs/1503.02531

阅读

阅读《Distilling he Knowledge in a Neural Network》