Abstract: Existing studies on knowledge distillation typically focus on teacher-centered methods, in which the teacher network is trained according to its own standards before transferring the learned ...
An illustration of a magnifying glass. An illustration of a magnifying glass.