Knowledge Distillation Kd

“Knowledge Distillation (KD) and mixup have proven effective at inducing smoothness in class boundaries”