Picture for Adeem Jassani

Adeem Jassani

Improving Knowledge Distillation for BERT Models: Loss Functions, Mapping Methods, and Weight Tuning

Add code
Aug 26, 2023
Viaarxiv icon