Picture for Nithin Anchuri

Nithin Anchuri

A Short Study on Compressing Decoder-Based Language Models

Add code
Oct 16, 2021
Figure 1 for A Short Study on Compressing Decoder-Based Language Models
Figure 2 for A Short Study on Compressing Decoder-Based Language Models
Figure 3 for A Short Study on Compressing Decoder-Based Language Models
Figure 4 for A Short Study on Compressing Decoder-Based Language Models
Viaarxiv icon

RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation

Add code
Oct 01, 2021
Figure 1 for RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation
Figure 2 for RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation
Figure 3 for RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation
Figure 4 for RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation
Viaarxiv icon