Picture for Liad Ben-Uri

Liad Ben-Uri

Neural gradients are lognormally distributed: understanding sparse and quantized training

Add code
Jun 17, 2020
Figure 1 for Neural gradients are lognormally distributed: understanding sparse and quantized training
Figure 2 for Neural gradients are lognormally distributed: understanding sparse and quantized training
Figure 3 for Neural gradients are lognormally distributed: understanding sparse and quantized training
Figure 4 for Neural gradients are lognormally distributed: understanding sparse and quantized training
Viaarxiv icon