A Fully Rigorous Proof of the Derivation of Xavier and He's Initialization for Deep ReLU Networks

Add code
Jan 21, 2021
Quynh Nguyen

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

A fully rigorous proof of the derivation of Xavier/He's initialization for ReLU nets is given.

View paper onarxiv icon

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon