Singular Value Decomposition and Neural Networks

Add code
Jun 27, 2019
Bernhard Bermeitinger, Tomas Hrycej, Siegfried Handschuh
Figure 1 for Singular Value Decomposition and Neural Networks
Figure 2 for Singular Value Decomposition and Neural Networks
Figure 3 for Singular Value Decomposition and Neural Networks
Figure 4 for Singular Value Decomposition and Neural Networks

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

Singular Value Decomposition (SVD) constitutes a bridge between the linear algebra concepts and multi-layer neural networks---it is their linear analogy. Besides of this insight, it can be used as a good initial guess for the network parameters, leading to substantially better optimization results.

View paper onarxiv icon

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon