Picture for Qianyi Li

Qianyi Li

Order parameters and phase transitions of continual learning in deep neural networks

Add code
Jul 14, 2024
Viaarxiv icon

Connecting NTK and NNGP: A Unified Theoretical Framework for Neural Network Learning Dynamics in the Kernel Regime

Add code
Sep 08, 2023
Figure 1 for Connecting NTK and NNGP: A Unified Theoretical Framework for Neural Network Learning Dynamics in the Kernel Regime
Figure 2 for Connecting NTK and NNGP: A Unified Theoretical Framework for Neural Network Learning Dynamics in the Kernel Regime
Figure 3 for Connecting NTK and NNGP: A Unified Theoretical Framework for Neural Network Learning Dynamics in the Kernel Regime
Figure 4 for Connecting NTK and NNGP: A Unified Theoretical Framework for Neural Network Learning Dynamics in the Kernel Regime
Viaarxiv icon

Globally Gated Deep Linear Networks

Add code
Oct 31, 2022
Viaarxiv icon

Statistical Mechanics of Deep Linear Neural Networks: The Back-Propagating Renormalization Group

Add code
Dec 07, 2020
Figure 1 for Statistical Mechanics of Deep Linear Neural Networks: The Back-Propagating Renormalization Group
Figure 2 for Statistical Mechanics of Deep Linear Neural Networks: The Back-Propagating Renormalization Group
Figure 3 for Statistical Mechanics of Deep Linear Neural Networks: The Back-Propagating Renormalization Group
Figure 4 for Statistical Mechanics of Deep Linear Neural Networks: The Back-Propagating Renormalization Group
Viaarxiv icon