Picture for Yuanhan Hu

Yuanhan Hu

Cyclic and Randomized Stepsizes Invoke Heavier Tails in SGD

Add code
Feb 10, 2023
Figure 1 for Cyclic and Randomized Stepsizes Invoke Heavier Tails in SGD
Figure 2 for Cyclic and Randomized Stepsizes Invoke Heavier Tails in SGD
Figure 3 for Cyclic and Randomized Stepsizes Invoke Heavier Tails in SGD
Figure 4 for Cyclic and Randomized Stepsizes Invoke Heavier Tails in SGD
Viaarxiv icon

Penalized Langevin and Hamiltonian Monte Carlo Algorithms for Constrained Sampling

Add code
Nov 29, 2022
Viaarxiv icon

Heavy-Tail Phenomenon in Decentralized SGD

Add code
May 16, 2022
Figure 1 for Heavy-Tail Phenomenon in Decentralized SGD
Figure 2 for Heavy-Tail Phenomenon in Decentralized SGD
Figure 3 for Heavy-Tail Phenomenon in Decentralized SGD
Figure 4 for Heavy-Tail Phenomenon in Decentralized SGD
Viaarxiv icon

Decentralized Stochastic Gradient Langevin Dynamics and Hamiltonian Monte Carlo

Add code
Jul 02, 2020
Figure 1 for Decentralized Stochastic Gradient Langevin Dynamics and Hamiltonian Monte Carlo
Figure 2 for Decentralized Stochastic Gradient Langevin Dynamics and Hamiltonian Monte Carlo
Figure 3 for Decentralized Stochastic Gradient Langevin Dynamics and Hamiltonian Monte Carlo
Figure 4 for Decentralized Stochastic Gradient Langevin Dynamics and Hamiltonian Monte Carlo
Viaarxiv icon

Fractional moment-preserving initialization schemes for training fully-connected neural networks

Add code
Jun 08, 2020
Figure 1 for Fractional moment-preserving initialization schemes for training fully-connected neural networks
Figure 2 for Fractional moment-preserving initialization schemes for training fully-connected neural networks
Figure 3 for Fractional moment-preserving initialization schemes for training fully-connected neural networks
Figure 4 for Fractional moment-preserving initialization schemes for training fully-connected neural networks
Viaarxiv icon

Non-Convex Stochastic Optimization via Non-Reversible Stochastic Gradient Langevin Dynamics

Add code
Apr 06, 2020
Figure 1 for Non-Convex Stochastic Optimization via Non-Reversible Stochastic Gradient Langevin Dynamics
Figure 2 for Non-Convex Stochastic Optimization via Non-Reversible Stochastic Gradient Langevin Dynamics
Figure 3 for Non-Convex Stochastic Optimization via Non-Reversible Stochastic Gradient Langevin Dynamics
Viaarxiv icon