Picture for Chulu Xiang

Chulu Xiang

AdaBatchGrad: Combining Adaptive Batch Size and Adaptive Step Size

Add code
Feb 07, 2024
Viaarxiv icon

SANIA: Polyak-type Optimization Framework Leads to Scale Invariant Stochastic Algorithms

Add code
Dec 28, 2023
Figure 1 for SANIA: Polyak-type Optimization Framework Leads to Scale Invariant Stochastic Algorithms
Figure 2 for SANIA: Polyak-type Optimization Framework Leads to Scale Invariant Stochastic Algorithms
Figure 3 for SANIA: Polyak-type Optimization Framework Leads to Scale Invariant Stochastic Algorithms
Figure 4 for SANIA: Polyak-type Optimization Framework Leads to Scale Invariant Stochastic Algorithms
Viaarxiv icon

Stochastic Gradient Descent with Preconditioned Polyak Step-size

Add code
Oct 03, 2023
Figure 1 for Stochastic Gradient Descent with Preconditioned Polyak Step-size
Figure 2 for Stochastic Gradient Descent with Preconditioned Polyak Step-size
Figure 3 for Stochastic Gradient Descent with Preconditioned Polyak Step-size
Figure 4 for Stochastic Gradient Descent with Preconditioned Polyak Step-size
Viaarxiv icon