Picture for Blake Bordelon

Blake Bordelon

Dynamically Learning to Integrate in Recurrent Neural Networks

Add code
Mar 24, 2025
Viaarxiv icon

Adaptive kernel predictors from feature-learning infinite limits of neural networks

Add code
Feb 11, 2025
Viaarxiv icon

Two-Point Deterministic Equivalence for Stochastic Gradient Dynamics in Linear Models

Add code
Feb 07, 2025
Viaarxiv icon

Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer

Add code
Feb 04, 2025
Viaarxiv icon

Scaling Laws for Precision

Add code
Nov 07, 2024
Viaarxiv icon

Do Mice Grok? Glimpses of Hidden Progress During Overtraining in Sensory Cortex

Add code
Nov 05, 2024
Figure 1 for Do Mice Grok? Glimpses of Hidden Progress During Overtraining in Sensory Cortex
Figure 2 for Do Mice Grok? Glimpses of Hidden Progress During Overtraining in Sensory Cortex
Figure 3 for Do Mice Grok? Glimpses of Hidden Progress During Overtraining in Sensory Cortex
Figure 4 for Do Mice Grok? Glimpses of Hidden Progress During Overtraining in Sensory Cortex
Viaarxiv icon

How Feature Learning Can Improve Neural Scaling Laws

Add code
Sep 26, 2024
Viaarxiv icon

Infinite Limits of Multi-head Transformer Dynamics

Add code
May 24, 2024
Figure 1 for Infinite Limits of Multi-head Transformer Dynamics
Figure 2 for Infinite Limits of Multi-head Transformer Dynamics
Figure 3 for Infinite Limits of Multi-head Transformer Dynamics
Figure 4 for Infinite Limits of Multi-head Transformer Dynamics
Viaarxiv icon

A Dynamical Model of Neural Scaling Laws

Add code
Feb 02, 2024
Viaarxiv icon

Grokking as the Transition from Lazy to Rich Training Dynamics

Add code
Oct 09, 2023
Figure 1 for Grokking as the Transition from Lazy to Rich Training Dynamics
Figure 2 for Grokking as the Transition from Lazy to Rich Training Dynamics
Figure 3 for Grokking as the Transition from Lazy to Rich Training Dynamics
Figure 4 for Grokking as the Transition from Lazy to Rich Training Dynamics
Viaarxiv icon