Picture for Michael Poli

Michael Poli

State-Free Inference of State-Space Models: The Transfer Function Approach

Add code
May 10, 2024
Viaarxiv icon

Mechanistic Design and Scaling of Hybrid Architectures

Add code
Mar 26, 2024
Viaarxiv icon

Zoology: Measuring and Improving Recall in Efficient Language Models

Add code
Dec 08, 2023
Viaarxiv icon

Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions

Add code
Oct 28, 2023
Figure 1 for Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions
Figure 2 for Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions
Figure 3 for Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions
Figure 4 for Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions
Viaarxiv icon

Learning Efficient Surrogate Dynamic Models with Graph Spline Networks

Add code
Oct 25, 2023
Viaarxiv icon

Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture

Add code
Oct 18, 2023
Viaarxiv icon

HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolution

Add code
Jun 27, 2023
Viaarxiv icon

Ideal Abstractions for Decision-Focused Learning

Add code
Mar 29, 2023
Viaarxiv icon

Effectively Modeling Time Series with Simple Discrete State Spaces

Add code
Mar 16, 2023
Viaarxiv icon

Hyena Hierarchy: Towards Larger Convolutional Language Models

Add code
Mar 06, 2023
Viaarxiv icon