Picture for Adway Girish

Adway Girish

Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models

Add code
Jul 22, 2024
Viaarxiv icon

Local to Global: Learning Dynamics and Effect of Initialization for Transformers

Add code
Jun 05, 2024
Viaarxiv icon

Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains

Add code
Feb 06, 2024
Viaarxiv icon

ICQ: A Quantization Scheme for Best-Arm Identification Over Bit-Constrained Channels

Add code
Apr 30, 2023
Viaarxiv icon