Picture for Archit Patke

Archit Patke

Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction

Add code
Apr 12, 2024
Viaarxiv icon