Picture for Olivier Tardieu

Olivier Tardieu

Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference

Add code
Mar 11, 2025
Viaarxiv icon

Towards Pareto Optimal Throughput in Small Language Model Serving

Add code
Apr 04, 2024
Viaarxiv icon