Picture for Yaodan Xu

Yaodan Xu

SMDP-Based Dynamic Batching for Efficient Inference on GPU-Based Platforms

Add code
Jan 30, 2023
Viaarxiv icon