Picture for Zhi Yao

Zhi Yao

VELO: A Vector Database-Assisted Cloud-Edge Collaborative LLM QoS Optimization Framework

Add code
Jun 19, 2024
Viaarxiv icon