FastQuery: Communication-efficient Embedding Table Query for Private LLM Inference

Add code
May 25, 2024

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: