Picture for In Gim

In Gim

Confidential Prompting: Protecting User Prompts from Cloud LLM Providers

Add code
Sep 27, 2024
Viaarxiv icon

Prompt Cache: Modular Attention Reuse for Low-Latency Inference

Add code
Nov 07, 2023
Viaarxiv icon