Pinned Loading
-
kv-middleware
kv-middleware PublicPersistent KV prefix caching middleware for llama.cpp and OpenAI-compatible agents. Detects stable system/developer prompts and tools, persists slot snapshots, and restores them after model restarts.
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.