feat: TurboQuant KV-cache quantization — all backends - #1

Merged

thecodacus merged 14 commits into

perffrom

fable5/turboquant

Jul 18, 2026

Commits on Jul 17, 2026

feat: TurboQuant KV-cache quantization — core types + CPU backend
thecodacus
committed
a579e99
feat: turbo KV cache — graph wiring and CLI types
thecodacus
committed
7fcd91d
feat: turbo KV cache — Metal backend (WHT kernel + FA dispatch)
thecodacus
committed
f386b46
feat: turbo KV cache — CUDA backend (set-rows quantize, fattn vec dispatch, dequant)
thecodacus
committed
42b6620
feat: turbo KV cache — Vulkan backend (set-rows quantize, turbo3 FA dispatch, WHT op)
thecodacus
committed
fb945e8
fix: extern initialization warning and C linkage for wht group size
thecodacus
committed
5d1cb9d
feat: turbo2/turbo4 FA dequant for Vulkan
thecodacus
committed
0a28733

Commits on Jul 18, 2026