Skip to content

Feature(quantization): add KIVI KV-cache quantization for exact-preifx reuse#4

Open
forLG wants to merge 8 commits into
Tele-AI:mainfrom
forLG:feature/kivi-quant
Open

Feature(quantization): add KIVI KV-cache quantization for exact-preifx reuse#4
forLG wants to merge 8 commits into
Tele-AI:mainfrom
forLG:feature/kivi-quant

Commits

Commits on Jul 17, 2026