KVTuner
arxiv.org ↗(ICML 2025) - sensitivity-aware layer-wise mixed-precision KV-cache quantization; up to 21% throughput improvement over uniform KV8.
AboutVisit arxiv.org ↗
(ICML 2025) - sensitivity-aware layer-wise mixed-precision KV-cache quantization; up to 21% throughput improvement over uniform KV8.
This entry links to an external website rather than a GitHub repository, so there's no README to display here.