KTransformers

github.com ↗

- KTransformers is a flexible framework for experiencing cutting-edge LLM inference optimizations.