mlx-lm

github.com ↗

- MLX LM is a Python package for generating text and fine-tuning large language models on Apple silicon with MLX, featuring integration with Hugging Face Hub and support for quantization and distributed inference.