Colossal-AI

github.com ↗

An open-source deep learning system for large-scale model training and inference with high efficiency and low cost.