RedPajama / RedPajama-V2

(2023-2024) - reproductions of LLaMA pretraining data; V2 is 30T tokens with quality signals.