ModernBERT
arxiv.org ↗(2024) - modernized encoder with rotary embeddings, FlashAttention, 8K context; current go-to encoder for classification, NER, retrieval.
AboutVisit arxiv.org ↗
(2024) - modernized encoder with rotary embeddings, FlashAttention, 8K context; current go-to encoder for classification, NER, retrieval.
This entry links to an external website rather than a GitHub repository, so there's no README to display here.