Megatron-LLM is queued for analysis. Crawling candidates and ranking them takes a few minutes. This page updates itself when the list exists — you can also come back later.
What is known so far comes from the other direction:
These projects were analysed and named Megatron-LLM among their alternatives. The relationship is not symmetric — how Megatron-LLM rates them is a separate judgement, made when Megatron-LLM is analysed in its own right.
calls Megatron-LLM “Older Megatron-derived distributed LLM trainer with no recent maintenance; use it only if you need that legacy codebase rather than GPT-NeoX.”
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries