Search

DevOps & Cloud · CUDA · NVIDIA/Megatron-LM

1 skill found.

Skills

Search results
#SkillRepositoryStarsUsed inTokensAuto-checkLicenceUpdated
1

Shows how to launch distributed Megatron-LM training on a SLURM cluster: sbatch skeleton, torch.distributed.run setup, CUDA_DEVICE_MAX_CONNECTIONS rules and failure diagnosis.

NVIDIA/Megatron-LM18k—~1.8kAutomated safety check: PassApache-2.0today