Megatron-LM

NVIDIA's framework for training large transformer models at scale.

Stars

18,347

Forks

4,714

Language

Python

Get the code

# Clone the repository
git clone https://github.com/NVIDIA/Megatron-LM

What is Megatron-LM?

NVIDIA's framework for training large transformer models at scale.

Is Megatron-LM safe to use?

Megatron-LM is an open-source project by NVIDIA on GitHub. Review the source code and license before using it in production.

How do I get started with Megatron-LM?

git clone https://github.com/NVIDIA/Megatron-LM

What language is Megatron-LM written in?

openSource.faqWhatLanguageAnswer

Fine-tune and run LLMs and diffusion models 2x faster with far less memory.

Unified efficient fine-tuning of 100+ LLMs and VLMs with a no-code web UI.

Deep learning optimization library that makes distributed training and inference easy and efficient.