SGLang

High-performance serving framework for large language and multimodal models.

Stars

38,571

Forks

10,259

Language

Python

Get the code

# Clone the repository
git clone https://github.com/sgl-project/sglang

What is SGLang?

High-performance serving framework for large language and multimodal models.

Is SGLang safe to use?

SGLang is an open-source project by sgl-project on GitHub. Review the source code and license before using it in production.

How do I get started with SGLang?

git clone https://github.com/sgl-project/sglang

What language is SGLang written in?

openSource.faqWhatLanguageAnswer

Run large models locally with a single command — LLMs, vision, and embeddings on any machine.

LLM inference in C/C++ with quantization — runs models on CPU, GPU, and edge devices.

High-throughput, memory-efficient inference and serving engine for LLMs with PagedAttention.