llamafile

Distribute and run LLMs with a single cross-platform executable file.

Stars

26,582

Forks

1,672

Language

C++

Get the code

# Clone the repository
git clone https://github.com/Mozilla-Ocho/llamafile

What is llamafile?

Distribute and run LLMs with a single cross-platform executable file.

Is llamafile safe to use?

llamafile is an open-source project by Mozilla-Ocho on GitHub. Review the source code and license before using it in production.

How do I get started with llamafile?

git clone https://github.com/Mozilla-Ocho/llamafile

What language is llamafile written in?

openSource.faqWhatLanguageAnswer

Run large models locally with a single command — LLMs, vision, and embeddings on any machine.

LLM inference in C/C++ with quantization — runs models on CPU, GPU, and edge devices.

High-throughput, memory-efficient inference and serving engine for LLMs with PagedAttention.