LocalAI

Run any model — LLMs, vision, voice, image, video — on any hardware, no GPU required.

Stars

50,248

Forks

4,581

Language

Get the code

# Clone the repository
git clone https://github.com/mudler/LocalAI

What is LocalAI?

Run any model — LLMs, vision, voice, image, video — on any hardware, no GPU required.

Is LocalAI safe to use?

LocalAI is an open-source project by mudler on GitHub. Review the source code and license before using it in production.

How do I get started with LocalAI?

git clone https://github.com/mudler/LocalAI

What language is LocalAI written in?

openSource.faqWhatLanguageAnswer

Run large models locally with a single command — LLMs, vision, and embeddings on any machine.

LLM inference in C/C++ with quantization — runs models on CPU, GPU, and edge devices.

High-throughput, memory-efficient inference and serving engine for LLMs with PagedAttention.