LocalAI

Run any model — LLMs, vision, voice, image, video — on any hardware, no GPU required.

Bintang

50,248

Fork

4,581

Bahasa

Kategori

Inference & Serving

Dapatkan kode

# Clone repositori
git clone https://github.com/mudler/LocalAI

Apa itu LocalAI?

Run any model — LLMs, vision, voice, image, video — on any hardware, no GPU required.

Apakah LocalAI aman digunakan?

LocalAI adalah proyek open source dari mudler di GitHub. Tinjau kode sumber dan lisensi sebelum menggunakannya di produksi.

Bagaimana memulai dengan LocalAI?

git clone https://github.com/mudler/LocalAI

LocalAI ditulis dalam bahasa apa?

openSource.faqWhatLanguageAnswer

Run large models locally with a single command — LLMs, vision, and embeddings on any machine.

LLM inference in C/C++ with quantization — runs models on CPU, GPU, and edge devices.

High-throughput, memory-efficient inference and serving engine for LLMs with PagedAttention.