LiteLLM

AI gateway to call 100+ LLM APIs in OpenAI format with cost tracking, guardrails, and load balancing.

Bintang

62,893

Fork

13,105

Bahasa

Python

Kategori

Inference & Serving

Dapatkan kode

# Clone repositori
git clone https://github.com/BerriAI/litellm

Apa itu LiteLLM?

AI gateway to call 100+ LLM APIs in OpenAI format with cost tracking, guardrails, and load balancing.

Apakah LiteLLM aman digunakan?

LiteLLM adalah proyek open source dari BerriAI di GitHub. Tinjau kode sumber dan lisensi sebelum menggunakannya di produksi.

Bagaimana memulai dengan LiteLLM?

git clone https://github.com/BerriAI/litellm

LiteLLM ditulis dalam bahasa apa?

openSource.faqWhatLanguageAnswer

Run large models locally with a single command — LLMs, vision, and embeddings on any machine.

LLM inference in C/C++ with quantization — runs models on CPU, GPU, and edge devices.

High-throughput, memory-efficient inference and serving engine for LLMs with PagedAttention.