LiteLLM

litellm.ai · Inference & Hosting

Open source

#6 in Inference & Hosting

Python SDK and proxy gateway that calls many LLM providers through one OpenAI-style interface with budgets and logging.

#gateway#proxy#100-providers#cost-tracking

Visit LiteLLM ↗GitHub ↗

About the Inference & Hosting category

Serving engines, local runtimes, gateways and cloud platforms for running models fast and cheaply in production or on your laptop.

LiteLLM is one of 10 inference & hosting tools indexed on Drydock. Facts on this page come from the tool's official site and public APIs; prices and features change, so confirm details on the official website before you commit.

// related

Related tools

All Inference & Hosting →

Ollamaollama.comThe simplest way to download and run open models locally, with a CLI, desktop app and local API.Inference & HostingOpen source★ 182.3k

Basetenbaseten.coProduction inference platform for deploying open and custom models with dedicated, autoscaling GPUs.Inference & HostingPaid★ 1.2k

OpenRouteropenrouter.aiUnified API to hundreds of models from many providers with automatic fallbacks and price routing.Inference & HostingFreemiumHN 34

Modalmodal.comServerless platform for running Python and GPU workloads, from inference endpoints to sandboxes, defined in code.Inference & HostingFreemiumHN 18

vLLMdocs.vllm.aiHigh-throughput LLM serving engine built around PagedAttention, with an OpenAI-compatible server.Inference & HostingOpen source★ 93.2k

Replicatereplicate.comRun and deploy open models through a simple API, packaging custom models with Cog.Inference & HostingPaid★ 9.5k