Drydock.si
Submit a tool

vLLM

docs.vllm.ai · Inference & Hosting

Open source
#5 in Inference & Hosting

High-throughput LLM serving engine built around PagedAttention, with an OpenAI-compatible server.

#serving#pagedattention#throughput#openai-compatible
Visit vLLM ↗GitHub ↗

About the Inference & Hosting category

Serving engines, local runtimes, gateways and cloud platforms for running models fast and cheaply in production or on your laptop.

vLLM is one of 10 inference & hosting tools indexed on Drydock. Facts on this page come from the tool's official site and public APIs; prices and features change, so confirm details on the official website before you commit.

// related

Related tools

All Inference & Hosting →
Ollamaollama.comThe simplest way to download and run open models locally, with a CLI, desktop app and local API.Inference & HostingOpen source★ 182.3kBasetenbaseten.coProduction inference platform for deploying open and custom models with dedicated, autoscaling GPUs.Inference & HostingPaid★ 1.2kOpenRouteropenrouter.aiUnified API to hundreds of models from many providers with automatic fallbacks and price routing.Inference & HostingFreemiumHN 34Modalmodal.comServerless platform for running Python and GPU workloads, from inference endpoints to sandboxes, defined in code.Inference & HostingFreemiumHN 18LiteLLMlitellm.aiPython SDK and proxy gateway that calls many LLM providers through one OpenAI-style interface with budgets and logging.Inference & HostingOpen source★ 60.2kReplicatereplicate.comRun and deploy open models through a simple API, packaging custom models with Cog.Inference & HostingPaid★ 9.5k