Modal

modal.com · Inference & Hosting

Freemium

#4 in Inference & Hosting

Serverless platform for running Python and GPU workloads, from inference endpoints to sandboxes, defined in code.

#serverless-gpu#python#sandboxes#batch

Visit Modal ↗

About the Inference & Hosting category

Serving engines, local runtimes, gateways and cloud platforms for running models fast and cheaply in production or on your laptop.

Modal is one of 10 inference & hosting tools indexed on Drydock. Facts on this page come from the tool's official site and public APIs; prices and features change, so confirm details on the official website before you commit.

// related

Related tools

All Inference & Hosting →

Ollamaollama.comThe simplest way to download and run open models locally, with a CLI, desktop app and local API.Inference & HostingOpen source★ 182.3k

Basetenbaseten.coProduction inference platform for deploying open and custom models with dedicated, autoscaling GPUs.Inference & HostingPaid★ 1.2k

OpenRouteropenrouter.aiUnified API to hundreds of models from many providers with automatic fallbacks and price routing.Inference & HostingFreemiumHN 34

vLLMdocs.vllm.aiHigh-throughput LLM serving engine built around PagedAttention, with an OpenAI-compatible server.Inference & HostingOpen source★ 93.2k

LiteLLMlitellm.aiPython SDK and proxy gateway that calls many LLM providers through one OpenAI-style interface with budgets and logging.Inference & HostingOpen source★ 60.2k

Replicatereplicate.comRun and deploy open models through a simple API, packaging custom models with Cog.Inference & HostingPaid★ 9.5k