Groq

groq.com · Inference & Hosting

Freemium

#10 in Inference & Hosting

Inference API running on custom LPU chips, known for very fast token generation.

#lpu#low-latency#inference#api

Visit Groq ↗

About the Inference & Hosting category

Serving engines, local runtimes, gateways and cloud platforms for running models fast and cheaply in production or on your laptop.

Groq is one of 10 inference & hosting tools indexed on Drydock. Facts on this page come from the tool's official site and public APIs; prices and features change, so confirm details on the official website before you commit.

// related

Related tools

All Inference & Hosting →

Fireworks AIfireworks.aiFast inference platform for open models with fine-tuning and compound AI tooling.Inference & HostingPaidHN 5

Basetenbaseten.coProduction inference platform for deploying open and custom models with dedicated, autoscaling GPUs.Inference & HostingPaid★ 1.2k

Replicatereplicate.comRun and deploy open models through a simple API, packaging custom models with Cog.Inference & HostingPaid★ 9.5k

Together AItogether.aiCloud for running, fine-tuning and training open models, plus on-demand GPU clusters.Inference & HostingPaidHN 4

Ollamaollama.comThe simplest way to download and run open models locally, with a CLI, desktop app and local API.Inference & HostingOpen source★ 182.3k

OpenRouteropenrouter.aiUnified API to hundreds of models from many providers with automatic fallbacks and price routing.Inference & HostingFreemiumHN 34