What is Groq?
Groq runs open models on its own LPU inference stack and serves them through an OpenAI-compatible API. Response latency is the reason most developers try it: it is one of the fastest hosted options for supported open-weight text and speech models.
Key Features
- Hosted inference for supported open text and speech models
- OpenAI-compatible request format, so existing clients work with a base URL change
- A developer tier with no card required, rate limited rather than billed
- Official SDKs and a model list with published per-model limits
How to Access
Create an account in the Groq console, issue an API key and check the current rate limits for the model you plan to use. Higher throughput and dedicated deployments are sold on paid plans.