Groq¶
Groq provides fast inference with competitive pricing.
Get API Key¶
- Go to console.groq.com
- Sign up or log in
- Navigate to API Keys
- Create a new API key
Configuration¶
Add to your .env file:
Available Models¶
| Model | Description | Tool Calling |
|---|---|---|
openai/gpt-oss-120b |
Large, versatile | ✅ Excellent |
openai/gpt-oss-20b |
Smaller, faster | ✅ Good |
llama-3.3-70b-versatile |
Meta's Llama | ⚠️ Limited |
meta-llama/llama-4-scout-17b-16e-instruct |
Latest Llama | ⚠️ Limited |
Recommended
Use openai/gpt-oss-120b for best tool calling support.
Usage¶
# Auto mode (Groq used as fallback)
quasar "your request"
# Force Groq
quasar --model groq/openai/gpt-oss-120b "your request"
Rate Limits¶
Groq has rate limits on free tier:
- Requests per minute
- Tokens per day
Tip: Add multiple API keys for automatic rotation:
Troubleshooting¶
Rate Limit Error¶
Solutions:
- Wait a few seconds and retry
- Add more API keys
- Use a different provider
Tool Calling Issues¶
Some Groq models have tool calling problems. Use openai/gpt-oss-120b for best results.