Skip to main content

​
What can you do with it?

Use Groq for high-speed AI inference with various open-source models. Ideal for applications requiring fast response times, high throughput, and efficient processing. The command provides access to multiple models with varying capabilities and context lengths for different use cases.

​
How to use it?

​
Basic Command Structure

/groq [prompt] [optional-parameters]

​
Parameters

Required:
  • prompt - Your instructions or questions
Optional:
  • model - Specific model to use (defaults to meta-llama/llama-4-maverick-17b-128e-instruct)
  • system prompt - Override the default system prompt
  • files - File URLs to include in the request (see LLM File Type Support for supported formats)

​
Response Format

The command returns: 
{
  "response": "Model's generated response",
  "format": "Response format (JSON/plaintext/markdown/HTML)",
  "metadata": {
    "model": "Model used",
    "context_length": "Available context length"
  }
}

​
Examples

​
Basic Usage

/groq
prompt: Summarize the key benefits of renewable energy
Gets a quick response summarizing renewable energy benefits.

​
Advanced Usage

/groq
prompt: Solve this complex mathematical problem step by step
model: deepseek-r1-distill-llama-70b
system prompt: You are a mathematics professor
Uses a specific model optimized for complex reasoning with a custom system prompt.

​
Specific Use Case

/groq
prompt: Analyze this lengthy document and extract key insights
files: document.pdf
model: meta-llama/llama-4-maverick-17b-128e-instruct
Processes long documents using a model with extended context length.

​
Notes

Available models include meta-llama/llama-4-maverick-17b-128e-instruct (131K context, default), deepseek-r1-distill-llama-70b, llama-3.3-70b-versatile, llama-3.1-8b-instant, mixtral-8x7b-32768, and gemma2-9b-it. Default response format is JSON.

​
Supported Models

Choose the appropriate Groq model based on your specific needs:
  • meta-llama/llama-4-scout-17b-16e-instruct - Ultra-fast exploration and search tasks
  • meta-llama/llama-4-maverick-17b-128e-instruct (default) - Ultra-fast creative tasks, extended context
  • qwen/qwen3-32b - Ultra-fast general purpose tasks
  • groq/compound - AI system with web search and code execution
  • meta-llama/llama-prompt-guard-2-86m - Groq Prompt Guard 2
The default response format is JSON. Models are optimized for high-speed inference on Groq’s specialized hardware.
⌘I