Skip to main content
Server path: /embedded-groq | Type: Embedded | PCID required: No Generate text using Groq-hosted open-source models including Llama, Qwen, and Kimi at high speed.

Tools

ToolDescription
embedded-groq_generateGenerate text using Groq models

embedded-groq_generate

Generate text using a Groq-hosted open-source model at high speed. Supports system prompts and file analysis. Parameters:
ParameterTypeRequiredDescription
modelenumNoModel to use. Default llama-3.1-8b-instant
systemPromptstringNoSystem prompt to guide model behavior
userPromptstringYesUser prompt or question
fileUrlsstring[]NoURLs of files to analyze
Response fields:
FieldTypeDescription
outputstring or objectGenerated text or structured output
metadataobjectResponse metadata
metadata.modelstringModel used for generation
metadata.usageobjectToken usage statistics
metadata.usage.promptTokensnumberNumber of input tokens
metadata.usage.completionTokensnumberNumber of output tokens
metadata.usage.totalTokensnumberTotal tokens used
Available models:
ModelDescription
groq/compoundGroq compound model
groq/compound-miniGroq compound model (mini)
llama-3.1-8b-instantLlama 3.1 8B instant inference (default)
llama-3.3-70b-versatileLlama 3.3 70B versatile
openai/gpt-oss-120bGPT open-source 120B
openai/gpt-oss-20bGPT open-source 20B
meta-llama/llama-guard-4-12bLlama Guard 4 12B safety model
meta-llama/llama-4-maverick-17b-128e-instructLlama 4 Maverick 17B 128E instruct
meta-llama/llama-4-scout-17b-16e-instructLlama 4 Scout 17B 16E instruct
meta-llama/llama-prompt-guard-2-22mLlama Prompt Guard 2 22M
meta-llama/llama-prompt-guard-2-86mLlama Prompt Guard 2 86M
moonshotai/kimi-k2-instruct-0905Kimi K2 instruct
openai/gpt-oss-safeguard-20bGPT open-source safeguard 20B
qwen/qwen3-32bQwen 3 32B