Learn how to leverage our model ecosystem — explore supported LLMs, check feature compatibility, and understand parameter mapping.
Choose models by modality, quality, latency, and cost. Compatibility differs by provider — always verify parameters before scaling.
Start with a model that matches your input type. Run a small evaluation set, then scale only after quality and cost look acceptable.
Tags: Models
Often yes — keep the request schema stable and change only the model field. Re-test tools / JSON mode when you switch families.
smoke test → shadow traffic → percentage rollout → full cutover
| Field | Notes |
|---|---|
temperature |
Higher = more random |
max_tokens |
Caps completion length |
top_p |
Nucleus sampling |
Different models support different parameters. Use each model's docs for supported fields and expected formats.
Tags: Parameters
Some gateways silently drop unsupported fields. Check the model card; prefer failing fast in your own validation layer.
| Feature | Small text | Flagship text | Vision |
|---|---|---|---|
| Streaming | Yes | Yes | Yes |
| Tools | Limited | Yes | Varies |
| JSON mode | Varies | Yes | Varies |
Always confirm against the live model list — capabilities change as providers ship updates.