DeepInfra
OpenAI chat/completions · serves google/gemma-4-31B-it as gemma-4-31b ·
probed live 2026-08-25 · back to the matrix
Billing
✓
Reported usage consistent with bytes on the wire.
Caching
Sometimes
Reused already-seen context on 1/3 cold→warm trials - a cache exists but a hit is not dependable. Speed numbers →
Flags
-
high inference
Images in tool results: rejected or silently blinded on several providers
The model reads images returned by tools - the reference provider delivers them, perception-judged, and several OpenAI-compat providers prove the standard shape works. The failing providers fail on schema choice, not... -
high inference
DeepInfra and Parasail validate tool_choice but do not enforce it
Invalid values are rejected with a 4xx - every surface signal says the capability exists - but a valid constraint has zero effect on decoding: "required" returns prose with zero calls, and forcing a tool by name yields a...
Every flag links to its finding - evidence, repro, and disclosure records live there; the deepest findings have full writeup pages.