Together AI

1 graded endpoint serving gemma-4-31b · back to the matrix

Findings affecting Together AI

• high inference Several providers drop replayed reasoning: the model never sees its own prior thinking
  The gemma-4 chat template renders reasoning replayed on model turns, and the model card mandates preserving thinking across tool-call turns - the reference provider reproduces this live. These providers delete it before...