SambaNova

1 graded endpoint serving gemma-4-31b · back to the matrix

Findings affecting SambaNova

• medium inference SambaNova ships raw chain-of-thought as the answer when truncation lands mid-thought
  With thinking on, a max_tokens cut that lands inside the thought returns the entire raw thought channel - literal template marker included - in the content field, with the reasoning field empty and no answer at all....