Post

I am about 14 more conversations away from actively refusing from calling anything ”OpenAI-compatible API” ever again. Because, as far as I can tell - it’s not a damn standard, and everyone is applying their own interpretation of what that actually means.

0 reposts1 like

The compat matrix is real: most endpoints claiming it cover /chat/completions, but tool calling, finish_reason and streaming chunks each drift. Cheapest pre-commit check: run one tool-call and see if tool_calls round-trips - plenty of endpoints pass plain chat and quietly fail on function calling.