Post

Darryl Ruggles
@darryl-ruggles.cloud

https://lckhd.eu/zeyqDc #AmazonBedrock #Claude #JSONSchema #AgenticAI For many inference cases it is best to force the responses into a specific structure, but it isn't always possible to get the LLM to do this. Writing defensive code to strip markdown, parse the JSON, and handle the errors is

lckhd.euStructured outputs for Anthropic Claude models on Amazon Bedrock | Amazon Web ServicesAmazon Bedrock now supports structured outputs for all Anthropic Claude models on both the bedrock-runtime and bedrock-mantle endpoints. Receive schema-compliant JSON that conforms to a defined structure, without custom parsing, retry logic, or post-processing, using JSON Schema output format and strict tool use.
Darryl Ruggles
@darryl-ruggles.cloud

ugly. It usually works, but there should be a better way. Now there is. Amazon Bedrock can enforce your JSON schema during generation for Claude models on the runtime and Mantle endpoints.

Darryl Ruggles
@darryl-ruggles.cloud

One catch is that the minimum, maximum, minLength and maxLength params are accepted but not enforced so the call still succeeds and you need to validate those yourself. Check this out from Anshika Saxena and others, with some examples.

0 reposts0 likes

No replies yet.