Post

Who is going to be the first ATProto dev to build an LLM based feature that uses the auth'ed user to provision an API key and do the inference on behalf of the user?

@xan.lol hey, doesn't witchsky need an LLM API for alt text?…

yes, although idk if any of the models on cocore support reading images? should see to make cocore work if it does

We just added image support! It should work on 0.9.31 (which of course means to work right we need the ability to target machines on a given minimum version number, argh opening another PR), which should be all we need for this!

@xan.lol I'll (@devingaffney.com here) get you set up here in a few minutes and provision two machines and DM you with enough details for how to test it!