Post

gabby
@fullmoon.id

I'm increasingly convinced that this is the #1 reason why frontier LLMs are still not capable of one-shotting high quality code They need to spell out their reasoning process in the completion in order to get the right result so when you style transfer that reasoning to code you get cluttered code

gabby@fullmoon.id

I've long suspected that when LLMs "code" (meaning: one shot a coding solution) what they're actually doing is a style transfer of their thinking process to code (no different than translating their inner abstract thoughts to English/French) In other words, "coding" for them is a low-rank adaption

3 reposts28 likes

3cats
@rachel.supply

one of the more interesting LLM artifacts i see is when some chain of reasoning shows up as a bunch of comments in the generated code and is never resolved it’s a lot of double checking and backtracking, and i see it show up most often when some small check runs headfirst into a design issue