Post

i think the scummiest part of LLM codegen is that you never know if you're getting an amalgamation of some common idea it's been trained on a million copies of, or just getting One Guy's passion project with the identifiers changed a bit, a thing i have overheard happening more than once

you'd get this same sort of problem generating art or writing, of course, but a number of programmers do not seem to understand that the thing they do is a creative pursuit, as if the existence of a test suite makes it a hard science

so we land instead on this industry-wide authorship laundering, encouraged by having the output come from a natural language interface with a cutesy name that makes it seem like a Guy rather than a fuzzy database with all the attribution filed off

and this isn't about copyright or whatever, just about common human decency between people who Make Things. artists of all stripes seem to understand this pretty intuitively, that you give nods to those you borrow from, because... because that's why we do any of this, to share and inspire

so codegen LLMs /must/ mostly be trained on code that someone actively decided to share, that its authors wished to contribute to the commons! this industry was just recently fretting over how to support the open source projects it relies on, too. now it exploits them

and hey it turns out that the industry is quite happy to pay millions of dollars for open source code! just not to its developers. no, all that money goes to fucking GOOGLE AND MICROSOFT because they're the ones operating the vacuum cleaners. fucking ludicrous state of affairs.

if you have a clever or novel idea, or if you just do the grunt work for some obscure task, your reward is now to have your name erased, to have "Co-authored-by: Claude" stapled on in its place, to have it treated like it just appeared from the æther by some cynical asshole who hates their career

I have seen a huge boom in the number of "free" programs people have created with LLMs. to me this looks a LOT like when arduino came out and everyone who didn't know how to do electronics and code got into arduino. I'm not going to say any of it is quality code, but there is mountains of it.

I have noticed a lot of it seems to be exactly the same projects over and over again with very slight differences. So basically what people were warning about years ago which is, this has not actually helped jobs but instead caused another market-driven race to the bottom