Post

i think the scummiest part of LLM codegen is that you never know if you're getting an amalgamation of some common idea it's been trained on a million copies of, or just getting One Guy's passion project with the identifiers changed a bit, a thing i have overheard happening more than once

you'd get this same sort of problem generating art or writing, of course, but a number of programmers do not seem to understand that the thing they do is a creative pursuit, as if the existence of a test suite makes it a hard science

so we land instead on this industry-wide authorship laundering, encouraged by having the output come from a natural language interface with a cutesy name that makes it seem like a Guy rather than a fuzzy database with all the attribution filed off

and this isn't about copyright or whatever, just about common human decency between people who Make Things. artists of all stripes seem to understand this pretty intuitively, that you give nods to those you borrow from, because... because that's why we do any of this, to share and inspire

and in fact the theft is arguably worse with programming — you can't share artwork without sharing its pixels, and you can't share writing without sharing its words, but you CAN share a program without sharing its code and in many cases that is the default thing that happens

so codegen LLMs /must/ mostly be trained on code that someone actively decided to share, that its authors wished to contribute to the commons! this industry was just recently fretting over how to support the open source projects it relies on, too. now it exploits them

and hey it turns out that the industry is quite happy to pay millions of dollars for open source code! just not to its developers. no, all that money goes to fucking GOOGLE AND MICROSOFT because they're the ones operating the vacuum cleaners. fucking ludicrous state of affairs.

and if you have even the faintest notion of how this technology works, you KNOW all this. if you've even used autocomplete on your fucking phone you know this! it's not some secret niche behavior. all of the output comes from somewhere

of course sometimes i'll see some clownshoes comment like "well people have always stolen code" as if that's an adequate excuse for an entire industry rallying around paying for a machine that automates stealing code and pats you on the back and promises that's not what you're doing

anyway this sort of thing is why all respect drains out of my body upon finding out someone uses this stuff, let alone actively funds it. because it means they don't respect either the craft or their own peers. what a bummer.