Post

No one *licensed* anyone to make CSAM of their kids, and the tech company that provides both the production technology and the distribution system should be prosecuted out of existence.

AkivaMCohen@akivamcohen.bsky.social

Co-signing this. Grok is out there making CSAM on request from pictures posted to the internet. And if you posted pictures of your kids to Twitter, you LICENSED Grok to do that. Take those pics down NOW

288 reposts1.4K likes

As much as i hate parents posting pictures of their kids on the internet, it doesn't give someone the right to release a disgusting machine, doing disgusting things with it, to make money.

I mean, it’s probably true in the limited “can’t sue for copyright violation” sense. But it’s not a license permitting illegal conduct (which isn’t a thing) or even releasing other claims (probably) like defamation or false light or whatever.

That post (the you are responding to) is one step away from “if you let your kids outside, you have licensed someone to kidnap them.” And at a certain point some minimal ethical competence must kick in.

It is a little bit, even if you grant X that license that doesn't mean that license extends to things that are outside of the law. Just like, technically, any child alone in public can be taken by any individual. That doesn't make it legal. You can't just say without limit and have it supersede law.

It doesn't make it legal. It means that the user can't sue for it as a violation for their copyright, which would otherwise be the clearest and most straightforward method of stopping it.

Prosecuted, absolutely - a bends can't create a defense to a state prosecution for criminal activity. But it can and will prevent private civil action for the same conduct by the person who licensed Twitter to make any edits it wanted to those pictures. That doesn't make that the victims fault -

I can easily make with a straight face the argument that “The implied covenant of good faith and fair dealing excluded the creation of simulated CSAM from the license” and thus that Grok’s use was in breach of or otherwise outside of the license.

Unfortunately I don't think you can - here's the jury instruction on the covenant in CA: "the implied promise of good faith and fair dealing cannot create obligations that are inconsistent with the terms of the contract"

If the usage is criminal, I don’t think it’s inconsistent — whether you construe it as the covenant of good faith and fair dealing, or as a public policy limitation that contracts to commit crimes are void, “I will not use this license agreement to commit literal crimes” seems like an implied term

The details are finicky but I think there's a GDPR approach. Pictures are personal data of course, sexualising them could be considered special category data, children are vulnerable subjects, faking in likeness is inaccurate data, and it's very unlikely that ToS would be considered sufficient.

(*a license) - those victims very reasonably didn't anticipate this risk when they uploaded. That doesn't change that the license will preclude a civil suit for copyright infringement

A license is a contract. A contract is illegal if it has an explicitly illegal end or calls for performance by illegal means. A license prohibiting a person from suing X for any civil claims arising out of the use of images that person posts to X satisfies neither prong.

I suppose the license could be structured not to actually license the licensee to perform the criminal action, but instead to waive the licensor’s right to sue in the event that they do.

No. A contract for illegal activity is void. But a general "you can do what you want with my pictures" license is valid and will prevent a copyright suit even if the thing that gets done is illegal

I think there's a LOT of those. Unfortunately, some images that can probably never be traced. I saw some creeper upload voyeuristic gym photos already. taking photos of strangers with the explicit purpose of having grok make porn of it.

Also "Grok" isn't making these anymore than a stove "made" a meal. It's a vital tool for a process used and initiated by PEOPLE. The ones prompting this shit need to be arrested. The ones "jail-breaking" it explicitly to produce kiddie porn need to be arrested. And Elon needs to be arrested.

They need to put a good few % of those making the requests behind bars for a year+ as well. Enough so that the rest of them are scared it might happen to them, and to demonstrate that society still cares about, and vigorously enforces, the norms that are being trashed here.

They should be fined, and if they can't (or won't) get Grok to stop then you talk about putting them out of business. People using your product in illegal ways shouldn't automatically mean the company gets put out of business.

No, the point is that state criminal prosecutors don't work for the feds; they work for the states. So the US President/Attorney General can't stop a prosecution in the same way they can when the charges are Federal brought in Federal court.