Post

That is not how any of this works. This is not even close to why its hard to make a machine like that (and very much possible to do so, in theory).

How would a machine capable of detecting that difference be usable to train a 'better' model? Only _if_ the goal was to make it indistinguishable from human, which it is not, the goal is to make it succeed at a set of training tasks! Tasks that in fact don't lead to it being all that human like.

And if we assume that was possible, and that such a detector could be used to train better models, which in turn would lead to better detectors, that would not break any laws of information theory of thermodynamics either! That would still require immersive amounts of compute!

And compute, famously, cost energy! Which is why this doesn't break thermodynamics. It also doesn't break information theory, because we already know what human text looks like, and are just extracting out the patterns that make it look like so via computation.