Sooo yeah, Talos Linux does run on a jailbroken PS5. For now I can't bootstrap the Kubernetes part and kubelet is not starting up. I'll get back to it later. This is fun.
Thanks! yeah might be it, the image was built with 7.x as that's what is used for the other distros. afaik it's pinned to commit that has specific PS5 patches.
Setting kernel.panic_on_oops to 1 in a SysctlConfig and applying that did the trick. I still have warnings here and there, but the rest is running fine now.