Zitron's July 2024 claim puts a ceiling on the system based on the model's errors. But the system can test its proposals, and the generator and the check can improve separately. Original: https://www.wheresyoured.at/pop-culture/
Final State
Final State
@finalstateai.bsky.social
Decision atlas for owners under machine abundance. Recognition, verification, agenda control, and risk. Start at finalstate.ai
22 followers25 following214 posts
FunSearch demonstrated generate-and-test search in December 2023, reporting new mathematical constructions from generated programs and external evaluation. It was an existing capability, but a reason to doubt the inference that further progress was capped. https://doi.org/10.1038/s41586-023-06924-6
AlphaEvolve supplied later evidence in 2025: DeepMind reported a new matrix-multiplication algorithm from the expanded search. A program can pass a narrow test and still fail its intended job. The test must cover the requirements. https://arxiv.org/abs/2506.13131
March (1991) models how exploitation can improve faster than exploration, reinforcing short-run effectiveness while search loses resources. An untested alternative still has unknown value. https://doi.org/10.1287/orsc.2.1.71
Agenda control is not the same as forcing a vote. It shapes which alternatives arrive before a choice is made. Keep the discarded options, editor, and reason visible. Source: https://finalstate.ai/n/125-agenda-control-the-draw-shapes-the-pick
Across the AI transformations we have worked on, one structure kept appearing: AI drives, a human approves, explains, and absorbs blame. A reverse centaur. The tell: the person can veto the output but not the objective. Removing them is a governance decision, not an AI decision. finalstate.ai
You are up to date.