Post

argument something like: optimisation on a large scale is hard but keeps things coherent; optimisation in pockets is easy but gets very expensively incoherent; LLMs are well suited to optimising for closed systems like games & code, but only insofar as these are sealed off from the Real World

0 reposts0 likes

so they are "decoherent", which means that when you put them in previously coherent systems they tend to eat away at them because they cannot optimise against reality, only comfortable proxies, so complexity must be very actively governed. this feels right?

of course i find that little pockets of decoherence (tiny LLM apps i will use and throw away) are useful and fun. i guess they are not systems that need to weather changes, though, and _that_ is the quality requiring coherence? this language is new to me, i like it.