Nick Huntington-Klein
Nick Huntington-Klein
@nickchk.com
Econ prof at Seattle University. Book The Effect http://theeffectbook.net out now! Substack https://nickchk.substack.com/ Twitter @nickchk
8.6K followers287 following1.4K posts
There is a new video on my channel about the principles of microeconomics: Economics Principles are Good, Actually youtu.be/_gxFIpedttc?...
bummed that there will likely never be a moment in my future where i can use the pickup line "hey Richard, we should link later" www.youtube.com/watch?v=TZCE...
Well this is a new approach to me. I'm gonna guess that NYT Bestselling novelist @lauranowlinauthor.bsky.social did not actually write this and is probably not in the business of writing to econometrics textbook authors to ask about their writing process
decided to start a thread that i will come back and add to whenever i hear a song and i'm like 'oh damn that's really good' www.youtube.com/watch?v=Dryd...
not digging super deep here but gotta recognize www.youtube.com/watch?v=3nWJ...
It's that time again, and there's a slight change!!! GPT-6: Fails Gemini 3.1-pro: Fails Opus 6: **Success**! I asked it twice and it was right both times, both in terms of calculating who wins and the chain of logic that works out why Opus 6 is the first model that has ever succeeded on this task.
Inspired by @proptermalone.bsky.social 's plan of having Opus 4.6 figure out the matches for bluesky 3CB (which i will definitely be participating in) I tried this task once again with Opus 4.6. It does better than previous models! But it still gets the wrong answer.
I have been running this test on every big new model since *2024* and this is the first time a model has actually solved it. Why is this such a hard task for LLMs? I discuss this in an old Substack: nickchk.substack.com/p/ai-errors-...
It's that time again, and there's a slight change!!! GPT-6: Fails Gemini 3.1-pro: Fails Opus 6: **Success**! I asked it twice and it was right both times, both in terms of calculating who wins and the chain of logic that works out why Opus 6 is the first model that has ever succeeded on this task.
Inspired by @proptermalone.bsky.social 's plan of having Opus 4.6 figure out the matches for bluesky 3CB (which i will definitely be participating in) I tried this task once again with Opus 4.6. It does better than previous models! But it still gets the wrong answer.
This episode is interesting as it's about a research group explicitly trying dozens to hundreds of quasi experiments, progressing only with the ones that "work", backing them up with a bunch of robustness tests, and then extrapolating a lot from the results. podcastaddict.com/freakonomics...