Post

I'm curious if you find any -- I was thinking about writing something in this vein in 2014-2015 after I finished my dissertation on attention but before the "Attention is all you need" paper.

Ooh, you were ahead of the game! I know @nickseaver.website taught a class on attention a few years ago. Maybe he knows!

The conclusion I came to eventually is that I am very confused about what attention is, it doesn't seem very important, and I would rather think about other things. But I lived two houses down from @nickseaver.website for a semester in 2017! I mean not the website, the person.