Post

By 2022 Google Translate had been using transformer models for several years. By 2014 Facebook was using deep convolutional neural nets (DeepFave) for face detection. Literally the things you think were “before LLMs” are either basically indistinguishable from LLMs or their direct predecessors.

Generalized computer vision is much newer and more generally useful than being able to pattern match facial measurements by dotting eyes and noses.

Seriously guys, Google’s Attention Is All You Need paper is almost 10 years old. The life you imagine from a decade ago is just a collection of extremely rudimentary systems of the same or similar form.