Post

Gemini Embedding 2 is out, and it's natively multimodal! 🐶🔥 but you might be wondering what the heck that means and why that's important? well... take the "this is fine" dog for example...

older encoder models analyzed this using two independent, single-track systems: 🖼️ image encoder processes flames/pixels, and outputs "danger"! 📄 text encoder processes the words, and outputs "calm"! they're isolated, missing the deep cross-modal connections. the model gets confused.

Gemini Embedding 2 processes text, images, audio, and video in a unified vector space. Because it's multimodal, it actually captures the irony of a calm dog in a burning room. You can search your vectors for "ironic dog meme" and find it! read more: medium.com/google-clou...

0 reposts0 likes

No replies yet.