Post

Do your airBnB's pans look pristine, but everything cooked on it tastes way too garlicky? Multi-tenant RAG/LLMs can be similar: broad semantic queries can leak "residual" context from other tenants. Be careful, though: That weird taste might be from macaroni, but it also might be methyline!

I have contemplated doing some long-term scientific research into Copilot but I don’t present at conferences anymore and don’t work for a team that publishes content. 🤔 I have thoughts about both how to cause leakage, and how to measure leakage.