Post

If anybody thinks I think GenAI cyber risks are overblown as I’m a Luddite - no, lead a global team of people who deal with emerging cyber threats and have done for years. We find the weird stuff. Amount of time I have spent dealing with incidents from GenAI cyber threats to date: zero.

8 reposts63 likes

Eh, I tend to agree with last year's report by IBM Red that, once the LLM OPS attack surfaces become profitable, there will be a big problem there. Carlini claims "hundreds" of vulns in the Linux kernel he hasn't reported yet. That's coherent long-term project with clear reporting system. +

If there were a way to find and then chain together vulns on MCP + a couple other things, it might get bad. I think the biggest potential effect Mythos-level LLMs might have is that attack surfaces become profitable sooner.

I work front lines. There's a lot of concern about the accumulated risk from back level systems and potential in change of pace of exploitation. So far, the change has been in self-injury from agentic experiments. This will be a step change like fuzzing was on early introduction.

Indeed - it's quite expensive in real terms to pen test using agents. It is fairly trivial for a Fortune 500 company to do it and it will unreliably and very slowly find a lot of what you've already ticketed but ignored, along with perhaps some interesting gaps.

That's interesting Even forgetting the interesting campaigns, we're seeing use abuse of AI tooling that gives you a websevlrver and a port.