Nathan Hamiel

Nathan Hamiel

@nhamiel.bsky.social

Senior Director of Research. Black Hat Review Board Member (AI, ML, and DS track lead) and International public speaker. I focus on emerging technologies and risks at the intersection of humanity and tech. Hype Critic. My writing: https://perilous.tech

771 followers97 following281 posts

OpenAI’s write-up of the incident reads more like a marketing document promoting a feature than an incident summary, while the quote from HuggingFace sounds more like someone accepting an award than someone who just got hacked. It’s a bit surreal.

People are obsessed with data, even when that data doesn't lead to useful optimizations. They often don't consider how data can be detrimantal to the activity they are collecting it for. In this article, I look at how this even extends to people who read. perilous.tech/reading-data...

perilous.techReading Data and Optimizing The Wrong Things - Perilous TechPeople love to utter phrases like “data is the new oil” or “data is the new gold.” When we hear these phrases, we immediately think of businesses and big

And not a moment too soon. Companies were being torn apart by the vulnpocalypse! 🙄 Overhyping these aspects has turned out to be a fantastic foot gun. The features they want to protect against are the most useful features of the model.

This article has an error. What appears as addiction is actually dependence. These students’ brains are rewired by cognitive offloading, not by a chatbot's addictive design. Adding the friction back seems painful, so they fall back to using AI. futurism.com/artificial-i...

futurism.comCollege Students Consumed by "Resignation and Despair" as They're Relentlessly Pressured to Use AIA professor asked his students to share their anonymous thoughts on AI, revealing a a complicated and bleak picture.

"A spokesman for KPMG International said the firm takes the accuracy and integrity of its published content seriously.” 🤣 Content and services continue to degrade around us every day. Are you feeling the AGI yet?

AI won't make you irreplaceable. It might even do the opposite. In this post, I dissect the two most common AI phrases and provide some perspective on why you might not want to wave goodbye to your skills and become one of the faceless. #AI #Skills #Workforce perilous.tech/poor-advice-...

perilous.techPoor Advice From the Two Most Common AI Phrases - Perilous TechYou’ve heard these two phrases uttered thousands of times. They creep into every conversation about AI and work, being mindlessly parroted as people nod in

This take from Ed Zitron needs some tweaking. LLMs impress the non-writers who want to write, the non-coders who want to code, the researchers who simply want to boost their publication count, and the lawyers who’d rather be drinking.

This may be a drop in the bucket for Google, bit it says a lot since it takes a lot for people switch. However, when a service continues to degrade with a slew of features nobody asked for, that's what happens. BTW, you still can't Google the word "disregard" in AI mode.

The flip side is that with the guardrails removed, the models become more useful. Much of the commentary about the dangers here is overly sensational. The way guardrails are added to models is more like wrapping paper than a true protection mechanism anyway.

This is a follow-up to my techno-communism post from last year. So many people talk about utopias or dystopias from the perspective of already being in them. What about the time leading up to them? This is what I call the dystopian lag. perilous.tech/the-ai-adjus...

perilous.techThe AI Adjustment Bureau and the Dystopian Lag - Perilous TechWhenever people discuss utopias or dystopias, they thrust us right into the middle of them, but you find fewer people who talk about the transition period

Pull out irony gun, point directly at foot. He started his own investigation? Wasn't that what writing the book was? Seriously, he had one job! 🤦‍♂️ Incidents like these are a lot more damaging than people think.

These predictions are always 12 to 18 months. That's because the timeframe is short enough to seem impactful, yet long enough for you to forget about the prediction after it doesn't happen.

Ah, yes, "innovation." Please capture what's on my screen, what I say, and what I point at all so I can... do what exactly? It's obvious what Google gets, but what do I get for all this surveillance? Other than, zomg! My Ctrl-c has AI!!!

Imagine having to pay a token ransom to keep your solutions functional. This may become a reality in the very near future. AI cost volatility is a new risk that must be factored into the calculus of AI use and the development of AI-powered solutions. kudelskisecurity.com/modern-ciso-...

kudelskisecurity.comAI Cost Volatility: A New Risk for Security Leaders - Nathan Hamiel - Kudelski SecurityExplore expert perspectives on cybersecurity, leadership, and emerging threats. The Modern CISO Blog delivers strategic insights for today’s security decision-makers.

Agents don't just hallucinate or create errors. They do so with action. If your design isn't robust against these inevitable failure modes, you're gonna have a bad time.

Okay, who made these icons? 😆 When I called out that the icons shouldn't be used, I was asked why. Upon realizing I'd have to explain, I said, "Forget it. They look great."

This article examines the democratization of AI psychosis and the capture of smart people by AI hype. A fascinating yet terrifying trend. We need to recognize when our perceptions of reality are warped, and it’s not as easy as it sounds. perilous.tech/democratizin...

perilous.techDemocratizing AI Psychosis: Why Smart People Are Captured By AI Hype - Perilous TechFor months now, I’ve been fascinated by seeing smart people completely captured by AI hype. The very people who should be pushing back against the hype are

What's happening with all of these price hikes and capability reductions in AI products? Influencers and "visionaries" have been telling us to plan for the price of intelligence to be zero! Apparently, subsidizing tokens while hemorrhaging money isn't a great business strategy.

Recently, there have been plenty of slot machine analogies applied to AI, but Jacques Ellul made this association back in the 1950s. He observed how humans participate less and less in technological creation and are reduced to mere catalysts.

People are losing their jobs to AI, not because of its capabilities, but because of the mere idea of AI. Companies that AI-wash layoffs see short-term gains, but these may translate into long-term losses. Let the great AI washing begin. perilous.tech/the-great-ai...

perilous.techThe Great AI Washing and the Mere Idea of AI - Perilous TechThe cool thing right now seems to be to tell the world you are reducing headcount because of AI, regardless of the reason. Although not a recent development,

Seneca said that the excellence of mind cannot be borrowed or bought. However, that’s exactly what’s being pitched with generative AI. In the end, we don’t get wisdom or AGI from turning books into statistics. perilous.tech/transforming...

perilous.techTransforming Books Into Statistics Won’t Bring Wisdom or AGI - Perilous TechHere’s a secret: turning books into statistics won’t bring AGI, cures for cancer, utopia, or any number of useful inventions that we are told are merely 12 to

The next few years will require vigilance and the ability to envision trade-offs even when no evidence of trade-offs is apparent. These are essential skills in a world that prioritizes dehumanization. This starts with not confusing innovation with progress. perilous.tech/confusing-in...

perilous.techConfusing Innovation With Progress - Perilous TechOne mistake we continue to make, time and time again, is confusing innovation with progress. It’s true that in many cases, innovation is progress. We see the

We need to get much better at envisioning tradeoffs. A symbiosis with AI would mean that we would never know if a thought or memory we have is truly our own. It’s the end of private thoughts and the beginning of a whole new world of manipulation and unintended consequences.

Pretending we’ve achieved AGI and ignoring all of the issues is not an effective control when slapping generative AI into high-risk, safety-critical use cases. While many point to reliability and human responsibility in military use, many aren’t addressing the security aspects.

Generative AI is one of the most manipulable technologies ever invented, and shoving it into systems creates an increased attack surface and unintended consequences. The future of warfare is gonna be lit, in some cases literally.

I first met FX in the early 2000s. We had so many laughs, so many memories. Hell, during just one notorious hacker trip in 2009, there were enough memories to last a lifetime. He will be missed.

The biggest hot take of the past few weeks is that software is dead. But is it really? Seems there are some fundamental realities not being considered. Regardless of success, software vulnerabilities will be absolutely everywhere. Welcome to the new reality. perilous.tech/the-death-of...

perilous.techThe Death of Software Is Greatly Exaggerated - Perilous TechSocial media is flooded with the same hot take: software is dead! Yup, that’s right, the world runs on software, but applications are either in the grave or

This Clinejection write-up is great, and I learned some things about GitHub actions caching, too. We experienced the same during our research for our Black Hat USA 2025 talk on attacking AI-powered developer productivity tools. adnanthekhan.com/posts/clinej...

adnanthekhan.comClinejection — Compromising Cline's Production Releases just by Prompting an Issue Triager | Adnan Khan - Security ResearchClinejection — Compromising Cline's Production Releases just by Prompting an Issue Triager - Security research by adnanthekhan