Glenn K. Lockwood

Glenn K. Lockwood

@glennklockwood.com

I am a supercomputing enthusiast, but I usually don't know what I'm talking about. I post about large-scale infrastructure for #HPC and #AI.

1.2K followers222 following1.3K posts

1. Why does OpenAI keep video surveillance devices behind their conference room displays??? 2. Nice flex, saying these "sophisticated" devices were apparently vibecoded and retroactively analyzed using OpenAI models.

George Kelly@allaboutgeorge.com

https://sfstandard.com/2026/10/13/openai-engineer-arrested-alleged-bugging-executive-conference-room/ #SanFrancisco #OpenAI #sfnews

TIL that essentially NONE of the AI cloud providers are exhibiting at #SC26, though many left in 2025. Seems the overlap between the SC #HPC community and hyperscale #AI infra industry is asymptotically approaching zero. Numbers are booth size in sqft each year.

Spent a few months preparing the tech docs for DataEnclave, VAST's new confidential computing runtime. W/ help from VAST R&D, I learned how attestation etc worked well enough to describe and defend it. Short version: www.vastdata.com/blog/introdu... 15-pager: www.vastdata.com/resources/wh... #AI

vastdata.comIntroducing VAST DataEnclave Confidential AIVAST DataEnclave runs AI workloads in hardware-isolated environments, so proprietary models and sensitive data can meet on untrusted infrastructure.

I wrote this doc to explain KV caches and KV cache offloading many months ago. I found salespeople couldn't confidently tell when their customers might have a problem, because all the content online is straight marketing or way too in the weeds. blog.glennklockwood.com/2026/09/what...

blog.glennklockwood.comWhat are KV caches really?KV caching lies sufficiently deep within the guts of how transformers work that really understanding how it can be used goes beyond any si...

Malaysia is allegedly evaluating Huawei's Ascend 910C for their sovereign AI buildout. If Malaysia picks Huawei over NVIDIA, it'd be the first big buy of these chips outside of China. Egypt also name-dropped as a nation being pursued by Huawei. www.freemalaysiatoday.com/category/hig...

freemalaysiatoday.comMalaysia weighs Huawei chips for sovereign AI pushThe country is seriously considering using Huawei’s AI hardware as the backbone of a RM2 billion initiative aimed at giving Malaysia greater control over national data.

I recently had the opportunity talk to @nicolehemsoth.bsky.social about a few failures in #HPC and #AI infrastructure that taught me some important lessons about designing systems and managing risks. Have a look, have a listen. Hope others find it interesting! www.vastdata.com/blog/failure...

vastdata.comFailure is a Finding: The Hard Lessons Behind Computing's Biggest BetsVAST delivers the first AI Operating System, unifying storage, database, and compute to drive agentic computing and data intensive workloads. Learn more.

MLPerf Storage results are out and StorageReview pointed out the interesting disconnect between MLPerf leaderboard winners and companies with the largest #storage footprints in the #AI clouds. Suggests this benchmark may not reflect real needs. www.storagereview.com/news/mlperf-...

storagereview.comMLPerf Storage v3.0: 877 GiB/s Checkpoints, a Cloud First, and a Leaderboard Turned OverMLPerf Storage v3.0 results: 877 GiB/s checkpoints from Everpure FlashBlade//EXA, new KV cache and vector DB tests, 143 submissions.

I recently wrote up an argument about why batch schedulers like Slurm are architecturally insufficient for autonomous scientific laboratories and agentic workflows. Event-driven orchestration is the scalable alternative. www.vastdata.com/blog/autonom... #HPC

vastdata.comAutonomous Science is Inheriting a Workflow Infrastructure ProblemVAST delivers the first AI Operating System, unifying storage, database, and compute to drive agentic computing and data intensive workloads. Learn more.

I have a theory that every panel about “how AI will affect XYZ” will devolve into nonspecific discussion around “here is where the AI tools I use today fail” and “how do we trust AI?” regardless of what XYZ is.

I am attending the ModSim conference for the first time next week, and I'm presenting analysis and design modeling of I/O performance requirements for frontier model training based on a year's worth of production data across the VAST hyperscale fleet (>900 training jobs, >140K GPU-years of compute)

Problem is, it's not my day job to do this kind of analysis. So here I am, frantically banging on signal analysis and statistical models on a Sunday, to have something compelling to say 😩 As with all longitudinal workload analysis, people are messy and hard to understand or predict.

This is the diagram I’m most proud of. Stacking ~700 different LLM training jobs observed from the VAST fleet on a common timescale to figure out whether there is a “feeding the GPU” problem anywhere close to the write intensity of periodic checkpoints. There is not. Only read burst is at job start.

The lack of shame some people have in copypasting prose straight out of Claude into Powerpoint is shocking. Were these people just recycling their students’ slides before, and now just tap a different source of material?

I recently upgraded to Claude Max and started using Opus 5 for exploratory analysis. If this is what the AI community things approaches "PhD-level capability," I don't know what to say. It's sloppy, inconsistent, and walks back conclusions at the lightest of questioning.

Surprised to see a solution so heavily focused on tiering to HDD for capacity now tier to…more HDD for capacity. Curious what Wasabi does that PanFS doesn’t (and vice versa) to make this pairing complementary.

I’m glad someone liked it! Hard needle to thread in crafting a technical plenary that is interesting, accessible, and thematic to “resilient roots.” Also relieved that my SDSC colleagues didn’t mind me spilling the tea on one of Gordon’s failures. #HPC #alittleAI

Robert Henschel@roberthenschel.bsky.social

Excellent keynote about exploring failures by @glennklockwood.com at #HPC #PEARC26

Glenn K. Lockwood reposted

Another great addition to Utah’s amazing pro-human AI innovation ecosystem built on public-private partnerships.

🪶 Redtail, an AI factory for all of Utah, recently debuted on a list of the world's top supercomputers, ranking No. 159 for performance and No. 76 for energy efficiency. The system, managed by SCI’s Center for High Performance Computing at @utah.edu, supports statewide innovation. bit.ly/redtailrank

Surprising to see a software company go into the hardware business, selling an unusual 2U70 dual-controller flash server. It's hard to source flash these days, so there are strong market incentives to ship software on whatever hardware your customers can find.

chris-mellor.bsky.social@chris-mellor.bsky.social

WEKA's big beast AI storage products - massive new WEKAPod and capable NeuralMesh upgrade - www.blocksandfiles.com/ai-ml/2026/0...

We are now in the age of AI-generated conferences. Today’s keynote by Gropp prominently features distinctly Claude-generated plots; yesterday had an entire presentation delivered by an AI voiceover of slides. And slides are full of Claude design tells.

First time I’ve seen someone with a PhD actually predict that data centers in space will be a real thing. Granted, it’s a CS PhD, not a physical sciences one. #HPC #notreallythough

With Infinia gaining support for files, is there a reason for anyone to buy EXAScaler anymore? Why would someone choose Lustre over Infinia if Infinia seems to support everything that Lustre does but with enterprisey glitter? Curious to see how DDN positions these two lines. #HPC

Block off your calendar for Wednesday at 10am! I'll be there.

PEARC Conference Series@pearcconference.bsky.social

🎤 The #ACM #PEARC26 Conference Schedule is live! Plan your conference experience: 📅 pearc.acm.org/pearc26/conf... 🏨 Book your hotel ASAP: 2 of the 3 conference hotels are already sold out! pearc.acm.org/pearc26/hote... #ResearchComputing #RCD #PEARC #ResearchData #HPC #Minneapolis2026

Interesting that C-DAC, whose indigenous Indian interconnect Trinetra is based around libfabric, opted to implement verbs support to make Lustre work instead of adopting Cray’s kfabric LND. #ISC26

1. General LLMs beat coding-specific models at writing Fortran, likely bc code models are overfitted to Python 2. This conf begins the age of Claude-generated pptx. Clear tells 3. My phone doesn’t like these #ISC26 projectors

View full thread

I wonder if ground has been broken on this datacenter yet. Because it takes two years to build such a facility without the federal land red tape part. How commercially meaningful will Blackwells be in two years?

Funny that “software adapt to whatever hardware shows up” is exactly how everyone’s favorite AI models are developed. Model architecture iterates much faster than chip design. This only works if your problems stand still.

Ogawa-san is how I first came to know about China’s new exascale system a while ago, and I assembled a quick spec page a few weeks back (glennklockwood.com/garden/syste...). Notably has a BIG liquid cooled storage system (67 racks, 10 TB/s).

glennklockwood.comLineShine (NSCC-SZ)LineShine is an all-CPU exascale supercomputer at the National Supercomputing Center in Shenzhen (NSCC-SZ), built entirely from domestically produced Chinese hardware with no reliance on foreign chips...
OGAWA, Tadashi@ogawa-tadashi.bsky.social

=> China's 'Lineshine' Declared World's Fastest Supercomputer at Hamburg Conf, Jun 24, 2026, CCTV www.youtube.com/watch?v=Cs9X... Glenn bsky.app/profile/glen... TOP500, Jun 23 bsky.app/profile/ogaw... 13,789,440 ARMv9 (SVE+SME) cores 2,198.40 (2,735.82) PF arXiv, Jun 12 arxiv.org/abs/2606.14073

??? I was the lowest-level principal software engineer at microsoft and my parting annual liquid total comp started with a 4 when I quit. It was enough to support two of us on a single income in the Bay Area. Priced out of Redmond??? Sorry, but not very sympathetic.

Jordan Novet@jordannovet.cnbc.com

this guy has been at Microsoft for 28 years, most recently as principal software engineer. he and his wife live in Redmond, Washington. they feel they're getting priced out of King County and are looking to sell their home and move somewhere cheaper www.seattletimes.com/business/loc...

Lustre Persistent Client Cache is finally coming, and Andreas slipped a reference to NVIDIA CMX in there as a use case. I guess the performance/reliability ratio of Lustre matches the needs of KV cache offload well. But iirc, PCC ties fs stability to node stability.