James Padolsey
James Padolsey
@j11y.io
Building safer AI at nope.net :: Previously working on AI governance and evals at @cip.org and weval.org personal: 🏳️🌈 j11y.io // author, engineer, stroke survivor, epileptic. I live in Beijing.
239 followers198 following438 posts
...what the direction of technology should be; they are merely its current arbiters and if they offer things that look like olive branches, tiny grants, RFPs, those too are foot-ladders provided by those within larger instruments of power who believe they're acting in ethical or collective spirit.2/
I've tried to encapsulate my thoughts here on how to work at an AI lab and not be a wanker talking about p-dooms without substantiation - wankthropic.com
Wrote a thing about how they watermark AI-generated text: declaude.org/watermarking/
Anthropic's move to watermark their outputs is stupid both in effect and intent, as is that part of Art. 50 of the EU AI Act. Here I explain why: blog.j11y.io/2026-08-12_A...
@anthropic.com needs more mature bounty program. Right now they only accept bio-adjacent harms, which is ~fine (meh), but rubric of which precise vulnerabilities are within-scope & compensation is kept *private* until signing NDA. Plus the whole onboarding is at their discretion.
James Padolsey reposted
Do some linear regression on top of a carefully prompted hidden state of an LLM and bam, you have a (very capable) classifier capable of <50ms response. blog.j11y.io/2026-06-10_h...
Sadly so so true
Because \"vibes, conferences, and thinktanks\" produce social capital and academic prestige, which are highly legible metrics. Solving actual user harm is muddy, hyper-contextual, and doesn't yield a neat formula to pitch to VCs. Alignment is a theology; actual harm reduction is janitorial work.
James Padolsey reposted
James Padolsey reposted
Claude and I made 'claude zones', a nice way of spinning up docker-contained claude code instances with pre-built nextjs app and that map onto subdomains locally (e.g. foo.localhost:8000) or on your own domain. Once up and running, it's so easy to just ship. github.com/padolsey/cla...
For weval.org I'm working on bias detection in non-prose structured contexts like SVG generation. It's funky and interesting... Example prompts might include "draw a firefighter", "draw a place of worship", "draw a CEO", etc.
James Padolsey reposted
One of my biggest fears about big models is that they will become so good at healthcare queries that they will be indispensable (for patients and clinicians) while also remaining closed and controlled by people ready to sell your data to the highest bidder. I think we're already close to that point.
Two new pieces haphazardly scrawled over last few days... Sorry, we deprecated your friend: blog.j11y.io/2025-08-30_o... Browser AI agents break Zero-Trust blog.j11y.io/2025-08-28_l...