aria
aria
@aurelium.me
research sw infra @ arcee, opinions extremely my own she/her
1.9K followers539 following1.5K posts
the overloading of "diffusion" in an LLM context comes back to bite me again this is an actual text diffusion model, doing multi-pass denoising of tokens. the diffusion in DFlash is different, just a single-pass transformer predicting multiple tokens at once. i imagine both are block-wise though
Mercury 3: dLLMs have arrived, finally Same price as Luna-6, slightly better, but 8x faster text diffusion is here www.inceptionlabs.ai/blog/introdu...
aria reposted
maybe I should become a "bioconservatism is the underpinning of all modern reactionary thought" crank. standing on a street corner shouting at people but instead of "THE END IS NIGH" my sign has a long screed connecting all modern reactionary movements together with it
I mean it seems like Bender has specified quite well the evidence she would accept for the claim (none, because in her mind it's a tautologically false claim).
as much as I like this method aesthetically the engineer in me suffers more the more I think about this. dynamic, conditional, unpredictable memory access like this is the male-to-male extension cord of GPUs
Another new, exciting architecture from my colleagues at Percepta: www.percepta.ai/blog/spotlig...
open.substack.com/pub/halimede... woke up this morning to a substack post perfectly calibrated to cause me maximum pain
aria reposted
arxiv.org/pdf/2609.22978 how could I miss the most important ML event of the week... the DeepSeek sandboxing tech report!
huggingface.co/XiaomiMiMo/M... MiMo-V2.6 is out! and, more importantly to me, the tech report. this is the most batteries-included tech report for a modern frontier model ever. really cool stuff.
tbh I really do not understand this mindset maybe for low-stakes websites and bespoke single-use software but for anything serious, the source code is important because it is the thing you've integration tested to within an inch of its life
Increasingly convinced that specs are now the source and that code is an artifact akin to a lockfile.
aria reposted
blog post from deepseek kernel engineer mp.weixin.qq.com/s/zk0KxuLzhm...
aria reposted
aria reposted
aria reposted
aria reposted
aria reposted
Hi, I didn't wanna make this video but I need to come clean about something. This whole time I've been a p-zombie with no phenomenal experience or interiority. I've been getting messages asking whether there's anything it's like to be me, and the answer is no. I'd say I'm sorry, but, well, you know.
aria reposted
aria reposted
aria reposted
aria reposted
if you want you can just try using a model post-trained mostly by just SFT'ing on hundreds of millions of frontier model replies. it's like 80% of the models on huggingface generally speaking, they suck and barely work. you need extensive RL to make modern models work, there's no way around it
in case anyone doesn't know this the thing about open weights models being made by stealing outputs from big players is almost entirely made up to justify regulations locking openai, anthropic and for some reason google into a cartel position