Vicki

Vicki

@vickiboykis.com

Founding list[float] engineer. Recsys. Personalization. Infra. Systems. Normcore code. Nutella. Vectors. Words. Vibes. Bad puns (soon). https://vickiboykis.com/what_are_embeddings/

74K followers901 following2.6K posts

The first time I listened to Berghain by Rosalía I understood that I was witnessing new, true art.

It’s pretty wild how cleanly the labs have been able to spin basic security incompetence into positive marketing

Blog posts we used to have: “how I reduced latency across several hundred machines by 200 ms by removing two O(n)^2 hot paths” Blog posts we have now: “Here’s how to get the most out of /ultrathink in the latest release of Claudex 3.0.5”

Curious about people’s ML dependency management strategies in the face of supply chain risks. Often pinning dependencies particularly in the torch/HuggingFace ecosystem is the only way to create reproducible training and inference code but that means dependabot isn’t happy.

There are like only three design patterns you need to use 80% to make stuff good and fast and elegant Make it a lookup (hashmap) Split it up into smaller pieces (sharding) Combine it into one large piece (map reduce)

There are millions of anti patterns that make stuff slower and less elegant but probably the worst offender is adding a network call

Looking to read an in-depth examination of the project history and code evolution of Bun in Zig, along with a technical evaluation of its current Rust re-implementation. I want to check out links to PRs, sidebars on Zig and Rust, the works. Who’s doing this?

Everyone working on recsys/embeddings/information retrieval/search is sleeping on this newsletter if you're not subscribed. I can't believe I didn't mention it before but it just summarizes the best content in the field every week recsys.substack.com

recsys.substack.comTop Information Retrieval Papers of the Week | Sumit | SubstackA weekly curated newsletter about the latest research papers in the Information Retrieval domain, including Recommender Systems, Search, Retrieval, and Ranking. Click to read Top Information Retrieval...

the actual most revolutionary thing the ai labs have actually done is make it look like it's insanely easy to duct tape together python microservices with all their concurrency issues and trained models with all their transformers issues and have them run as one api call

this is so cool, continuing my local experiments and using pi and lm studio and gemma to introspect how i use agents locally. On the left, you can literally see the streaming tokens and the context window filling up.

Running a local model and harness (Pi + GGUF via LM Studio) and I can see everything it's doing, which is dope.

Vicki reposted

It’s not “do good work and be successful.” It’s doing good work, talking about the work, figuring out how to get your work to the right people, accepting that good work is slower than bad work and finding a path through that anyways

Very strongly recommend breaking out of the token discourse and touching grass from time to time to maintain a grip on reality

Something happens to my brain after agentic coding that I can’t describe. It’s like cognitive offloading which folks have already written about, but even more. It feels like I can’t think through problems anymore. Like a fog. Using agentic but losing my hard-won agency.

The only things that I’ve found counteract this is putting the tool away and reading hard technical books and writing things on paper. I don’t think I ever felt like this when I searched Google or Stackoverflow for answers.

Legitimately feels like an unquantifiable vibe shift the last few weeks where the pendulum is swinging back to reasonable takes and people experimenting with model choice 🙏

Anyone running a bot that summarizes their discords over a given time? Is this something that’s possible with the API?

I find that I can’t concretely commit to an implementation until I touch the code a bit and one thing that it has gotten easier than ever to do is to get to a draft PR where you share your proposed approach and easier see the trade offs of certain design decisions

this tab ordering tells me everything I need to know about GitHub’s actual product priorities for the next year

Vicki reposted

Replying to @vickiboykis.com

Yes, I think my current work on the Hardwood Parquet file parser is a good example: while I can implement it without a lot of dependencies (I decided to ship my own AWS API request signer), hundreds of hours (of LLM usage) went into the project, ensuring correctness, great performance, etc.

I don’t buy the idea that libraries will go away since everyone can just write their own now. Maybe for small internal company use-cases. But libraries are not just code, they’re time invested in edge cases, they’re hundreds of hours of human eyes. I don’t want to replace that.

Just once I wanna see a research paper say, the tokens we pretrained on were not high-quality or diverse, they were absolute trash we scraped from AMA subreddit longtail submissions combined with everyone's public Venmo transaction messages

Vicki reposted

DeepSeek v4 Flash with *local inference* after 24h of playing with that: even with the 2 bit selective quantization GGUF, iti is the FIRST time I feel I have a frontier model running on my computer. This is *crazy*, and probably a much stronger change in the landscape than PRO.