Daniel Van Zant

Daniel Van Zant

@danielvanzant.bsky.social

Building AI that amplifies human expertise instead of diminishing it. Founder at https://www.sylvum.com PhD Student at https://www.mpcrlab.com

16 followers20 following121 posts

1/ I did a historical analysis of five transformative technologies from 1950 to now. Research periods with long time horizons and high uncertainty were about three times more likely to experience sustained underfunding.

View full thread

3/ I call this the coarse-graining problem, borrowing from Stephen Wolfram. Funding agencies are computationally bounded observers. They cannot track every investigation in detail, so they rely on proxy indicators. Transformative research often resists this. The details matter.

1/ I did a historical analysis of five transformative technologies from 1950 to now. Research periods with long time horizons and high uncertainty were about three times more likely to experience sustained underfunding.

2/ There is an explanation. Public research funding in a democracy requires public justification. Agencies defend budgets to legislators who defend votes to constituents. This creates pressure toward research that can demonstrate understandable progress within politically relevant timeframes.

When I find an interesting article/paper/etc I don't read it right away, I save it in a folder on my computer. Once I have enough, I run a small script to get it printed as a glossy magazine with an AI-designed cover (here's the latest) and read through everything at my leisure.

Setting up a weapons shop inside Rome's walls makes you a respected merchant. Outside the walls, you're seen as a barbarian threat, but you're free from Rome's taxes and politics. Research has the same geography. It's worth knowing which side of the wall serves your purposes.

Hyperdimensional spaces (like the ones that LLMs and other AI systems work in) have emergent properties that are more than just "scaling up 3 dimensions a lot". Is there a single resource that lists these unique properties. Or even better one that gives a good intuition of them? #MLSky

Being unbiased in science communication seems almost impossible. I admire scientists who, instead of pretending to be unbiased, work to be transparent about their biases. I.e. "I came up with this theory so I prefer it," "my field looks at this thing this particular way," etc.

Daniel Van Zant reposted

Daniel Van Zant reposted

Replying to @seanmcarroll.bsky.social

Wikipedia is also a good evaluator of how much I can trust the LLM. If the topic has multiple fleshed-out Wikipedia articles with lots of sources then the LLM is usually mostly right. If there's just one two-paragraph article that cites one paper then usually the LLM output has many hallucinations.

Daniel Van Zant reposted

There's so much polarization around LLMs. They are way overhyped, I agree. But I also use them semi-regularly now. Here's a thread of genuine use cases where I find them helpful. Please add your own!

Demo of an AI tool that displays relevant information live as you are having a technical conversation or presentation. The display is based on either a query you gave it beforehand where it can grab and process relevant documents from the internet. www.danielvanzant.com/p/augmenting...

danielvanzant.comAugmenting technical conversations with AI (demo)A quick demo of a project I am working on for an AI tool that displays relevant information live as you are having a technical conversation or presentation.

1. Figure out what the current self-maintenance mechanisms are. 2. Figure out how to circumvent those self-maintenance mechanisms. 3. Setup new self-maintenance mechanisms for the new desired state. 4. Wait for the system to transition on its' own to the new desired state.

www.newscientist.com/article/2472... UK tech secretary's official chatgpt records were requested and given under freedom of information(FOI) laws. Under most FOI laws, text conversations between two people on are exempt. Should conversations with a chatbot be treated the same?

newscientist.comRevealed: How the UK tech secretary uses ChatGPT for policy adviceNew Scientist has used freedom of information laws to obtain the ChatGPT records of Peter Kyle, the UK's technology secretary, in what is believed to be a world-first use of such legislation
View full thread
View full thread

5/7 The key innovation: Investors' returns are higher when solutions come sooner. This creates powerful incentives for speed, collaboration, and funding approaches too radical for grants but too public-good-oriented for industry.

arxiv.org/abs/2502.203... Maybe LLM's are using symbolic mechanisms built through transformers? Raw transformers are only the "machine code" explanation for how LLM's incredible performance. I really enjoy papers like this that form theories about what the "software" might be.

arxiv.orgEmergent Symbolic Mechanisms Support Abstract Reasoning in Large Language ModelsMany recent studies have found evidence for emergent reasoning capabilities in large language models, but debate persists concerning the robustness of these capabilities, and the extent to which they ...
View full thread
View full thread

2/7 What makes U-matrices valuable is their ability to partially maintain two key properties from the original data: they show both adjacency information (which points are neighbors) as well as distance information for your set of hyperdimensional points in space.

3/7 Finding a good list of resources on these has been challenging so I am posting this here in hopes that someone else can save themselves some frustration in the future. If you know of any additional high quality resources on U-matrices I would love to hear about them. Recommended reading order:

Have been trying to understand what it means for a system to be Turing-complete (which in theoretical computer science acts as a sort of "check" for programming languages or physical computing systems). For a system to be turing-complete it must be able to compute an arbitrary

Anytime a researcher who is an expert in their field writes a book with the intention of being accessible, I immediately add it my reading list. Chaitin, Ericsson, Penrose, and Schwarzlose come to mind as folks who are examples of this. Any that I should add to my list?

From a fun conversation with a friend who is working on a sci-fi novel on what some neuroscientifically realistic options for something like "mind-control" could look like assuming technology in 20 years. These are some of the cooler papers I found.

Had a fun conversation with a friend who is working on a sci-fi novel on what some neuroscientifically realistic options for something like "mind-control" could look like assuming technology in 20 years. These are some of the cooler papers I found.