Joel Martin

Joel Martin

@kanaka.bsky.social

Creator of mal/make-a-lisp, noVNC, websockify, clj-protocol, conlink, instacheck, miniMAL, wam, wac, warpy, raft.js (github.com/kanaka). Interested in Clojure, WebAssembly/wasm, AI/LLMs, JS, Rust, network protocols, web browsers, testing, etc.

63 followers56 following79 posts

I had Opus 5.5 create an implementation in Fortran/f90. Existing mal impls (e.g. python, C, Go, Rust, etc) are in the training data but there is no fortran impl. It took 27 mins and that included a mark and sweep garbage collector and performance profiling/optimizations.

Joel Martin reposted

Replying to @kripken.com

OpenAI certainly made mistakes, and this removes none of their responsibility. But some people think that if we just used LLMs in some safe way, everything would be fine. There is no such option. This technology is extremely capable, and not entirely predictable.

After Mythos/Glasswing and now the Erdős unit distance conjecture, I decided to reread ai-2027.com. Honestly a bit unnerving that reality seems to be well ahead in many ways. 😬

Joel Martin reposted

I can't find an option in the Gmail iPhone app to view raw email headers, which is deeply frustrating when I am trying to evaluate a suspicious email to figure out if it's a phishing attack or not

Joel Martin reposted

Zawinski's law (www.laws-of-software.com/laws/zawinski/) should read "Every program attempts to expand until it can *chat with an AI.* Those programs which cannot so expand are replaced by ones which can." I'm not sayin' I like it, but it is what it is

laws-of-software.comZawinski's LawA catalog of the laws guiding software development. Especially useful for individual contributors, new managers, and product managers who want to build well-made software.

Free idea for an unsaturated LLM benchmark with large real-world value: - input: raster image of a diagram - output: a dot/mermaid diagram with correct nodes, edges, labels, fonts, colors, subgraphs/groupings, etc. Bonus: it is automatable and has variable complexity.

Joel Martin reposted

Folks: Use AI in hard mode. Use it to be stronger, not as a substitute for your strength. And for goodness sake, don't let it be your voice. It's a great audience and editor to give you feedback and to train and refine your voice. Your voice is you — don't lose it!

Joel Martin reposted

Replying to @lusaimon.com

Prototypes are the most powerfully tool I know of for increasing the productivity of conversations about what software should do and how it should work They're tools for thinking

Joel Martin reposted

I added a basic tool use chapter to the rlhfbook if you've long heard about it and never spent the time to learn the fundamentals of what it actually is and how the data is formatted. (I'm becoming more tool-pilled)

Joel Martin reposted

"Design Patterns for Securing LLM Agents against Prompt Injections" is an excellent new paper that provides six design patterns to help protect LLM tool-using systems (call them "agents" if you like) against prompt injection attacks Here are my notes on the paper simonwillison.net/2025/Jun/13/...

simonwillison.netDesign Patterns for Securing LLM Agents against Prompt InjectionsThis a new paper by 11 authors from organizations including IBM, Invariant Labs, ETH Zurich, Google and Microsoft is an excellent addition to the literature on prompt injection and LLM …

Joel Martin reposted

By surveying workers and AI experts, this paper gets at a key issue: there is both overlap and large mismatches between what workers want AI to do & what AI is likely to do. AI is going to change work. It is critical that we take an active role in shaping how it plays out. arxiv.org/pdf/2506.06576

Joel Martin reposted

Lots of neat stuff in this paper showing 30% of US python commits use AI As of the end of 2024: “the annual value of AI-assisted coding in the United States at $9.6−14.4 billion, rising to 64−96 billion if we assume higher estimates of productivity effects reported by randomized control trials”

Joel Martin reposted

Joel Martin reposted

Replying to @simonwillison.net

I think the one counterexample is that it's good at writing a lot of code, which is creating more text. My rough rule of thumb is that LLMs are good when it's easy to verify the output as correct, which is quite a lot of things

@emollick.bsky.social You might be interested in this: bsky.app/profile/kana... I made it to be lower barrier than other agent tutorials I've seen: no API sign-up/credits needed (via free GitHub Copilot) and hopefully it is approachable for less experienced python devs (incremental, diagrams, etc)

Joel Martin@kanaka.bsky.social

A 6 step tutorial on creating an LLM coding agent: kanaka.github.io/blog/litellm.... * Uses LiteLLM * About 140 lines of python when finished * Can use the free plan of GitHub Copilot (no API sign-up/credit is needed to work through the steps) * Step 5 of the agent is used to create Step 6

Joel Martin reposted

A 6 step tutorial on creating an LLM coding agent: kanaka.github.io/blog/litellm.... * Uses LiteLLM * About 140 lines of python when finished * Can use the free plan of GitHub Copilot (no API sign-up/credit is needed to work through the steps) * Step 5 of the agent is used to create Step 6

kanaka.github.ioAn LLM Coding Agent in 6 incremental steps and about 140 lines of pythonI will show you how to create a working LLM coding agent in 6 incremental steps (and about 140 lines of code). We will use the python LiteLLM library and use Github Copilot which means all you need is...

Joel Martin reposted

I think the key bit here is that LLMs don't make me X% faster at everything, it makes me able to solve a specific subset of tasks instantly, *including* many tasks that then boost my regular programming. So even though programming is high-leverage, creative, nonfungible, LLMs boost my productivity

folks are talking about how AI makes developers 30% more productive as if that's meaningful—but it simply isn't? programming is a high-leverage, creative pursuit it just isn't a matter of outputting fungible programming-units X% faster

Quantitative LLM benchmarks should probably be generated on the fly rather than a static collection. Think property-based testing (PBT) rather than a pile of individual tests. Reduces memorization cheating and reduces the need for hidden test sets.

Joel Martin reposted

Replying to @bauer.codes

😆. Particularly for FOSS projects, being able to do synthetic user usability testing across a range of user capabilities is pretty interesting. For many of these applications we're looking to maximize how smart the model is but this is a case where we might not want that

Joel Martin reposted

Replying to @kanaka.bsky.social

This, interestingly may be a use case for using "dumber" models in the future, even when more capable models exist, serving as a proxy for a lower range of user capability during this sort of synthetic user testing

Joel Martin reposted

Joel Martin reposted

Replying to @kanaka.bsky.social

I'm having a much less productive experience with a greenfield domain bsky.app/profile/baue... I'm wondering if removing the mal implementations from the explicit context is enough to negate the highly likely case that 3.7 Sonnet has mal in its training set

Paul Bauer@bauer.codes

I'm trying claude code in earnest for a non-trivial grpc interceptor. claude is constantly trying to pull a volkswagen and put conditions into the production code to detect when it's being exercised by a test to make the tests pass. 🤦‍♂️