John Paulett
John Paulett
@johnpaulett.com
Engineering Leader & Architect @hoppr.ai #radsky #medsky
223 followers43 following81 posts
If you're not using Claude Code, you are missing out. AI coding has taken a giant leap over the past few months Great article with some tips spiess.dev/blog/how-i-u...
My background: I am a long-time GitHub Copilot and continue.dev user (with multiple LLMs, recently Claude).
Time and time again, starting with #postgresql would just make life easier. If at some point you need to scale beyond PostreSQL, you are an enviable success story. engineering.usemotion.com/migrating-to...
How is it 2025 and the receiver of Outlook invites can not control the reminder time 🤯? It's not like we need 15 minutes to walk to a conference room. We're just bouncing between video calls. The number of meetings I forgotten about because I've moved to another task ... @microsoft.com
www.latent.space/p/reasoning-... The DeepSeek R1 meltdown is impressive to watch. The democratization of top-tier models and the cratering of training cost has opened thousands of opportunities.
Deep dive on NVDA: Despite AI boom, major threats emerge from innovative hardware (Cerebras, Groq), custom silicon (big tech), software alternatives (MLX, Triton), and DeepSeek's 45x efficiency gains. Risks may not be priced in @ 20x sales & 75% margins youtubetranscriptoptimizer.com/blog/05_the_...
DeekSeek built a reasoning LLM using reinforcement learning, minimal labeled data, and auto-verification. Key innovation: R1-Zero proves high-quality reasoning possible without massive supervised datasets. newsletter.languagemodels.co/p/the-illust...
www.latent.space/p/reasoning-... The DeepSeek R1 meltdown is impressive to watch. The democratization of top-tier models and the cratering of training cost has opened thousands of opportunities.
"R1 distillations are going to hit us every few days - because it's ridiculously easy (<$400, <48hrs) to improve any base model with these chains of thought eg with Sky-T1" news.ycombinator.com/item?id=4282...
HuggingFace: "We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open!" x.com/_lewtun/stat...
John Paulett reposted
HOPPR signs imaging AI vets Boonn, Kim 🙏 Thank you for sharing this news, @auntminnie.bsky.social @wboonn.bsky.social @ksiddiqui.bsky.social
Phi-4 fine-tuneable via unsloth: fixing bugs 🐛 and moving to llama 🦙 architecture. unsloth.ai/blog/phi4
🤗 transformers now has ModernBERT included! github.com/huggingface/...
John Paulett reposted
It's easy to lose sight of the fact that, from a tech perspective, we're absolutely living in the future. Our CEO and co-founder @apenwarr.ca looks at just how powerful our modern machines are — and what that means for all of us
Very cool: prompt-based SVG generation with distinct editable shapes. sagipolaczek.github.io/NeuralSVG/
🚑 Part 3 of ModernBERT in Radiology 🚑 Combining Parts 1 and 2, I show how easy it is to fully fine-tune ModernBERT with a Classifer task objective to predict UMLS concepts from radiology text. www.johnpaulett.com/2025/modernb...
NYC AI > The city’s “AI transformation has begun,” with more than 2,000 AI startups and 40,000 workers already forming a “thriving tech ecosystem,” according to the report by the city’s Economic Development Corporation. gothamist.com/news/ai-will... #nyc #ai #startups
John Paulett reposted
Start the New Year off right with issue #670 of The Imaging Wire at buff.ly/4gJi0d4: - Is Radiation Dose Too Low? - What Now for Medicare Fix? - What Triggers Radiation Dose Alerts? - RT Enrollment Grows - Mammo Screening Falls Short ... and much more! #radiology #medicalimaging #ImagingAI
🚀 Fine-tuning ModernBERT for Radiology 🚀. Part 2 of my 3-part series shows how to use the ROCOv2 radiology dataset to fine-tune a transformer 🤗. www.johnpaulett.com/2025/modernb... #bert #modernbert #nlp #ml
🚀 Fine-tuning ModernBERT for Radiology 🚀. Part 2 of my 3-part series shows how to use the ROCOv2 radiology dataset to fine-tune a transformer 🤗. www.johnpaulett.com/2025/modernb... #bert #modernbert #nlp #ml
Part 1️⃣ of a 3️⃣-part Series: Exploring ModernBERT and the ROCOv2 dataset to build a multi-label classifier using a simple Logistic Regression model to predict UMLS CUI's from radiology report text. 🩻 www.johnpaulett.com/2025/modernb... with a Colab Notebook! #bert #ml #ai #nlp
Part 1️⃣ of a 3️⃣-part Series: Exploring ModernBERT and the ROCOv2 dataset to build a multi-label classifier using a simple Logistic Regression model to predict UMLS CUI's from radiology report text. 🩻 www.johnpaulett.com/2025/modernb... with a Colab Notebook! #bert #ml #ai #nlp
Great to see UUIDv7 support landing in the upcoming PostgreSQL 18. Monotonicity for orderable IDs is hugely beneficial: improved index performance and work in distributed systems. brandur.org/fragments/uu...
I had recently been using ULIDs (and storing into Postgres' uuid type), but this means I can use purely in UUID in the future. blog.daveallie.com/ulid-primary...
John Paulett reposted
John Paulett reposted
Here's my end-of-year review of things we learned out about LLMs in 2024 - we learned a LOT of things simonwillison.net/2024/Dec/31/... Table of contents:
A home built rig for $12,000 USD that can train a 1B parameter LLM. 🔥 Unfortunately I don't have four spare 4090s laying around. I'll keep playing on Colab for now. sabareesh.com/posts/llm-rig/
Great read on 🤗 transformers -- I've been working through the code over the holidays. Amazing to see the advancements in the #NLP world since 2018 and how easy #HuggingFace has made it to use and customize hundreds of models. amzn.to/4guTRXC
Exploring the hidden states of #ModernBERT with UMAP umap-learn.readthedocs.io/en/latest/