ngrok

ngrok

@ngrok.com

One gateway for all your traffic. Service status available at http://status.ngrok.com.

380 followers14 following96 posts

Pinned

Pull requests to the Public Suffix List have already doubled this year. Most get closed without a merge. The PSL is the volunteer-maintained file browsers use to keep cookies apart. @joelhans.com dug into who keeps it running, and why nobody can replace it. ngrok.com/blog/public-...

ngrok reposted

Highly recommended blog and video by @anniesexton.com about the relation between compression algorithms and large language model token prediction. -> ngrok.com/blog/compres...

ngrok.comCompression is prediction | ngrok blogCompression and LLMs are trying to solve the exact same problem: predicting what comes next. Learn the fundamentals of compression and how better prediction leads to better shrinkage.
ngrok@ngrok.com

The best compressors are... LLMs? Compression and language modeling share a job: predicting what comes next. @anniesexton.com shows how those predictions become fewer bits, and why gzip still gets to keep its all-important job. ↓ www.youtube.com/watch?v=HkUy...

ngrok reposted

I made a video about the compression article, it has animations, go watch it and admire my sick new studio.

ngrok@ngrok.com

The best compressors are... LLMs? Compression and language modeling share a job: predicting what comes next. @anniesexton.com shows how those predictions become fewer bits, and why gzip still gets to keep its all-important job. ↓ www.youtube.com/watch?v=HkUy...

ngrok reposted

Impossible to overstate how much of my soul is imbued into this post. I wanted to push the boundaries of the web as an education platform. Why _shouldn’t_ we run Kubernetes in the browser to demonstrate for-real what happens, and let you influence it? Hope you love it. 🫶

ngrok@ngrok.com

What do a port of Kubernetes to TypeScript and a high-priority bug in the kubelet have in common? They both feature in @samwho.dev's guide to probing, out now. We're experimenting with what next-generation k8s education looks like, and we hope you love it.

What do a port of Kubernetes to TypeScript and a high-priority bug in the kubelet have in common? They both feature in @samwho.dev's guide to probing, out now. We're experimenting with what next-generation k8s education looks like, and we hope you love it.

ngrok reposted

ngrok reposted

This is the coolest article I've ever written. Genuinely. All of you should read it.

ngrok@ngrok.com

Compression and LLMs are trying to solve the exact same problem: predicting what comes next. @anniesexton.com's interactive essay walks us through the basics of compression to reveal its surprising overlap with every language model you've ever used.

Compression and LLMs are trying to solve the exact same problem: predicting what comes next. @anniesexton.com's interactive essay walks us through the basics of compression to reveal its surprising overlap with every language model you've ever used.

ngrok reposted

💡 Tuesday tech tip: At our free & virtual #P99CONF, @ngrok.com's Sam Rose will dive into the mathematical process applied to models to make them smaller and introduce our audience to tools that gauge how much a quantized model differs from its original. www.p99conf.io?latest_sfdc_... #ScyllaDB

Validating JWTs, restricting IPs, and running a WAF on your ngrok endpoints just got 10x cheaper. Traffic Policy is now $0.10 per 100k TPUs, down from $1. OAuth didn't get cheaper. It was already free. ↓ ngrok.com/blog/pricing...

ngrok.comTraffic Policy is now 10x cheaper, and idle custom domains are free | ngrok blogTraffic Policy pricing drops by 10x, custom domains move to active-only billing, and Endpoint Pooling now bills per active endpoint. Here's what changed and why.
View full thread

When you route to a local model, it's full private connectivity: no publicly addressable URLs, no public IPs to allowlist, or ports to open, wherever you've got those GPUs humming. Works with Ollama, vLLM, LM Studio, and the neoclouds, too.

One baseURL change and an access key gets you: → routing to every model, even dedicated ones on AWS, Azure, etc → automatic failover + retries when a model slows or fails → scoped keys per app → token, latency, and cost visibility by app, dev, and model

ngrok reposted

Inviting controversy with this take, which is outside of my comfort zone, but I do stand by it. You can generate good quality code with LLMs, it “just” requires a tonne of human oversight and automated guard rails. Got a week off then I’ll be building my first proper post with webernetes. Stoked.

ngrok@ngrok.com

Our own @samwho.dev ported Kubernetes to the browser. Like a real flippin' cluster with lifecycles, DNS, and a simulated network. It's ~100k lines of TypeScript, almost all written by LLMs, but with every line reviewed by hand to keep it slop-free ↓ ngrok.com/blog/i-porte...

Those dots moving around a webpage? Real (enough) pods sending each other requests over a simulated network, all in your browser. Hit pause and the whole cluster freezes, because it runs on a fake clock. Go poke at the demo for yourself: webernetes-demo.ngrok.app

Yup, @samwho.dev is a wild one for this. But we want to teach the invisible layers of modern software in ways grounded in reality. Ways that'll last for a long, long time. Sometimes that means 100k lines of TypeScript just to earn the right to start telling the story at all.

Sam Rose@samwho.dev

I've made a Kubernetes that runs in the browser, and today we're open sourcing it. The hope here is to make super interactive and visual web content about Kubernetes much easier to write, and we have a whole bunch planned this year. Repo: github.com/ngrok/webern... Demo: webernetes-demo.ngrok.app

Our very own @samwho.dev decided the only honest way to explain how Kubernetes probes work, using his signature interactive essay style, was to build himself a cluster. In the browser. 👇

We gave ngrok domains a `resolves_to` property and, what do you know, made the *routing* part of data residency a one-click. Pin your traffic to specific PoPs so European data stays in Europe, then rearrange the whole thing tomorrow if you want.

ngrok's AI gateway now supports the Anthropic SDK natively. Change your base_url, keep your prompt caching, extended thinking, all of it. The diff is one line & there's no step two. ngrok.com/blog/native-...

ngrok reposted

What do LLMs see? I wrote a lil' tool that extracts the attention matrices out of open models and creates this typing visual, with each token's opacity changing according to its average attention score as the prompt progresses. Dimmer words are considered less important to the model.

Three ships coming soon we're excited about: ◆ region pinning for data residency ◆ similarly, dedicated IPs instead of our default range of multi-tenant IPs ◆ faster & more reliable certificate provisioning for ngrok/custom/wildcard domains ↓

A favorite beat on the new ngrok.com: We put ngrok on top of ngrok.com so you can ngrok while you learn about ngrok. If we're going to ask you to use us for anything, we better do it ourselves first, in prod, and also show our work.