Post

Sam Rose
@samwho.dev

New post! ✨ Prompt caching ✨ My first big project post for @ngrok.com. 5 weeks, 12217 lines of code, 195 commits. I poured a lot into this one, and learned a lot in the process. I really hope you enjoy it ❤️

ngrok@ngrok.com

Yesterday we launched ngrok.ai into early access. Today we're bringing you a deep dive into LLM internals with beautiful visuals crafted by our very own @samwho.dev. Discover exactly what gets cached to offer you 10x cheaper input tokens. ngrok.com/blog/prompt-...

Jack Sleight
@jacksleight.com

Awesome post, incredibly well done as always. 💯 I know I’m in the minority with an iPhone Mini but I noticed a little issue on the smaller screen. The text in this demo wraps, causing height changes that make the rest of the article below jump up and down a bit.

Sam Rose
@samwho.dev

Thank you ❤️ I did notice this while making it. Sadly that was the last visual I made and it was done the day before publishing, and I made the pragmatic decision to accept the imperfection. The smallest screen size I tend to target is the iPhone SE, is the Mini smaller? I might use that instead.

Jack Sleight
@jacksleight.com

According to Google (AI) they have the same logical widths of 375 px. But maybe there are other factors. Anyway it’s not a major issue at all, especially as it’s so close to the end.

0 reposts3 likes

No replies yet.