Post

Oliver Dunk

@oliverdunk.com

Curious as a potential video topic - what should developers be looking out for in the AI space in 2026?

4/1/26, 12:02 pm0 reposts1 like

What do you mean?

Are there particular products or subjects where you think there’s going to be a lot of progress?

Sam Rose

@samwho.dev

4 Jan

Ah I see. Based on mostly vibes… - I think we’ll see 10m token context windows and substantially better long context performance so context engineering will be less important. - I think we’ll see the first usable continuous learning models towards the end of 2026, no idea what to do about that.

singletoned.bsky.social

@singletoned.bsky.social

4 Jan

Context management today is like memory management was in the 80s, but the manual aspect of it will disappear from most engineers lives much faster

Sam Rose

@samwho.dev

4 Jan

- I really want local models to become more of a thing but I think the RAM shortage is going to make it very hard to justify the cost of running them. They’ll continue to get better but you’ll need to use them through some inference provider for the foreseeable.