New #AI Model, Qwen-2.5-1M (in 7b and 14b flavors) is really impressive with its context length of 1 million tokens. Now THAT's a hell of an attention span. This rivals Gemini's context window. Going to think of of ways to use and abuse qwen as a system. simonwillison.net/2025/Jan/26/...
simonwillison.netQwen2.5-1M: Deploy Your Own Qwen with Context Length up to 1M TokensVery significant new release from Alibaba's Qwen team. Their openly licensed (sometimes Apache 2, sometimes Qwen license, I've had trouble keeping up) Qwen 2.5 LLM previously had an input token …
0 reposts0 likes