The GreenPT Cache Problem Fixed Itself A month ago I published a post about burning €11 in 18 minutes on GreenPT. The session logged 10 million input tokens with zero cache hits.... https://mrmurphy.dev/the-greenpt-cache-problem-fixed-itself/
mrmurphy.devThe GreenPT Cache Problem Fixed ItselfA month ago I published a post about burning €11 in 18 minutes on GreenPT. The session logged 10 million input tokens with zero cache hits. Every request billed the full conversation history. GreenPT support responded to that post and refunded the €11. They said they do caching internally, but that it's opaque from the API — you wouldn't be able to see cache stats in the API response. That's no longer the case. Their pricing page now lists cached input rates for several models, and thecached_tokensfield shows up in the API response.
0 reposts0 likes