Post

Thanks for sharing & it's super interesting to see from someone not at the 'median'! And not to discount what you found but it seems this might be more about the folks who use these tools frequently. And maybe that's worth exploring by itself since more people are using it like you (writing code)

The one that got me was when you said your "median session" was ~150x a "typical query" and then your "typical day" used equivalent of ~4500 "typical queries" Does that mean you have ~30 sessions per day? Let's say they take a conservative 5 minutes of wait per session— that's ~2.5hrs of waiting?

For the record, I totally can see that. And I can imagine the energy usage being a concern if high usage like this becomes more typical & models remain at this efficiency But I'm honestly not sure if it makes a huge difference in overall use (say it's only <1% of all power usage by these models)

0 reposts2 likes

No replies yet.