Post

hey, nice work! what does your (cached) input:output ratio look like? I don't strongly vouch for our estimates of input/attention costs still being relevant today so would be useful to know how sensitive this is to inputs vs outputs

Very much appreciated your blog post when putting this one together. Thank you. That ratio is very, very input-heavy, so would likely be quite sensitive to those estimates.

0 reposts2 likes

glad it helped! my hope was to inspire more and better work on energy costs of AI. It was moderately but definitely not wholly successful on this: we still need more transparency!