Post

If I read correcly, Mistral says that the energy footprint of training is about 18 billion times a standard response (20.4e6/1.14e-3). How many queries does a model serve in its lifetime? w. 1 bn: training footprit/query ~18 times higher than the per-query usage. w. 10 bilion ~1.8 times higher