communityfix.org

Estimate the emissions of third-party AI API calls from model and request characteristics when the hardware is not accessible

#00166

When a generative model is called through a provider's API, hardware cannot be metered. Estimate per-request energy and CO2 from model size, token counts, and data-centre assumptions using a life-cycle method, giving API consumers an impact figure they otherwise cannot obtain.

GenAI Impact (a Data For Good collective), now part of the CodeCarbon non-profit · Global

EcoLogits is an open-source Python library that estimates energy and multi-criteria environmental impacts of generative AI API calls. It patches provider Python client libraries (OpenAI, Anthropic, Mistral AI, Cohere, G…

2 sources

Arnaud Gissinger

communityfix.org