Mastodon Feed: Post

Mastodon Feed

kornel ("Kornel") wrote:

Energy usage of LLMs used through an individual chat interface doesn't seem worrying to me. It's not worse than energy usage of a high-end PC, and it's limited by how much a human can ask and read.

But deployment of LLMs as "autonomous #agents seems like a floodgate for wasteful large-scale usage. It makes it easy to run lots of them, without time limits. Getting only summarized outputs hides how much effort was spent in the process of getting it.