Mastodon Feed
Boosted by cstanhope@social.coop ("Your weary 'net denizen"):
wim_v12e@scholar.social ("Wim🧮") wrote:
The more I dig into "agentic AI" the worse it gets. Not only does a query to a #genAI tool now triggers multiple queries to secondary tools which are also massive LLMs, but then people run several of these concurrently, and run that in a loop.
Combine that with the huge system prompts, and the whole thing explodes in terms of compute requirements.
(1/3)
#FrugalComputing