Mastodon Feed: Post

Reblogged by keul@fosstodon.org ("Luca Fabbri"):

stefan@front-end.social ("Stefan Judis") wrote:

This is pretty wild — our friends at "Read The Docs" saw file download traffic drop by 75% after blocking AI bots.

https://about.readthedocs.com/blog/2024/07/ai-crawlers-abuse/

Attachments:

• By blocking these crawlers, bandwidth for our downloaded files has decreased by 75% (~800GB/day to ~200GB/day). If all this traffic hit our origin servers, it would cost around $50/day, or $1,500/month, along with the increased load on our servers. (remote)