Mastodon Feed
Exterminate all rational AI scrapers, redux redux.
Nine months ago I added an infinite-nonsense honeypot to poison LLM scrapers.
Today, it comprises 69% of URLs served.
Normally it feeds junk after a few seconds delay, but in "high-load mode" it bans IPs. That mode starts when the free-worker count is low, and ends when it has been calm for 15 min.
This month it has been in high-load mode 50% of the time.
https://jwz.org/b/ykwy