Mastodon Feed
Boosted by brib@bribstodon.xyz ("brib :neofox_floof: :Nonbinary:"):
algernon@come-from.mad-scientist.club ("algernon@rustweek") wrote:
Allegedly, OpenAI's crawlers have a small, cheap LLM behind them that tries to detect garbage, and stop scraping if it did that.
Uhm. That's not working too well, guys.
But! This is good information. Now I can specifically target OpenAI's crawlers.
Friday can't come soon enough.