Mastodon Feed: Post

Boosted by jwz:
alvaromontoro@front-end.social ("Alvaro Montoro") wrote:

A practical visualization of how robots.txt stops AI bots from crawling your website.

#webdev #ai #humor