AI Bot Blocking

I recently stood up a wiki for a project I do computer-y stuff for (Shousetsu Bang*Bang, one of the longest running NSFW queer webzines, so thank them for my blocklist if you’re inclined) and, like pretty much every other MediaWiki instance stood up on the internet this is getting absolutely pestered with AI scraper bots. It’s not crippling amounts of traffic, but it’s ridiculous and unnecessary amounts and frankly I am completely done with all these people. (Does facebook need to hit a wiki with a thousand or so pages 400k times in a day? No. No it does not)

To not bury the lede too much, there’s a link to my htaccess file you can snag that blocks a lot of these crappy things.

Continue reading →