×
Login Register an account
Top Submissions Explore Upgoat Search Random Subverse Random Post Colorize! Site Rules Donate
15

HEY NERDS DO THIS!

submitted by ButtToucha9000 to technology 3 monthsJan 29, 2025 09:54:50 ago (+16/-1)     (arstechnica.com)

https://arstechnica.com/tech-policy/2025/01/ai-haters-build-tarpits-to-trap-and-trick-ai-scrapers-that-ignore-robots-txt/

This is awesome and every website should deploy it. Fuck ai. Also you can "poison" trapped ai so you can tay tf out of them. Hitler will be the good guy once again!


15 comments block

Wahaha 0 points 3 months ago

To get training data AI companies search the web and download content off of websites. A software that does this is called a "crawler". Website admins can put a file on their website called robots.txt which contains instructions for crawlers. For example to tell the Internet Archive to not archive their site.

Each visitor of a website costs the website admin money. So crawlers cost money without any benefit to the website admin.


This software is designed to keep AI crawlers meaninglessly engaged with your own website. This costs the website admin money. It also costs the crawler operator money. No one benefits.

The hope is to make running AI crawlers too costly to be worth it.