3mo ago

Is there an European alternative to Cloudflare with AI Crawlers honeypot trapping?

Cloudflare has a system called AI Labyrinth to fight against AI crawlers ignoring web recommended guidelines (Nofollow tag) and crawl without permission, is there any European alternative to Cloudflare with a similar mechanism to fight against AI crawlers?

9 comments

Similar but selfhosted, iocaine
- Iocaine comes from Australia, and Australia, as everyone knows, is entirely peopled with criminals, so I can clearly not choose the goblet next to you.
  
  Well "5 eyes" would be a more interesting argument...
  
  Bullshit, all of the criminals there fell off the earth years ago!
  
  You have a dizzying intellect.
- This one looks interesting, I'll look it up thanks!
I've got one! It's not a trap, but the opposite, which is what many people use Cloudflare for: to protect your web server against the load of LLM scrapers.
It's called "the nuclear option" because it keeps out all bots, including good ones from search, internet archive, etc.
https://github.com/TecharoHQ/anubis

9 comments