It’s futile to block AI crawler bots because they lie, change their user agent, use residential IP addresses as proxies, and more.
EDIT(2025-01-17 17:50 UTC): … The bots are still hammering away from a different IP every time. About 10% of the requests do not have the amazonbot user agent …
just drop their traffic at the ip level. works for me
From the article:
Could this be considered illegal computer hacking?
deleted by creator
from my comment