• @Limonene
    link
    English
    6
    edit-2
    10 hours ago

    From the article:

    It’s futile to block AI crawler bots because they lie, change their user agent, use residential IP addresses as proxies, and more.

    EDIT(2025-01-17 17:50 UTC): … The bots are still hammering away from a different IP every time. About 10% of the requests do not have the amazonbot user agent …