Amoxtli@thelemmy.club to Technology@lemmy.zipEnglish · 4 months agoCloudflare Has Blocked 416 Billion AI Bot Requests Since July 1www.wired.comexternal-linkmessage-square4linkfedilinkarrow-up162
arrow-up162external-linkCloudflare Has Blocked 416 Billion AI Bot Requests Since July 1www.wired.comAmoxtli@thelemmy.club to Technology@lemmy.zipEnglish · 4 months agomessage-square4linkfedilink
minus-squareMike@piefed.chrisco.melinkfedilinkEnglisharrow-up4·4 months agoI had to set up fail2ban + bot detection just to block the suckers. Its mostly amazon and openai for me and my small sites. Google/bing look at robots.txt and respect it. Openai in particular slams any site to the ground quick…
I had to set up fail2ban + bot detection just to block the suckers. Its mostly amazon and openai for me and my small sites. Google/bing look at robots.txt and respect it. Openai in particular slams any site to the ground quick…