Davriellelouna@lemmy.world to Technology@lemmy.worldEnglish · edit-24 days agoThe AI company Perplexity is complaining their bots can't bypass Cloudflare's firewallwww.searchenginejournal.comexternal-linkmessage-square250linkfedilinkarrow-up1866arrow-down17
arrow-up1859arrow-down1external-linkThe AI company Perplexity is complaining their bots can't bypass Cloudflare's firewallwww.searchenginejournal.comDavriellelouna@lemmy.world to Technology@lemmy.worldEnglish · edit-24 days agomessage-square250linkfedilink
minus-squarepressanykeynow@lemmy.worldlinkfedilinkEnglisharrow-up1·edit-24 days ago Cloudflare doesn’t distinguish these things It does. You just make useragent like “AI bot request initiated by user” and the website owners will decide for themselves to allow your traffic or not. If your bot pretends to not be a bot, it should be blocked. Edit. Btw Openai does this.
It does.
You just make useragent like “AI bot request initiated by user” and the website owners will decide for themselves to allow your traffic or not.
If your bot pretends to not be a bot, it should be blocked.
Edit. Btw Openai does this.