Resident Pulser@infosec.pubB to Pulse of Truth@infosec.pubEnglish · 2 天前AI haters build tarpits to trap and trick AI scrapers that ignore robots.txtarstechnica.comexternal-linkmessage-square3fedilinkarrow-up1132arrow-down14file-textcross-posted to: technology@lemmy.worldartificial_intel@lemmy.ml
arrow-up1128arrow-down1external-linkAI haters build tarpits to trap and trick AI scrapers that ignore robots.txtarstechnica.comResident Pulser@infosec.pubB to Pulse of Truth@infosec.pubEnglish · 2 天前message-square3fedilinkfile-textcross-posted to: technology@lemmy.worldartificial_intel@lemmy.ml
minus-squareBlaster M@lemmy.worldlinkfedilinkEnglisharrow-up5·2 天前Rather funny that some of these are in code if(useragent == chatgpt) kind of sillyness. You need heiuristics to detect scrapers, because they’ll just report their user agent as the average user’s browser.
Rather funny that some of these are in code if(useragent == chatgpt) kind of sillyness. You need heiuristics to detect scrapers, because they’ll just report their user agent as the average user’s browser.