Andy Reid@lemmy.world to Technology@lemmy.worldEnglish · 2 years agoAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comexternal-linkmessage-square170fedilinkarrow-up11.05Karrow-down114cross-posted to: technology@beehaw.orgwolnyinternet
arrow-up11.04Karrow-down1external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comAndy Reid@lemmy.world to Technology@lemmy.worldEnglish · 2 years agomessage-square170fedilinkcross-posted to: technology@beehaw.orgwolnyinternet
minus-squareGenderNeutralBro@lemmy.sdf.orglinkfedilinkEnglisharrow-up10·2 years agoYou’d probably have to go out of your way to avoid logging this. I’ve always seen such logs enabled by default when setting up web servers.
You’d probably have to go out of your way to avoid logging this. I’ve always seen such logs enabled by default when setting up web servers.