mrinfinity@lemmy.world to Linux@lemmy.worldEnglish · 3 months agoLinux desktop market share climbs to 4.45%ostechnix.comexternal-linkmessage-square60fedilinkarrow-up1389arrow-down16cross-posted to: linux@programming.devtechnology@lemmit.onlinehackernews@lemmy.smeargle.fanslinux@lemmy.ziplinux@lemmy.worldlinux@lemmy.ml
arrow-up1383arrow-down1external-linkLinux desktop market share climbs to 4.45%ostechnix.commrinfinity@lemmy.world to Linux@lemmy.worldEnglish · 3 months agomessage-square60fedilinkcross-posted to: linux@programming.devtechnology@lemmit.onlinehackernews@lemmy.smeargle.fanslinux@lemmy.ziplinux@lemmy.worldlinux@lemmy.ml
minus-squaredrphungky@lemmy.worldlinkfedilinkEnglisharrow-up3·3 months agoAnyone using bots that are openly bots would be limiting their shit to robots.txt. Anyone who is out trawling the whole website is probably obfuscating what they’re doing by spoofing new user agents.
Anyone using bots that are openly bots would be limiting their shit to robots.txt. Anyone who is out trawling the whole website is probably obfuscating what they’re doing by spoofing new user agents.