minus-squareNawor3565@lemmy.blahaj.zonetoFediverse@lemmy.world•Admins: Instnace randomly running extremely slowly? Check for thislinkfedilinkEnglisharrow-up31arrow-down1·7 days agoThat “jackass” sounds like an AI training set scraper. They’re known for being incredibly brutal to the sites they scrape, ignoring robots.txt and other honor-based systems for preventing the site from getting overloaded. linkfedilink
That “jackass” sounds like an AI training set scraper. They’re known for being incredibly brutal to the sites they scrape, ignoring robots.txt and other honor-based systems for preventing the site from getting overloaded.