AI crawlers and fetchers are blowing up websites, with Meta and OpenAI the worst offenders
AI crawlers and fetchers are blowing up websites, with Meta and OpenAI the worst offenders 2025-08-21 at 13:45 By Gareth Halfacree One fetcher bot seen smacking a website with 39,000 requests per minute Cloud services giant Fastly has released a report claiming AI crawlers are putting a heavy load on the open web, slurping up […]
React to this headline: