Shrinks training pool, but hurts services like the Internet Archive

The internet is becoming significantly more hostile to webpage crawlers, especially those operated for the sake of generative AI, researchers say.…