AI Tools: AI Slop on the Web

Yes, but: Researchers told Axios that a definitive count of AI-made content isn't possible with today's tools and definitions.

• It's hard to determine what content is AI-generated and what is human-generated because humans are increasingly working together with AI.

The intrigue: Common Crawl isn't the entire web, but it is one of the largest sources of training data for large language models.

• As a result, some paywalled websites — where content is presumably human-written — are blocking Common Crawl from indexing their pages.
• This could mean that the volume of human-written articles is even larger than what Graphite's data shows.