Industry31 Oct 2026
Google, Microsoft, OpenAI and Anthropic back one robots.txt signal to opt out of AI training
The four AI heavyweights will honor a single robots.txt entry that blocks generative-AI training scrapes, with Microsoft also adding a separate control for answer grounding.
