Now the Google-Extended flag in robots.

28 Sep 2023, 19:36
Now the Google-Extended flag in robots.txt can tell Google’s crawlers to include a site in search without using it to train new AI models like the ones powering Bard.