A Shared AI Training Signal Is Coming: What Defense Firms Should Know
On October 30, 2026, Google added a note to its crawler documentation saying it intends to support a shared, machine-readable signal that lets site owners state whether their content may be used to train AI models. The signal is being developed through the IETF, the body that writes many internet standards. Microsoft, OpenAI and Anthropic made similar commitments the same day, according to coverage of the announcement.
For a criminal defense firm this sounds like a publisher's problem. It is closer to home than that. The same robots.txt file that would carry a training preference also decides whether AI search tools can read the pages you want them to cite. A firm that reacts to this news by blocking every AI bot could quietly remove itself from the answers people get when they ask an assistant about a DUI or an assault charge. Here is what changed, what has not, and what to check.
What Google actually announced
The change is an intention, not a live feature. Google's crawling changelog describes the October 30 update as a note about its plan to support the shared training preference. Reporting on the announcement put the target for support in 2027, and the IETF proposal behind it is still a draft that could change before anyone implements it.
The idea is simple. Today, a site that wants to opt out of AI training has to name each company's crawler separately in robots.txt. A shared signal would let a site state one training preference that several AI providers honor. Google already offers a control called Google-Extended, introduced in 2023, which governs whether content is used for its Gemini models. Google says Google-Extended does not affect whether a site appears in Google Search.
Nothing you do today depends on the final format. If you follow the draft, wait for the standard and for each company's documentation before editing your file around it.
Training and search are separate decisions
The most useful thing a defense firm can take from this news is the distinction it makes clear. Letting a company train a model on your pages is one choice. Letting its search tool read your pages so it can cite them in an answer is another.
The major AI companies already split these jobs between different crawlers. OpenAI documents GPTBot for training and OAI-SearchBot for ChatGPT's search features, and says sites that block OAI-SearchBot will not be shown in ChatGPT search answers. Anthropic lists ClaudeBot for training and Claude-SearchBot for improving search results, along with Claude-User for pages fetched when a user asks. A firm can refuse training while still allowing search access, and the coming shared signal is built around that same split.
If your goal is to be named when someone asks an assistant about local defense lawyers, the search crawlers matter far more than the training crawlers. For a sense of what those assistants currently say to people asking about charges, this research note on what AI chatbots tell people who ask about a criminal charge is a useful starting point.
Check what your site is blocking right now
Many firms have never looked at their robots.txt file. Others had a developer or plugin add rules years ago. Before any new standard arrives, find out what is already there.
- Open yourdomain.com/robots.txt in a browser and read every line.
- Note any user agents that are disallowed, especially GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, PerplexityBot and Google-Extended.
- Ask your host or CDN provider whether a bot-blocking setting is turned on. Some providers offer one-click AI crawler blocking that works outside robots.txt, and it may have been switched on without anyone at the firm knowing.
- Write down the firm's actual preference for training and for search, then make the file match it.
If a search crawler is blocked by mistake, fixing it is usually a one-line change. The effect on AI answers will not be immediate, since each service recrawls on its own schedule.
Other AI search news from the past week
Two smaller items are worth knowing. Search Engine Roundtable reported on November 3 that, for many brand searches, AI Overviews had moved from the main column to the right-hand column of Google's results. That affects how people searching your firm's name see the page, and it is worth checking your own brand search from a phone and a desktop.
Google also updated its guidance on AI-generated content in recent weeks to say such content should be fact-checked and reviewed for accuracy. For a defense firm publishing charge pages and articles, that matches what state bar rules already demand. Any page that states a penalty, a deadline or a procedure needs a lawyer's review before it goes live, however it was drafted.
What to do this month
Most defense firms need no emergency changes. A sensible plan is to confirm the robots.txt file and CDN settings match the firm's wishes, allow the search crawlers of the assistants you want to appear in, and decide your training preference calmly. When the shared signal is finalized, adding it will take minutes.
For continuing coverage of search and AI changes that affect defense practices, follow the legal SEO and AI search news library.
Questions about the shared AI training signal
Will blocking AI training hurt my Google rankings?
Google says Google-Extended does not affect inclusion in Google Search. Blocking Googlebot itself would, so never disallow Googlebot when your intent is only to opt out of training.
Do I need to add the new signal now?
No. It is not live, and the format may change. Watch for official documentation from Google and the AI companies before editing your file.
Does robots.txt stop every AI tool from reading my site?
No. It is a request that reputable crawlers follow. OpenAI notes that robots.txt rules may not apply to ChatGPT-User, which fetches pages when a person asks it to.
SBD Marketing works only with criminal defense firms, one firm per city. It builds websites for defense practices, handles SEO for the charges a firm defends, works on visibility in AI search tools and runs SEO audits.