One question can become several searches
You type one question. The product may not search those exact words.
ChatGPT Search may rewrite a prompt into one or more targeted searches. It may run follow-up searches as it works through the question. Microsoft says Copilot can turn a longer prompt into a shorter Bing search query.
Google calls one version of this query fan-out. Its AI features may search related parts of a question and use a wider set of supporting links.
The simple version looks like this:
| Stage | What can happen |
|---|---|
| Your question | You ask for a service, provider, product, comparison or explanation. |
| Interpretation | The product decides what the question means and whether current web information is needed. |
| Search query | It creates one search, several related searches or no web search at all. |
| Follow-up search | An earlier result may lead to another search. |
Two products can start with the same question and search for different material. You usually cannot see every intermediate query, so do not present a guessed search path as a known fact.
A source must be reachable before it can be considered
A search system cannot use a public page it cannot reach. That is the access layer.
For Google Search, discovery, crawling, indexing and serving are separate stages. A link or sitemap may help Google find a URL. Googlebot must be able to request it. None of those steps guarantees that Google will show it.
Google says a supporting page for AI Overviews or AI Mode must meet the usual Search requirements. It needs to be indexed and eligible to appear with a snippet. Google also says there is no special AI markup or separate technical requirement for these features.
Access can fail for ordinary reasons:
robots.txtblocks the named crawler;- the page uses
noindexor a restrictive snippet control; - the server returns an error;
- a login or paywall blocks the content;
- a firewall or content delivery service blocks the request;
- the useful information exists only in a form the crawler cannot read;
- internal links do not lead to the page.
Fixing access makes the page available for consideration. It does not prove that a system indexed it, selected it or cited it.
| What you confirmed | What you still have not confirmed |
|---|---|
A crawler is allowed in robots.txt | The firewall allowed the request |
| The page returned a successful response | The system indexed or stored it |
| The page is indexed in one search engine | Another product can retrieve it |
| The source appeared once | It will appear again |
Access is necessary for some products. It is not the result.
Retrieval chooses material for this question
Retrieval means choosing useful material for the question being answered.
Sources may come from a search index, a page fetched for the request or another product source. The mix differs by provider and mode.
Perplexity describes a sequence that interprets the question, searches current sources and then synthesizes an answer. Its Pro Search documentation says the product can run multiple searches and use web pages, academic sources, forums and videos.
Claude’s web-search explanation says Claude may generate a targeted query, retrieve results and run progressive searches in which earlier results inform later searches. Microsoft’s public-website guidance separates retrieval from relevance checking and summarization.
Retrieval is a selection step. The system is not required to use every accessible or indexed page.
| Source state | Plain meaning |
|---|---|
| Available | The product may be able to reach or search the source. |
| Retrieved | The product selected material for this run. |
| Used | The selected material influenced the answer. |
| Cited | The interface exposed a source link beside the answer. |
A page can be accurate and still be omitted. Another page may answer the exact question more directly. Give each important page one clear job and answer the buyer’s real question with specific facts.
Synthesis turns selected material into an answer
Synthesis means writing the response from the selected material and the model’s instructions.
The product may combine facts from several pages, shorten an explanation, compare options or add a conclusion. That creates another place where errors can enter.
Source selection and answer wording are separate decisions. The system chooses material, decides which parts matter, writes the response and may attach source links.
The TREC 2025 retrieval-augmented generation research track evaluates retrieval and generation as related but separate parts. It also examines whether an answer is grounded and whether its citations support it.
That model helps explain the stages. It does not prove that every consumer product has the same design. OpenAI also warns that ChatGPT may provide incorrect information or fabricate a citation.
A citation is something to check, not a promise
A citation gives you a source to inspect. It does not automatically mean the answer is correct.
Use this three-part check:
- Open it. Does the link resolve, and can you see the relevant content?
- Match it. Does the page support the statement beside the citation?
- Date it. Is the fact current enough for the buyer’s decision?
Keep three observations separate:
| Observation | What it establishes | What it does not establish |
|---|---|---|
| Citation | The interface exposed a source. | The page supports every nearby statement. |
| Mention | The answer named the business. | A source was shown or the business was endorsed. |
| Recommendation | The answer presented the business as an option. | The buyer visited, qualified or purchased. |
A real source may be old or support one sentence but not the conclusion. Count citations if the count helps, but also check their quality.
Crawler names tell you the purpose of access
There is no single “AI crawler” switch. Providers use different user agents for different jobs.
| Provider | Search or discovery | Other relevant access | What permission does not prove |
|---|---|---|---|
| Googlebot supports Search discovery and indexing. | Google-Extended controls some separate Gemini and Vertex AI uses. | Appearance in an AI Overview, AI Mode answer or any other result. | |
| OpenAI | OAI-SearchBot supports search discovery. | GPTBot is tied to potential training use; ChatGPT-User supports some user requests. | Retrieval, citation or recommendation in ChatGPT. |
| Perplexity | PerplexityBot supports search discovery and is documented as following robots.txt. | Perplexity-User supports user-requested retrieval and has a different access boundary. | Indexing, answer use or a source link. |
| Microsoft | Bingbot supports public-web discovery for Bing-based systems. | Product and administrator settings can control whether web search is used. | Selection by Copilot for a specific answer. |
OpenAI’s crawler documentation says OAI-SearchBot and GPTBot can be controlled independently. A publisher can allow search discovery while disallowing the training crawler. OpenAI also says a robots change may take about 24 hours to affect its systems.
Perplexity’s crawler documentation distinguishes PerplexityBot from Perplexity-User. It also notes that a firewall may need to allow the documented bot even when robots.txt permits it.
Review access by provider, crawler and purpose. Do not assume one allowlist works for every product.
The answer can change even when your page does not
AI answers are observations made under conditions. They are not fixed listings.
The result can change with:
- the exact wording of the question;
- earlier messages in the conversation;
- location and account settings;
- the product, model or mode;
- the sources available at that time;
- a page or index update;
- a product release or temporary incident;
- the system’s source selection and synthesis choices.
Google says different AI experiences may use different models and techniques. OpenAI says location and memory can affect some rewritten searches. Perplexity and Claude describe multi-search behavior that can change the material collected for a run.
One screenshot proves what appeared once, not stable visibility. For a fair comparison, save the exact question, product, mode, location, date, answer and source links. The guide on why AI answers change covers the full test card.
Improve the parts your business controls
You do not control the answer. You do control the quality of the public source path.
Start here:
- make the important page reachable to the crawler you intend to allow;
- give the page one clear purpose;
- state the business, service, product, provider and location facts plainly;
- answer the main buyer question before adding background;
- support important claims with the right primary evidence;
- keep visible content and structured data consistent;
- connect related pages with useful internal links;
- give the buyer an appropriate next step;
- correct stale or contradictory public facts.
Google’s 2026 guidance says established SEO foundations still apply to its generative Search features. It also warns against producing large numbers of near-duplicate pages for every imagined query.
There is no special file that forces an AI product to use a page. There is no schema type that guarantees a citation. There is no agency setting that guarantees a recommendation.
Make the source accessible, the meaning clear and the evidence worth using. Then observe what the platform does.
The buyer question changes across five industries
The search mechanism may be similar. The useful source and valuable action change by industry.
| Industry | Example buyer question | Public source that must be clear | Qualified action to track |
|---|---|---|---|
| Home Services | Who handles this service in my area? | Service, service-area, licence and availability information where relevant | Valid call or booking request |
| Healthcare | Which provider or service is appropriate for this need? | Reviewed provider, service, location and access information | Appropriate appointment request |
| Legal | Which practice and jurisdiction fit this issue? | Reviewed practice-area, attorney, jurisdiction and intake information | Qualified prospective-client enquiry |
| B2B SaaS | Which product fits this use case and buying constraint? | Use-case, integration, limitation, evidence and comparison information | Qualified demo or trial |
| eCommerce | Which product and variant fit this need? | Category, product, availability, policy and merchant information | Valid order |
Healthcare information needs privacy and clinical review. Legal information needs jurisdiction and advertising review. Give each page facts that help its buyer make the next decision.
Measure the answer, visit and result separately
The answer sits in the middle of the buyer journey. Measure each layer with the record that belongs to it.
| Layer | Save | What it proves |
|---|---|---|
| Answer observation | exact question, product, context, date, output and sources | what one recorded run showed |
| Visit | referral, landing page and onsite behavior | a tracked visit occurred |
| Qualified action | booking, intake, CRM or commerce qualification | the action met the business’s rule |
| Commercial outcome | completed job, scheduled care, accepted matter, pipeline or order record | the business recorded the result |
Google announced dedicated generative-AI visibility reports in Search Console in June 2026 for a subset of sites. The fields include impressions, pages, countries, devices and dates. An impression tells you that a URL appeared in the feature. It does not prove a click, qualified enquiry or sale.
The same boundary applies to a citation count. Your booking, intake, CRM or order system records the business result. A timeline can connect the records, but it does not prove cause.
The AI Search Guide covers the wider source-to-action path. Measuring AI Search Honestly gives you the full logging and comparison protocol. The AI Visibility service explains the work Mindflow offers, and the technical SEO decision guide covers access and rendering problems.
If you want Mindflow to review the public path from your important buyer questions to the pages and profiles that should answer them, request the Free Visibility Check. Access, citations, rankings, recommendations and commercial outcomes remain platform and buyer decisions, not promises.
Sources used
- Google: AI features and your website
- Google: Optimizing for generative AI in Search
- Google: Generative AI performance reports
- OpenAI: Searching the web with ChatGPT
- OpenAI: ChatGPT and inaccurate citations
- OpenAI: Crawlers
- Perplexity: How Perplexity works
- Perplexity: Pro Search
- Perplexity: Crawlers
- Claude: Web search on the Anthropic API
- Microsoft: How web search works in Copilot
- Microsoft: Public-website generative answers
- TREC 2025 RAG Track overview
