Back to blog

How to set a citation baseline before a model update

A practical AEO workflow for freezing prompts, competitors, engines and citation metrics before an answer engine changes its model.

  • AEO
  • AI Search
  • Measurement
  • Citations
Frozen AI citation baseline dashboard comparing answer engine signals before a model update

A citation baseline is a fixed snapshot of how answer engines mention, cite and recommend a brand before a model update, product rollout or ranking change alters the answer set.

Without that baseline, every movement looks ambiguous. A brand may lose citations because ChatGPT changed its model, because Gemini expanded the source set, because a competitor published stronger evidence, because crawlers stopped reaching a page or because the prompt sample changed. The baseline does not explain the movement by itself. It gives you the control surface needed to investigate it honestly.

In AEO, a useful baseline freezes the prompt portfolio, competitor set, answer engines, cited URLs and scoring rules before the environment moves.

Why model updates make baselines necessary

Answer engines are not stable directories. They combine retrieval, ranking, grounding, synthesis and interface choices. A model update can change which source is trusted, how many sources are shown, whether web search is invoked, how local or fresh the answer feels and which passage is selected from the same page.

SISTRIX has documented citation drift across major AI search systems and a sharp citation-distribution shift after a ChatGPT model rollout. Google also explains that its generative Search features depend on Search systems, retrieval and AI techniques to highlight content from the index. OpenAI documents separate crawlers for search visibility and user retrieval. The practical message is simple: AI visibility is a moving measurement problem, not a one-time ranking report.

A baseline lets you separate four situations that otherwise get confused: platform movement, category movement, competitor movement and owned-site movement. The right response is different in each case.

What to freeze before the update

A baseline is only useful if it is reproducible. Do not capture a vague impression such as “we appear more often in AI answers”. Capture the measurement setup that produced the result.

  • Prompt portfolio: the exact prompts, grouped by intent, funnel stage, market and language.
  • Competitor set: the named brands, publishers, directories, review marketplaces and informational sources you will compare.
  • Engines and modes: ChatGPT, Gemini, Perplexity, Copilot, Google AI Overviews, AI Mode or any other surface, measured separately.
  • Location and language: country, interface language, account state and any personalization controls you can document.
  • Citation fields: cited domain, cited URL, cited page title, answer position, source context and whether the brand is cited, mentioned or recommended.
  • Scoring rules: how you count a citation, mention, recommendation, negative mention, incorrect summary and unsupported claim.
  • Technical state: robots.txt, sitemap health, canonical status, crawl access for AI search bots and whether important pages are indexable.
  • Evidence pages: the owned pages that should support each prompt cluster, including methodology pages, glossary entries, reports, comparisons and citable evidence pages.

The point is not to create a perfect laboratory. The point is to record enough context that a later change can be attributed with less guessing.

Use prompts as the measurement unit

AEO measurement should start from a prompt portfolio, not from a keyword list alone. Keywords still matter for classic search and for discovering demand, but answer engines respond to full tasks: comparisons, recommendations, definitions, troubleshooting, evaluation criteria and buying questions.

For a clean baseline, keep each prompt stable long enough to compare results. If you rewrite prompts during the measurement window, you will not know whether the answer changed because the engine changed or because the question changed.

  • Definition prompts: “What is AEO?” or “What is an answer engine?”.
  • Problem prompts: “Why did my ChatGPT citations change?”.
  • Comparison prompts: “AEO vs SEO for B2B software companies”.
  • Recommendation prompts: “Which agencies help with AI search visibility?”.
  • Implementation prompts: “How do I prepare content for AI Overviews?”.
  • Risk prompts: “Should I block AI crawlers or allow search bots?”

Measure these groups separately. A brand can be visible in definition prompts but absent from recommendations. It can be cited as evidence but not recommended as a solution. Treat those as different outcomes.

Capture more than citations

Citation rate is important, but it is not the whole story. Many answer experiences mention brands without clickable citations, cite sources that do not get the recommendation, or summarize a source incorrectly. A baseline should record the whole answer context.

  • Citation: the answer links to or names a source as support.
  • Mention: the brand, method, product or publication appears in the answer.
  • Recommendation: the answer presents the brand as a suitable choice, not only as a source.
  • Source influence: the answer appears to use a page's facts or framing even when the page is not visible as a link.
  • Accuracy: the answer describes the entity, scope, pricing, geography, method or evidence correctly.
  • Sentiment and fit: the answer explains when the brand is appropriate, risky, limited or not the best match.

This distinction matters commercially. A page can be cited while a competitor wins the recommendation. A brand can be mentioned while the answer uses outdated positioning. A baseline should show whether visibility is helping the decision, not only whether the domain appeared.

Measure per engine, not as one blended score

A single AI visibility score is useful for reporting, but it can hide the real signal during a model update. ChatGPT, Gemini, Perplexity, Copilot and Google AI surfaces do not share the same retrieval layer, citation display, source preferences or freshness behavior.

Keep the first baseline engine by engine. If ChatGPT moves while Perplexity and Gemini stay stable, you are probably seeing a ChatGPT-specific event. If every engine changes around the same prompt cluster, the category or source environment may have moved. If only your domain drops while competitors stay visible, investigate owned-site access, content quality, entity consistency and evidence freshness.

Add a technical access checkpoint

A citation baseline should include the technical state of the pages that you expect answer engines to retrieve. This does not mean allowing every AI crawler. It means documenting access decisions so they do not get mistaken for content performance.

  • Check that important pages are indexable, canonical and present in the sitemap.
  • Confirm that robots.txt does not accidentally block search-oriented bots that you want to allow.
  • Separate training crawlers from search and user-fetch crawlers in the audit notes.
  • Review server logs or CDN logs for major AI search bots when available.
  • Record whether key pages recently changed title, URL, canonical, redirects, schema, noindex, rendering or internal links.

This checkpoint prevents false diagnosis. If a page disappeared from citations after a robots.txt edit or canonical mistake, calling it a model update is a distraction.

The baseline template

Use a simple table or spreadsheet. The baseline does not need to be complicated; it needs to be consistent.

  • Prompt ID and exact prompt.
  • Intent bucket and funnel stage.
  • Engine, mode, country and language.
  • Brand mentioned: yes, no or incorrect.
  • Brand cited: yes or no, with cited URL.
  • Brand recommended: yes, no, conditional or negative.
  • Competitors mentioned, cited and recommended.
  • Cited third-party sources, including directories, review sites, publishers, forums and official documentation.
  • Answer summary and any factual errors.
  • Owned page that should support the answer.
  • Action tag: content gap, evidence gap, entity gap, technical gap, PR gap or no action.

Store the raw answer as well as the score. Screenshots are useful for auditability, but plain text export is easier to search and compare. Keep the scoring sheet and raw captures together.

How to read the after-update movement

After an update, rerun the same portfolio before changing the site. Do not rewrite content, change schema or edit robots.txt between baseline and follow-up unless there is a critical technical issue. Otherwise you will contaminate the comparison.

  • Platform shift: many unrelated categories move in the same engine. Watch, document and avoid panic edits.
  • Category shift: your prompt cluster changes across several competitors. Recheck source preferences, freshness and third-party evidence.
  • Competitor shift: one rival gains citations or recommendations. Compare its cited pages, evidence, entities and external mentions.
  • Owned-site shift: your pages lose visibility while the category stays stable. Audit crawling, page changes, evidence quality and entity consistency.
  • Display shift: citations are shown differently but the underlying answer is similar. Separate interface changes from source-selection changes.

The best response is usually staged: diagnose first, then strengthen evidence pages, internal links, entity consistency, structured data and third-party source coverage where the baseline points to a real gap.

Common mistakes

  • Changing the prompt set after the baseline and still calling the report a trend.
  • Blending engines into one score before checking which engine actually moved.
  • Counting every brand mention as a recommendation.
  • Ignoring third-party sources that the answer uses to justify the recommendation.
  • Comparing localized answers without documenting country and language.
  • Treating a one-day swing as proof of success or failure.
  • Editing pages during the measurement window and losing attribution.

FAQ

How many prompts do I need for a baseline?

Enough to cover the decisions you care about. For a small B2B site, a focused baseline can start with twenty to forty prompts across definitions, comparisons, recommendations, implementation and risk. Larger sites should sample by product line, market, language and funnel stage.

Should I rerun prompts multiple times?

Yes when the engine is highly variable or the prompt is commercially important. Multiple runs help distinguish normal answer variance from a real movement. Keep the same settings and record each run separately before averaging or summarizing.

Is a citation baseline the same as rank tracking?

No. Rank tracking follows positions in search results. A citation baseline tracks how answer engines synthesize sources, mentions and recommendations for natural-language tasks. Organic rankings can support AI visibility, but they do not fully explain it.

Can a baseline prove that a model update caused the change?

It can support a stronger diagnosis, but it rarely proves causality on its own. The baseline helps you compare timing, engine-specific movement, competitor movement and owned-site changes. That makes the explanation more defensible.

Conclusion

A model update turns weak AI visibility reporting into guesswork. A citation baseline gives teams a disciplined before-and-after record: same prompts, same engines, same competitors, same scoring rules and documented technical state.

That discipline is the difference between reacting to noise and improving the source graph that answer engines actually use. Before the next update changes the answers, freeze the measurement.

Sources and related resources