AI Visibility: How to Measure It Without Fooling Yourself
AI visibility is the share of relevant AI-generated answers that mention or cite your brand. It is measurable, but only statistically: the same prompt returns different answers across runs, sessions, regions, and model updates, so a single check tells you almost nothing. A defensible measurement is a fixed prompt set, run repeatedly, averaged, and tracked as a trend.
TL;DR
- Measure with a fixed 20–40 prompt set, repeated runs, monthly averages — never single samples.
- Mentions and citations move independently: brands get named, aggregators get linked — track both.
- Tool dashboards are directional; mention-share numbers without variance shown are single dice rolls.
Two metrics, not one
Separate mentions from citations. A mention is your brand named in the answer text; a citation is your URL in the sources. They move independently — Semrush's citation research observed that strong consumer brands get named without links while aggregators and publishers get cited without being named — and they reward different work: mentions follow brand presence across the web, citations follow retrievable, quotable pages.
The manual protocol (free, one afternoon a month)
Build a list of 20–40 prompts your buyers would genuinely ask — comparison prompts ("best X for Y"), problem prompts ("how do I fix Z"), and category prompts. Mine the phrasing from sales calls and competitor reviews rather than keyword tools. Each month, run every prompt three times in each engine you care about (ChatGPT, Perplexity, Gemini at minimum), in a clean session. Log four things per run: were you mentioned, were you cited, who else appeared, and which URLs the engine used. Report mention rate and citation rate per engine as monthly averages, alongside a competitor share-of-voice count. Three runs is a floor, not rigor — but it beats the single-sample screenshots most teams act on.
If you buy a tool, interrogate it
Trackers such as Profound, Semrush's AI Visibility Toolkit, and Ahrefs Brand Radar automate exactly this loop at scale, which is genuinely valuable. The caveat comes from engineers who have built these systems: front-end scraping is fragile, geography and personalization shift results, models drift with every update, and any dashboard reporting "rank 3" or a mention share to decimal precision without showing variance is dressing a dice roll as a constant. Ask vendors how many runs per prompt they average, whether they disclose variance, and which regions they query from. Directional trends from these tools are trustworthy; precise stable numbers are not.
Reading the numbers
Interpret movements, not levels. A mention rate rising from 10% to 25% over a quarter is signal; a week-to-week wobble is noise. Attribute cautiously: engines re-index on different clocks, so tie changes to work shipped at least three to six weeks prior. And keep the denominator honest — visibility on prompts nobody asks is decoration. Weight your prompt set toward queries with purchase intent, and revisit it quarterly as your market's language shifts.