Skip to main content

What You'll Measure

Give the client a shared vocabulary for four measurement pillars before touching a single report — strategy without a baseline is guesswork.

Each pillar answers a different question, uses a different report, and — this is the part worth emphasizing — none of them substitute for each other. A brand can score well on one and poorly on another, and the gap between them is often the most useful finding of the whole engagement. Each pillar below is marked with which delivery track it's available in.

Pillar 1: External AI Citations — Citation Monitor​

Available on: Prospect and Existing Customer tracks

Question it answers: When a prospect asks ChatGPT, Claude, or Gemini directly, does the client get recommended — or does a competitor?

Citation Monitor runs tracked queries through five signals — ChatGPT and Claude (closed-book training data), Google Gemini and ChatGPT Web Search (web-grounded), and optional Google organic rank — then scores a Citation Health Score, a verdict tier, and a diagnostic quadrant per query.

What to show the client: the Competitor Share of Voice table and the Google vs. Bing Citation Gap breakdown. Both make an abstract "we're not visible" complaint into something specific and actionable.

Real example to reference: a real run scored 32/100 ("Emerging"), with the brand cited only on its own branded query while a competitor (Ada) held 19% share of voice and won all three uncited category queries outright. The report's own diagnostic didn't stop at "you're not cited" — it named the exact competitor beating them and the exact pages to build in response.

Pillar 2: Real Customer Questions — Q&A Analysis​

Available on: Existing Customer track only — requires real chatbot conversation history

Question it answers: What are people actually asking the client's chatbot, and how well is it answering?

Q&A Analysis clusters real chatbot conversations into up to 50 themes, computes an IDK (unanswered question) rate, and scores answer quality per theme. It's the only pillar built from a brand's own real conversation data rather than a simulated audit.

What to show the client: the Query Frequency Histogram and Citation Phrase Suggestions panel — the mechanism that turns "what your customers actually type" directly into a Citation Monitor tracked-query list with one click. Between full runs, Q&A Insights shows the same signal live, per conversation.

Real example to reference: a Q&A Analysis run that found 30 out of 42 total consolidated action items traced back to Q&A Analysis findings alone — including five separate FAQ answers ranked High-impact/Low-effort because they were high-volume, unanswered, or answered inconsistently.

Pillar 3: Keyword Answer Quality — Keyword Visibility​

Available on: Existing Customer track, or Prospect track with a trial bot stood up specifically for the engagement

Question it answers: When someone asks a short, direct question vs. a longer conversational one, does the client's answer quality hold up either way?

Keyword Visibility expands seed keywords into natural-language questions across buyer-intent stages, scores every answer against the client's live chatbot, and computes a Format Delta between short-form and conversational query performance.

Don't treat this as a one-time score either — it's the tool for proving a CMS content edit actually helped: re-run the same Keyword List after the client updates a page, and compare. Source the seed keywords from something real when possible — Google Search Console/Analytics query data, the client's old on-site search logs, or Q&A Analysis's Citation Phrase Suggestions — rather than guessing at terms.

What to show the client: a real Format Delta example is the single best "aha" moment in this pillar — most clients assume short, direct questions perform best, and the data frequently says the opposite.

Real example to reference: a real audit scored a short-form average of 82 against a conversational average of 89 — a +7.0 delta, meaning longer, context-rich questions actually scored higher, because the bot could synthesize multiple facets into one coherent narrative instead of hedging on a single direct yes/no.

Pillar 4: AI Referral Traffic — AI Referral Analytics​

Available on: Existing Customer track only — requires real AI-referred traffic to attribute

Question it answers: Is any of this actually driving real visits — and once someone arrives, what do they do?

AI Referral Analytics is the one pillar that isn't a generated report — it's a live dashboard tracking sessions by engine, landing page, and engagement, with a drill-down into the actual chatbot conversation that followed. This is also where Perplexity shows up — it isn't one of Citation Monitor's five direct signals, but it's fully tracked here as a referral source.

What to show the client: the Sessions by Answer Engine donut and the Latest AI Referral Events feed — the fastest way to make "AI referral traffic" feel like a real, countable thing rather than a marketing phrase.

Real example to reference: a real dashboard view showed 7,842 AI referral sessions (up 28.6% period over period), with ChatGPT alone responsible for 43.5% of them — a single, concrete number that reframes "should we care about GEO" as "look how much of our traffic already comes from it."

The Pattern to Name Explicitly​

Once relevant pillars are on the table, say this out loud: these pillars measure different failure modes, and a brand can fail at one while succeeding at another. A brand can have excellent on-site answers (strong Q&A Analysis or Keyword Visibility scores) while scoring "Emerging" on Citation Monitor — meaning the content is good, but nobody outside the website has found it yet. That specific pattern — strong on-site answers, weak external citation — is one of the most common findings this engagement surfaces, and it points squarely at content amplification and technical discoverability work, not a content-quality problem at all.

Last updated on