Research framework

AI Citation Benchmarks: ChatGPT vs Perplexity

A transparent framework for testing sources, structure, freshness, and page quality. Verified results will be added after collection.

Review the methodology Explore AEO research

Benchmark report and transparent methodology

AI citation benchmarks at a glance

AI citation benchmarks are repeatable, dated tests that measure which sources appear in AI-generated answers and which content characteristics are associated with those citations. A credible benchmark records its prompts, platforms, model or mode, collection dates, sample size, classification rules, measured results, repeat runs, and limitations so others can interpret or reproduce it.

Answer first: No verified benchmark run data was supplied for this page. This edition therefore does not report citation rates, source counts, platform winners, or claims about the content most likely to be cited. The fields below remain explicit rather than being filled with estimates.

  • Strongest observed patterns: None can be reported until a dated sample has been collected and checked.
  • Exceptions: Query-level exceptions should be preserved alongside aggregate findings rather than removed as noise.
  • Practical next step: Fix the query set, document both platform settings, collect within a closely matched period, and publish raw counts before percentages.

What does an AI citation benchmark measure?

A useful benchmark separates citations from mentions and records results at the query, answer, URL, and domain levels. Combining these signals would make the comparison difficult to interpret.

  • Citation: A source link or explicit attribution in an answer that can be resolved to a page or domain.
  • Source link: A clickable URL exposed inline or in a visible source list. Its location should be recorded because interfaces differ.
  • Brand mention: A brand, publication, or domain named without a resolvable citation.
  • Source inclusion: A page or domain displayed in a source panel even when it is not directly referenced in the answer text.

For every eligible answer, the dataset should record whether an answer was produced, whether any citation appeared, the number of cited pages, the number of unique domains, any unlinked brand mention, and any source included outside the answer text.

Four variable groups should then be evaluated:

  • Content structure: Direct answers, answer placement, descriptive headings, definitions, lists, tables, summaries, references, and supporting context.
  • Source pattern: Source category, first-party or third-party ownership, topical relevance, domain concentration, source diversity, and cross-platform overlap.
  • Update practice: Publication date, visible modified date, revision note, content age at collection, and evidence of substantive change.
  • Page quality: Authorship, ownership, source attribution, accessible primary content, evidence for claims, original data, methods, limitations, and alignment with the query.

These fields identify associations inside the measured sample. They do not establish that one page characteristic caused a citation.

How are ChatGPT and Perplexity citations tested?

The fairest comparison uses the same documented query set, closely matched collection dates, explicit platform settings, and consistent classification rules.

  • Define the research question and hypotheses. State which structures, source patterns, freshness signals, or page qualities will be examined. Write hypotheses before reviewing results.
  • Select the query set. Document categories, question wording, inclusion rules, exclusions, and the reason each query type is represented. Preserve the exact prompts used.
  • Record collection conditions. Capture platform, model or mode, search or browsing state, account state, observable geography, conversation state, date, time, and any platform-specific instructions.
  • Save the raw answers. Preserve the answer text, visible source list, citation position, destination URL, domain, unlinked mentions, and collection timestamp.
  • Classify consistently. Apply a written codebook for citation type, source category, query type, content structure, update practice, and page-quality fields.
  • Deduplicate carefully. Keep query-level citation events while also reporting unique canonical pages and unique domains. Explain URL normalization and duplicate handling.
  • Check quality and repeatability. Use a second review or documented spot check for classifications. Repeat a stated subset under matched conditions and retain variation between runs.
  • Report for reproduction. Publish raw counts, denominators, percentages, query-level exceptions, methodology changes, and uncertainty. If a genuine dataset is released, document its variables, measurement technique, temporal coverage, and license.

Core calculations

  • Citation rate: Eligible answers containing at least one citation divided by all eligible answers.
  • Source frequency: Citation events attributed to a page or domain divided by all extracted citation events.
  • Source diversity: Unique cited pages and domains, reported separately from total citation events.
  • Domain overlap: Unique domains cited by both platforms divided by the union of unique domains cited by either platform.
  • Repeat consistency: Repeated eligible queries returning the same cited page or domain divided by all repeated eligible queries.

Every percentage should be shown with its raw numerator and denominator. Failed answers, unavailable modes, and extraction errors should be reported separately rather than silently removed.

Which content structures are evaluated?

The benchmark should test whether specific structures co-occur with citations. Until results are collected, these are measurement fields and practical hypotheses, not proven ranking factors.

Results should be separated by platform and query type. A structure associated with citations for comparison questions may not show the same pattern for definitions, local questions, or rapidly changing topics.

What source patterns are compared?

Source analysis should report counts rather than rely on a few memorable examples. Each cited page can be classified as first-party, official, editorial, academic, reference, community, or commercial, with priority rules for sources that fit more than one category.

The report should compare:

  • The citation frequency of each source category.
  • Unique pages and domains, not only total source links.
  • The share of citations held by the most represented domains.
  • Page-level and domain-level overlap between ChatGPT and Perplexity.
  • Sources unique to one platform within the measured sample.
  • Differences by query type and repeated run.
  • Notable exceptions that challenge the aggregate pattern.

Authority should not be inferred from a domain name alone. Observable signals such as ownership, topical alignment, bylines, references, methods, and original evidence can be recorded, but any scoring rubric and weighting should be public.

Does freshness improve citation likelihood?

An updated date alone does not establish a citation advantage. The benchmark should distinguish substantive revisions from timestamp changes and test whether either is associated with citations in the collected sample.

Record the original publication date, visible modified date, revision note, content age on the test date, and evidence that facts, examples, data, or explanations changed. Define substantive updates before analysis, set age bands before reviewing results, and retain an unknown value when a date cannot be verified.

Freshness results should be reported by platform and query type. A recency association for news or product queries may not apply to stable definitions. Even a strong association would not guarantee a future citation.

Which page qualities are assessed?

The page-quality review should use observable fields rather than an undisclosed overall impression:

  • Clear authorship, publisher ownership, and source attribution.
  • Accessible, indexable primary content with meaningful headings.
  • Specific claims supported by verifiable evidence.
  • Original data accompanied by methods and limitations.
  • A clear answer to the question that brought the reader to the page.
  • Useful context without burying the answer in unrelated material.
  • Visible update information that describes what changed.

Unknown and absent should be recorded separately. If a composite score is used, publish every field, weight, and scoring rule so readers can inspect the result.

How do ChatGPT and Perplexity compare?

No measured platform comparison is available in this draft. The first verified edition should complete the table with raw counts and rates from matched collection conditions.

Differences in model, mode, account, interface, or collection date must appear beside the results. A platform should not be labeled better solely because it exposes more links.

What can a small team do now?

Answer engine optimization, or AEO, helps content become easier for answer engines to find, understand, evaluate, and cite. It can improve clarity and evidence, but it cannot guarantee a citation.

  • Prioritize existing question-led pages. Start with pages that already answer a specific audience question and have a realistic reason to be referenced.
  • Lead with the answer. Add a short, plain-language response near the top, then support it with descriptive headings, definitions, lists, or compact tables.
  • Strengthen verifiable evidence. Attribute claims, link to primary sources, explain original data, and state limitations. Structured data should match visible content and should not be presented as a citation guarantee.
  • Make substantive updates. Correct facts, improve explanations, replace stale evidence, and add a revision note describing the change. Avoid changing only the timestamp.
  • Measure and retest. Track mentions and citations separately across a fixed query set. Record the query, platform, model or mode, date, mention, citation, destination URL, source position, and notes for each run.

A small spreadsheet is enough to begin. Review query-level results before expanding the work, and prioritize improvements that help readers even when no AI citation follows.

How will benchmark history be maintained?

Each benchmark edition should preserve its collection date, query set, platform settings, raw counts, calculated rates, methodology version, quality checks, and limitations. Prior editions should remain visible so readers can distinguish long-term patterns from short-term variation.

If the query set, model, mode, extraction rule, or classification codebook changes, show the change beside the new edition. Do not combine incompatible samples into a single trend line. Compare like with like, or label the comparison as directional.

Next planned retest: No date was supplied for this draft. Add a date only after the first collection is scheduled, then retest on a stated recurring cadence and after meaningful platform or methodology changes.

Corrections should include the correction date, affected result, reason, and recalculated value. Methodological changes should be versioned rather than silently applied to prior results.

What are the limitations and disclosures?

Every edition should address the following limits:

  • The query set may not represent every industry, language, audience, or information need.
  • Account state, personalization, geography, model, mode, and interface can affect outputs.
  • Citation behavior can change between repeated runs and platform updates.
  • Platform-specific citation interfaces may require different extraction rules.
  • URL normalization and source categorization involve judgment.
  • Associations inside one sample do not prove causation or universal ranking factors.
  • Commercial relationships, sponsorships, or tool affiliations, if relevant, must be disclosed beside the edition and methodology.

Publication checklist for the first verified run

  • [ ] Collection date and exact platform settings are visible.
  • [ ] Query count, answer count, page sample, and domain sample are reported.
  • [ ] Citations, source links, source inclusion, and mentions are classified separately.
  • [ ] Raw counts appear beside every percentage.
  • [ ] Query-level exceptions and repeated-run variation are preserved.
  • [ ] Methodology, codebook, deduplication rules, and quality checks are accessible.
  • [ ] Limitations, corrections, changes, and relevant commercial ties are disclosed.
  • [ ] The next retest date is stated only after it is scheduled.

Frequently asked questions

Direct answers about benchmark methods, platform comparisons, freshness, limitations, and practical use.

Benchmark basics

What are AI citation benchmarks?

What should an AI citation benchmark measure?

Platform comparison

How should ChatGPT and Perplexity citations be compared?

Do ChatGPT and Perplexity cite the same sources?

Freshness and outcomes

Does updating content make it more likely to be cited?

Can AEO guarantee a citation from ChatGPT or Perplexity?

Applying and updating research

How can a small team use AI citation benchmark findings?

How often should AI citation benchmarks be updated?

Continue

Turn the framework into a workflow

Use these resources to design the test, improve answer clarity, and track mentions and citations without treating visibility as guaranteed.

AEO Surge: independent guidance for AI-search visibility.

Evidence-backed guides, transparent tool comparisons, practical templates, and repeatable experiments for small teams navigating answer engine optimization.