Work

A 50-prompt audit of six AI answer engines: citation volume, source mix and run-to-run instability

Year: 2026
Type: preprint
Abstract: Generative answer engines do not rank pages, they select a handful to cite. We report a first-party citation log: one fixed set of fifty prompts, asked to six engines in English and Chinese, with every source the answer itself displayed recorded. Three findings: engines differ more from each other than languages do (independent sites take 80% of Doubao's citations and 6% of 360 AI's); citation volume spans more than threefold (16.4 per answer for Perplexity, 4.7 for Bing Copilot); and two runs of the same prompt share only part of their sources (Jaccard 0.48 for Doubao, 0.41 for Metaso, while Perplexity is sticky within a session at 0.66 but changes almost entirely across sessions at 0.16). ChatGPT is covered through third-party measurements rather than our own, and the engines we could not complete are reported instead of estimated.
Author: Don, Jask
Language: English
Open Access status: green
OpenAlex ID: W7236717868
Cites:
Cited by:
Related to: 10