Work

DocVLM-Fingerprint: Document VLM Faithfulness Under Visual Perturbations

Year: 2026
Type: preprint
Abstract: DocVLM-Fingerprint studies a narrow failure mode in document visual question answering (VQA): a vision-language model (VLM) can return a plausible short answer while its accompanying claim is unsupported by the annotated evidence. This work implements a reproducible evaluation pipeline for generated chart, optical character recognition (OCR) document, and scientific figure tasks. The pipeline includes four visual perturbations, open VLM clients, answer scoring, claim-support labels, plots, and failure records. The main run covers 120 generated examples, 480 perturbed variants, and three open models. Small clean subsets of ChartQA and DocumentVQA, together with a Qwen-only CharXiv perturbation supplement using real charts, provide external checks. The evidence supports a controlled diagnostic study of failure patterns, not a general ranking of VLMs.
Language: English
Open Access status: green
OpenAlex ID: W7234473378
Cites: 8
Cited by:
Related to: 10