UWBench: A Vendor-Neutral Protocol and Case Set for Evaluating Credit-Underwriting Agents
Year: 2026
Type: preprint
Abstract: UWBench is an open, vendor-neutral protocol, case format, trusted runner, and mostly deterministic scorecard for evaluating AI agents on commercial credit underwriting. The first public track contains ten synthetic United States commercial term-loan cases and supports raw-document, normalized-data, and reasoning-only evaluation lanes. This public-alpha resource paper describes the protocol, cases, scorecard, practice-analysis foundation, and preliminary unblinded pilot measurements. These measurements are engineering shakedowns, not certification results, a controlled model ranking, or evidence of occupational validity.
Author: Pfuetze, Tobias
Language: English
Subfield: Accounting
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W7203919382
Cites:
Cited by:
Related to:
