Work

UWBench: A Vendor-Neutral Protocol and Case Set for Evaluating Credit-Underwriting Agents

Year: 2026
Type: preprint
Abstract: UWBench is an open, vendor-neutral protocol, case format, trusted runner, and mostly deterministic scorecard for evaluating AI agents on commercial credit underwriting. The first public track contains ten synthetic United States commercial term-loan cases and supports raw-document, normalized-data, and reasoning-only evaluation lanes. This public-alpha resource paper describes the protocol, cases, scorecard, practice-analysis foundation, and preliminary unblinded pilot measurements. These measurements are engineering shakedowns, not certification results, a controlled model ranking, or evidence of occupational validity.
Language: English
Subfield: Accounting
Open Access status: green
OpenAlex ID: W7203919382
Cites:
Cited by:
Related to: