Work

A benchmark for elevator fault diagnosis: Multi-level tasks from perception to diagnostic reasoning

Year: 2026
Type: article
Abstract: Elevator fault diagnosis is a safety-critical problem that requires capabilities beyond isolated fault classification, including knowledge grounding and structured reasoning for maintenance support. In this work, we present a benchmark for elevator fault diagnosis and organize evaluation into three complementary task groups: (A) sensor-based fault detection and classification, (B) taxonomy-grounded fault classification and cause identification, and (C) reasoning with incomplete or constrained information. To enable reproducible comparison across heterogeneous model families, we standardize task definitions, input/output formats, and scoring protocols and report component-level predictive metrics. Experiments across representative language models show task-dependent performance: higher performance on one task does not necessarily transfer to another. The benchmark is a reproducible testbed for studying diagnostic-assistance methods, not a validation of safe operational deployment.
Source: PLoS ONE
Language: English
Open Access status: gold
Estimated APC paid: $2,382
OpenAlex ID: W7236397809
FWCI:
Cites: 19
Cited by:
Related to: 10
Parts: 10