Work

Developing Standards for Rapid Evaluation and Appraisal Methods (STREAM): An e‐Delphi Consensus Study

Year: 2025
Type: article
Abstract: BACKGROUND: Timeliness is key to influencing the utility of evaluation and research findings and has given rise to a range of rapid evaluation and appraisal approaches. However, issues in the design, implementation and transparency in their reporting has led to concerns around their rigour and validity. To address this, we have developed the Standards for Rapid Evaluation and Appraisal Methods (STREAM). METHODS: We followed a four-stage consensus process, starting with a (1) steering group consultation; (2) three-stage e-Delphi study; (3) stakeholder consensus workshop; and (4) piloting exercise. The stakeholders invited to participate in the consensus process had experience in conducting, being part of, or commissioning rapid evaluations or appraisals. RESULTS: Thirty-eight standards were developed with the purpose of guiding the design and implementation of rapid evaluations and appraisals and supporting the reporting of methods used. CONCLUSIONS: Rapid evaluations and appraisals can be useful in time and resource limited contexts and in the response to new or changing services, but close attention needs to be paid to their rigour and other factors that might influence the production of knowledge and validity of the findings.
Language: English
Open Access status: hybrid
Estimated APC paid: $4,430
OpenAlex ID: W4412374324
FWCI: 5.417
Cites: 27
Cited by: 3
Related to: 10