Evaluation of the methodological quality of studies of the performance of diagnostic tests for bovine tuberculosis using QUADAS
Year: 2017
Type: article
Study design: Systematic Review
Abstract: There has been little assessment of the methodological quality of studies measuring the performance (sensitivity and/or specificity) of diagnostic tests for animal diseases. In a systematic review, 190 studies of tests for bovine tuberculosis (bTB) in cattle (published 1934-2009) were assessed by at least one of 18 reviewers using the QUADAS (Quality Assessment of Diagnostic Accuracy Studies) checklist adapted for animal disease tests. VETQUADAS (VQ) included items measuring clarity in reporting (n = 3), internal validity (n = 9) and external validity (n = 2). A similar pattern for compliance was observed in studies of different diagnostic test types. Compliance significantly improved with year of publication for all items measuring clarity in reporting and external validity but only improved in four of the nine items measuring internal validity (p < 0.05). 107 references, of which 83 had performance data eligible for inclusion in a meta-analysis were reviewed by two reviewers. In these references, agreement between reviewers' responses was 71% for compliance, 32% for unsure and 29% for non-compliance. Mean compliance with reporting items was 2, 5.2 for internal validity and 1.5 for external validity. The index test result was described in sufficient detail in 80.1% of studies and was interpreted without knowledge of the reference standard test result in only 33.1%. Loss to follow-up was adequately explained in only 31.1% of studies. The prevalence of deficiencies observed may be due to inadequate reporting but may also reflect lack of attention to methodological issues that could bias the results of diagnostic test performance estimates. QUADAS was a useful tool for assessing and comparing the quality of studies measuring the performance of diagnostic tests but might be improved further by including explicit assessment of population sampling strategy.
Source: Preventive Veterinary Medicine
Authors: Sara H. Downs, Simon J. More, Anthony V. Goodchild, Adam O. Whelan, Darrell A. Abernethy, Jennifer M. Broughan, Angus Cameron, Alasdair J. Cook, R. Ricardo de la Rua-Domenech, Matthias Greiner, Jane Gunn, Javier Nuñez-Garcia, Shelley Rhodes, Simon Rolfe, Michael Sharp, Paul Upton, Eamon Watson, Michael Welsh, John A. Woolliams, Richard S. Clifton-Hadley, Jessica E. Parry
Institutions: Animal and Plant Health Agency, University College Dublin, UCD Centre for Veterinary Epidemiology and Risk Analysis, Defence Science and Technology Laboratory, Department of Agriculture and Rural Development, University of Pretoria, Ausvet (Australia), University of Surrey, Department for Environment Food and Rural Affairs, University of Veterinary Medicine Hannover, Foundation, German Federal Institute for Risk Assessment (BfR), Welsh Government, Catalyst, Agri Food and Biosciences Institute, Roslin Institute
Language: English
Subfield: Statistics, Probability and Uncertainty
Field: Decision Sciences
Domain: Social Sciences
Open Access status: hybrid
Estimated APC paid: $3,280
OpenAlex ID: W2604089474