Work

Judged by Design, Not by Degree: Validating Natural Resource Evidence Collected by Non-Specialist Field Observers in Africa

Year: 2026
Type: article
Abstract: Much of the evidence on Africa's natural resources is collected by people who are not trained scientists: traders, students, young people and community members. A common objection holds that such data cannot be trusted. This paper answers the objection with a published, testable protocol rather than with assertion. It shows first that the most quoted continental natural resource figures, including the Democratic Republic of the Congo's share of world cobalt and Africa's food import bill, are themselves built from reports and forms completed at source by company staff, officials, clerks and interviewers rather than by research scientists, and earn trust through method and checking. It then reviews peer-reviewed evidence that trained non-specialist observers match professional accuracy when projects use standard instruments, repeat measurement and expert validation. It sets out the UNU-INRA field protocol: one question, three counts, one fixed day and site, weighed or paid quantities only, and explicit coding of zeros and non-reports. It describes four validation layers (recorder, office, peer review, government) and five checks (second-observer replication, check measurement, an independent second source, record reconciliation and paired official figures), the agreement statistics used to measure error, and a published validation state for every figure. It reports how the protocol has already refused and flagged weak evidence at its places of first use. The claim is bounded: evidence should be judged by its design, and this design is published so that anyone can test it.
Language: English
Open Access status: green
OpenAlex ID: W7233595103
FWCI:
Cites:
Cited by:
Related to: