Quality control of epidemiological lectures online: scientific evaluation of peer review.
Year: 2007
Type: article
Abstract: AIM: To examine the feasibility of using peer review for the quality control of online materials. METHODS: We analyzed the inter-rater agreement on the quality of epidemiological lectures online, based on the Global Health Network Supercourse lecture library. We examined the agreement among reviewers by looking at kappa statistics and intraclass correlations. Seven expert reviewers examined and rated a random sample of 100 Supercourse lectures. Their reviews were compared with the reviews of the lay Supercourse reviewers. RESULTS: Both expert and non-expert reviewers rated lectures very highly, with a mean overall score of 4 out of 5. Kappa (Kappa) statistic and intraclass correlations indicated that inter-rater agreement for experts and non-experts was surprisingly low (below 0.4). CONCLUSIONS: To our knowledge, this was the first time that poor inter-rater agreement was demonstrated for the Internet lectures. Future research studies need to evaluate the alternatives to the peer review system, especially for online materials.
Source: PubMed
Authors: Faina Linkov, Mita Lovalekar, Ronald LaPorte
Institution: University of Pittsburgh
Language: English
Subfield: Education
Field: Social Sciences
Domain: Social Sciences
SDG: Quality education
Open Access status: green
Funder: National Institutes of Health
OpenAlex ID: W2133505113