Work

Promises, problems and pitfalls of peer review: the use of peer review in external quality assessment in higher education

Year: 1991
Type: conference-paper
Abstract: In the discussions that raged since about 1981 on how to assess the quality of research and/or teaching in higher education, two broad strands of methods have been advocated: performance indicators and peer review.After thorough discussions of the merits of performance indicators, and after some years of experience with quality assessment procedures in several European countries, a consensus now seems to be growing that performance indicators should be the ?objective base? for assessment procedures, but that they should be used ?intelligently? in processes of assessment by human, knowledgeable individuals, for short: peer review.The merits of peer review have not received that much attention in the public discussions on quality assessment methods, even though a not insignificant body of research has been built up in the discipline of sociology of science.The aim of this paper is to review some of the research into the actual operation of peer review, and to try and apply the research results to the ?new?, external quality assessment procedures, where peers are in a quite different position from journal referees and the like, and where they face a different task.§ | INTRODUCTION: PROMISES British higher education first came into contact with external quality assessment procedures in a more dramatic way than anything experienced by other?countries.Almost overnight, the University Grants Committee (UGC) in 1981 introduced substantial budget reductions to the universities by way of a ?highly selective approach?, presumably based on teaching quality of the institutions (Sizer 1990: 156).Indeed ?presumably?, for the criteria used remained unknown.This brought to the fore ?as one of its more innocent consequences?the discussion on the question of how quality of higher education should be assessed: objectively or subjectively?By way of performance indicators or by way ofpeer review?In reaction to the apparentlysubjective approach used by the UGC, support grew for objective performance indicators.*Long lists of possible or recommended performance indicators have been published (see for an overview, e.g., Cave, Hanney, Kogan & Trevett 1988).In contrast to this development, the external quality assessment procedures initiated in the 1980s in the higher education system of the Netherlands relied to a large extent on subjective human judgement.The discussion in the Netherlands about performance indicators did lead to research (Segers, Dochy & Wijnen 1989, see also Dochy, Segers & Wijnen 1990), but not to policy changes.The contrast between the Britishand Dutch approaches to quality assessment in higher education should not beexaggerated, it is more a question of emphasis; the British do not rely solely on performance indicators, nor do the Dutch use peer review exclusively.In both countries quality assessment consists of human judgement based on ?but more than a simple combination of?objective data.The performance indicator side of this hasbeenrather extensivelydiscussed in the years since 1981.Peer review as a method is not often discussed; usually, itis taken for granted.For example, Banta & Fisher (1989: 6) call it ?. . .a time-honored evaluative process that is almost * Mixed up with this was the question on public, published versus ?secret?, unpublished assessments.In the publicity of statements is not related to the method of reaching these statements.Therefore, Principles Il not be addressed systematically in this paper.this question wi p.
Language: English
Subfield: Education
Open Access status: green
OpenAlex ID: W2892292536
FWCI:
Cites: 12
Cited by: 8
Related to: 9