Statistical evidence pertaining to the claim of grading severity in GCSE French, German and Spanish and theimpact of statistical alignment of standards on outcomes
Year: 2019
Type: other
Abstract: Executive summaryThis report forms part of the research undertaken by Ofqual to investigate the claim that GCSE French, German and Spanish are severely graded in comparison with other GCSE subjects.The report focuses on evidence generated from statistical analyses.Evidence from existing research as well as results from new analyses are included in the report.The report also highlights important issues with making simple inferences from this type of work.Results from statistical analyses using a range of methods suggest that GCSE French, German and Spanish are generally "statistically more difficult" than many of the other GCSE subjects at both individual grade level and the overall subject level over the past 15 years or so.Such evidence has been frequently interpreted as an indication of grading severity in these subjects.The report discusses the major issues with the statistical methods used for comparing standards between subjects, including the strong assumptions made about the data being analysed (for example, the unidimensionality assumption that a single underlying latent trait used to define subject difficulty is assessed by examinations in different subjects) which are seldom met by real data.Many of the factors that can potentially influence examination performance are also discussed, including motivation of students, subject demand, and efficiency and effectiveness of teaching and learning.These factors can vary substantially between subjects and most statistical methods fail to take them into account.It is suggested that, although statistical analysis can provide useful information about the relationship in performance between different subjects, caution must be exercised when interpreting subject difficulty measures derived and linking difficulty measures directly to the grading standards of examinations which are generally subject specific.The report also demonstrates that aligning standards statistically between subjects could potentially impact performance standards.Depending on the particular point of statistical alignment chosen, this would have a lesser or greater impact on the quality of performance expected of students for some grades in GCSE French, German and Spanish.-8.00 -6.00 -4.00 -2.00 0.00 2.
Authors: Qingping He, Beth Black
Language: English
Subfield: Education
Field: Social Sciences
Domain: Social Sciences
SDG: Quality education
Open Access status: green
OpenAlex ID: W2990230232
