Dimensionality issues related to item format in large scale achievement tests
Year: 2014
Type: conference-paper
Study design: Observational Study
Abstract: Students faced problem in developing algebraic understanding and solving algebraic problem (Mary & Heather, 2006; Warren, 2003; Hall, 2002; Vlassis, 2002; Radford, 2000).In contrast to standard-based summative assessments which are used to monitor educational systems by providing coarsely grained information about global proficiencies, cognitive diagnostic assessments (CDAs) seek to provide more fine-grained interpretations to support instruction and learning (Rupp et al., 2010).The fine-grained diagnostic feedback makes it possible for the stakeholders to identify the deficiencies in abilities that are revealed by the content standards and for the teachers to implement interventions to remedy those skills that have not been mastered yet.CDA has been applied to various subdomains of mathematical learning such as mixed-number subtraction (Mislevy, 1996; Tatsuoka, 1990), proportional reasoning (Beland & Mislevy, 1996), multiplication and division with exponents (Birenbaum & Tatsuoka, 1993) and, addition and subtraction of fractions (Klein et al, 1981).This study investigate the cognitive attribute proficiencies of a pre-algebra test.The knoweldge and skills that should be assessed were identified from the school curriculum specification.The final Q-matrice devloped has eight attributes for pre-algebra and used to write appropriate items for the mathematics test.Altogether, the test consists of 28 open-ended items, with at least three items to elicit the knowledge or skill for each attribute profile.The test was administered to 2500 grade-8 students from two northern states in Malaysia.The Fusion Model was used to estimate examinees profiles on each algebraic subskills underlying the test to make inference about students' mastery status for the knowledge and skills in the learning of algebraic expression.Examinee profiles were produced as the result of the cognitive diagnostic analysis.Performing computation involving combined operations seemed to be the most difficult skill for the grade 8 students.
Language: English
Field: Decision Sciences
Domain: Social Sciences
SDG: Quality education
Open Access status: green
OpenAlex ID: W2737877100
