When the Items Fail the Test: Prevalence of Item-writing Flaws in Multiple-choice Questions used in Introductory Forensic Science Courses
Year: 2026
Type: article
Abstract: Multiple-choice questions (MCQs) are widely used in undergraduate education because they allowinstructors to efficiently assess students’ comprehension, support consistent exam structure, and identify areas that may require instructional or curricular adjustments. However, the quality of MCQs can be compromised by item writing flaws (IWFs), which reduce the reliability and validity of assessments. This study systematically examined the presence of IWFs in MCQs using the Item Writing Flaws Evaluation Instrument (IWFEI). Examples of IWFs include incomplete question stems, ambiguous wording, and inconsistent answer-choice formats. A content analysis was conducted on 337 instructor-generated MCQs and 569 publisher-generated MCQs from introductory forensic science courses. Across both sources, Criterion 7 (items lacking a complete stem) of the IWFEI emerged as the most frequently observed IWF. Overall, 47% of publisher-generated items and 68% of instructor-generated items contained at least one IWF. These findings highlight the importance of critically evaluating MCQs in undergraduate forensic science education to ensure accurate measurement of student learning. The study offers a practical framework for improving assessment design by identifying common IWFs and provides recommendations for instructors.
Institution: University of Central Florida
Language: English
Subfield: Education
Field: Social Sciences
Domain: Social Sciences
SDG: Quality education
Open Access status: diamond
OpenAlex ID: W7220518412
