A comparison of an innovative web-based assessment tool utilizing confidence measurement to the traditional multiple choice, short answer and problem solving questions
Year: 2006
Type: conference-paper
Abstract: Computerized assessment is playing a major role in IT education, with\nextensive utilization of the multiple choice question (MCQ) format. This is\nmainly due to the ease of adaptation of MCQs into the internet environment,\noffering extensive advantages to both the student and the instructors. This\nstudy analyzes the results of students’ grades using an alternative web-based\nassessment tool and the more traditional modes of assessment, being\nMultiple Choice Questions, Short answers and Problem Solving (Scenario)\nquestions. The Multiple Choice Questions with Confidence Measurement\n(MCQCM) is a web based assessment tool that permits the student to register\ntheir level of confidence in their answer, and was included as a revision tool\nfor the duration of the semester and as a component of the final exam.\nAdditionally the exam also contained questions using more traditional\nmethods for assessment. A total 43 students sat the final exam producing\nsome interesting results. The statistical analysis indicated that the correlation\nbetween the MCQCM and the other alternatives ranges from strong to\nmedium. In addition it appears that the MCQCM demonstrated equal to\nslightly stronger convergence of validity compared to the traditional MCQ\nmethod and the other alternative assessment methods.
Author: Graham N. Farrell
Institution: Swinburne University of Technology
Language: English
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
SDG: Quality education
Open Access status: green
OpenAlex ID: W1549361069
