Work

Computer Aided Assessment MUST be more than multiple-choice tests for it to be academically credible?

Year: 2001
Type: article
Abstract: Computer Aided Assessment (CAA) is being proposed as the means of providing\nformative testing to the ever-increasing numbers of students involved in higher\neducation. A large proportion of this testing is being based around the use of\nobjective based multiple-choice tests. These tend to make use of the process of\nselect one out of three possible answers, or to improve the reliability of the process,\none out of four! Obviously there are alternatives to the above, however, a lecturer\ninitially will use the method that is easiest for them. With the complexity, multifunctionality\nand hence steep learning curve involved in setting up these systems,\nmany lecturers are dumping them before their benefits can be achieved. Question\nbanks are available, however, these normally require an initial financial outlay. The\nquestions offered are often general, and may not directly map to the areas covered\nin a particular module. No matter what system is utilised for these objective tests, the\ncriticism offered by CAA sceptics is "we are not developing employable and\ntransferable skills". Students on leaving higher education will rarely be expected to\nproduce answers for their employers that require multiple-choice skills, but will be\nexpected to produce reports, presentations, etc. The question that springs to mind is\n... what is our job as educators, to produce clones, or to develop and nurture broader\nskills? The use of formative multiple choice tests is also causing a problem in that\nstudents are not being "prepared" to sit their final examinations. These often still take\nthe format of select three from five questions and then write essays for each of the\nselected questions in a limited time period. Having students develop essays as part\nof their formative/summative assessment throughout the course of a module, again\nbrings us back to the time consuming problem of having to mark and provide\nformative feedback. This paper introduces the audience to the Computerised Assessment and Plagiarism\nsystem (Davies 2000), that provides an on-line means of students assessing the\nessays of their peers, and providing formative feedback. This system has been\nsuccessfully used at levels one, two and three of an undergraduate programme in\nthe field of computer studies at the University of Glamorgan. It has been used for\ncontinual assessment at level one, a combination of multiple choice / peer\nassessment at level two, and for self, peer and reflective self-assessment at level\nthree. The use of this networked tool has produced major positive benefits both for\nthe students and staff. Its acceptance has not only provided an efficient method for\nformative / summative assessment, but has also aided in developing the students'\nessay writing skills. From a lecturer's point of view, those who in the past have been\nsceptical of the use of peer assessment and the more general use of objective\ntesting, have become much more receptive to the introduction of these innovative\nassessment methods making use of CAA.
Language: English
Open Access status: green
OpenAlex ID: W361052509
FWCI: 4.12
Cites: 14
Cited by: 36
Related to: 10