Work

The Application of Automate Scoring Program to Supply-Type Items of Basic Competency Test

Year: 2013
Type: article
Abstract: The purpose of this study is to explore possibility of automatic scoring supply type items of the Grade 3 National Diagnostic Assessment of Basic Competency (NDABC) to reduce scoring biirden, to improve scoring efficacy and scoring reliability. This study presented scoring rates, scoring errors, and Kappa(correlation) coefficients of scores between human scoring and automatic scoring in order to ensure scoring reliability. We also analyzed the sources of scoring errors, where the automatic scoring program fails. We used automatic scoring program developed by the Korea Institute for Curriculum and Evaluation (KICE). The results showed that the scoring rate was very high(91.5~100%), and that the Kappa coefficients depend on items. The numbers of scoring error were 1 〜42. The sources of scoring errors were caused by spelling errors, the non-recognition of analogous terms and symbols. This study presented two suggestions as following. First an automatic scoring program for NDABC should be supplemented to give feedback and information about wrong answer to teachers and students. Second the program should focus on providing convenient interface for teachers.
Language: English
Open Access status: diamond
OpenAlex ID: W2602120171
FWCI: 0.479
Cites: 3
Cited by: 1
Related to: 10