Using Text Analysis to Assess Qualitative Student Works, Deal with Inter-rater Reliability, and Simultaneously Comply with AACSB Standard 8 and Middle States Standard V
Year: 2016
Type: article
Abstract: The purpose of this research is to determine if the analytical process of text analysis or text mining can be adapted successfully as a tool to help automate assessment of student works related to ways in which they demonstrate progress in meeting institutional and accreditation standards.Student works in this case are assignments from graduate and undergraduate courses in business.An electronic library with six dictionaries was built containing Jesuit and Catholic keywords, phrases, concepts and synonyms so text analysis has the ability to identify these institutional learning goals within student work products.Conclusions from this study are that text mining can be adapted successfully as an automated solution for assessing large volumes of student works without involvement of large numbers of assessors and therefore without the problem of inter-rater reliability that comes from using multiple human assessors.
Authors: Guy Gessner, Karen Hutt-Doner
Institution: Canisius College
Language: English
Subfield: Computer Science Applications
Field: Computer Science
Domain: Physical Sciences
SDG: Quality education
Open Access status: bronze
OpenAlex ID: W2336838630