Automating data narratives in Learning Analytics Dashboards using GenAI
Year: 2024
Type: conference-paper
Abstract: This paper presents an innovative approach leveraging Generative Artificial Intelligence to automate data narratives within Learning Analytics Dashboards for collaborative learning scenarios. Focusing on the analysis of class meeting transcripts, the study delves into specific collaboration skill metrics, transforming raw data into a cohesive narrative. Validation through inter-rater reliability, utilizing Cohen’s Kappa coefficient, establishes the reliability of both human and AI assessments. The integration of Large Language Models, such as ChatGPT3.5, is explored, shedding light on their potential in educational narrative assessment. The proposed methodology not only enhances understanding of class dynamics but also contributes a practical tool for educators, seamlessly translating raw data into visually compelling narratives. The paper concludes with insights from a pilot test, revealing student perceptions and addressing concerns around AI impact on dashboard utility and fairness. This research advances the intersection of data storytelling and Learning Analytics Dashboards, offering valuable insights into collaborative learning dynamics.
Authors: Pinargote, Adriano, Calderón, Eddy, Cevallos, Kevin, Carrillo, Gladys, Chiluiza, Katherine, Echeverria, Vanessa
Institution: Escuela Superior Politecnica del Litoral
Language: English
Subfield: Computer Science Applications
Field: Computer Science
Domain: Physical Sciences
SDG: Quality education
Open Access status: green
OpenAlex ID: W7045603085
