Cross-Model Analysis of Token-Level Explanations in Tatar Text Classification
Year: 2026
Type: conference-paper
Abstract: The aim of this work is to evaluate the performance, interpretability, and consistency of explanations generated by different Explainable AI (XAI) methods for different machine learning models trained on a Tatar language text classification task. Explanations were generated by using Integrated Gradients and LIME methods, and aggregated to obtain global importance scores. Inter-model similarity of explanations was assessed by using Spearman rank correlation and Jaccard overlap, while cross-model consensus was identified through bootstrap confidence intervals and Kendall’s coefficient of concordance. Although classifiers demonstrated comparable predictive performance, their global explanatory patterns differed substantially. But a subset of architectureindependent tokens showed statistically stable and directionally consistent influence across models. The proposed framework enables systematic evaluation of explanation stability and is applicable to low-resource NLP languages requiring transparent and robust model analysis. The work contributes both to the field of computational linguistics for Turkic languages and to the methodology of interpreting different machine learning models for text data.
Institutions: Kazan Federal University, Tatarstan Academy of Sciences
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W7167210359
