Keyword

inter-annotator reliability

Description: Inter-annotator reliability is the degree to which multiple annotators consistently assign the same labels or judgments, assessed in data annotation research.
OpenAlex ID: keywords/inter-annotator-reliability
2008 · Ron Artstein, Massimo Poesio · Computational Linguistics · 2,492
2004 · Barbara Di Eugenio, Michael Glass · Computational Linguistics · 576
2004 · Elizabeth Shriberg, Raj Dhillon, et al. · Defense Technical Information Center (DTIC) · 387
2018 · Saif Mohammad, Svetlana Kiritchenko · Language Resources and Evaluation Conference (LREC) · 137
2004 · Rebecca J. Passonneau · Language Resources and Evaluation Conference (LREC) · 121
2008 · Alejna Brugos, Nanette Veilleux, et al. · Speech prosody · 118
2021 · Margaret Cychosz, Alejandrina Cristia, et al. · Developmental Science · 66
2021 · Patricia Pastoriza-Domínguez, Iván G. Torre, et al. · Speech Communication · 62
2013 · Aynat Rubinstein, Hillary Harner, et al. · 48
2017 · Xiaofei Lu, Ben Pin-Yun Wang · Language Resources and Evaluation · 43
2016 · Noushin Rezapour Asheghi, Serge Sharoff, et al. · Language Resources and Evaluation · 34
2004 · Seok Bae Jang, Jennifer Baldwin, et al. · ACM Transactions on Asian Language Information Processing · 29
2025 · Sriram Ramanathan, Lisa-Angelique Lim, et al. · International Conference on Learning Analytics and Knowledge (LAK) · 26
2021 · Henrique Santos, Mayank Kejriwal, et al. · Experimental Results · 21
2025 · Zhang, Dingling, Zhu, He, et al. · arXiv (Cornell University) · 19
2012 · Huanying (Helen) Gu, Gai Elhanan, et al. · Journal of Biomedical Informatics · 18
2023 · Dorota Gaskins, Marianna Falcone, et al. · Language and Cognition · 17
2019 · Sreeja P. S., G. S. Mahalakshmi · International Conference on Communications and Signal Processing (ICCSP) · 12
2026 · Masoomali Fatehkia, Enes Altinisik, et al. · Conference of the European Chapter of the Association for Computational Linguistics · 10
2016 · Jasy Liew Suet Yan · Syracuse University Libraries (Syracuse University) · 10
2014 · M. Pilar Valverde-Ibanez, Akira Ohtani · Waseda University Repository (Waseda University) · 10
2005 · Rebecca Bates, Patrick Menning, et al. · Interspeech (USB) · 8
Works count: 116
Citation count: 4,739
Year
Topic
Type