Keyword

annotator reliability

Description: The consistency and trustworthiness of an annotator's judgments or labels, assessed in tasks such as text classification, affect annotation, and crowdsourcing.
OpenAlex ID: keywords/annotator-reliability
2013 · Yan Yan, Rómer Rosales, et al. · Machine Learning · 254
2018 · Rodrigues, Filipe, Pereira, Francisco · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · 246
2010 · Micha Elsner, Eugene Charniak · Computational Linguistics · 119
2013 · Filipe Rodrigues, Francisco Pereira, et al. · Machine Learning · 108
2010 · Pinar Donmez, Jaime Carbonell, et al. · SIAM International Conference on Data Mining · 99
2013 · Shaohua Wan, J.K. Aggarwal · Pattern Recognition · 84
2013 · S. Joty, G. Carenini, et al. · Journal of Artificial Intelligence Research · 79
2018 · Filipe Rodrigues, Francisco Pereira · Proceedings of the AAAI Conference on Artificial Intelligence · 77
2014 · Andreas Peldszus · Workshop on Argument Mining (ArgMining) · 73
2022 · Olasunkanmi Oluwasanjo Ladapo, Adetomiwa A Dosunmu, et al. · Journal of Frontiers in Multidisciplinary Research · 65
2021 · Irene Martin-Morato, Annamaria Mesaros · European Signal Processing Conference (EUSIPCO) · 64
2017 · Alessandro Checco, Kevin Roitero, et al. · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · 56
2018 · An Nguyen, Aditya Kharosekar, et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 49
2004 · Ulrike Gut, Petra Saskia Bayerl · Speech prosody · 49
2013 · Andreas Peldszus, Manfred Stede · Linguistic Annotation Workshop · 46
2020 · Zhijun Chen, Huimin Wang, et al. · International Joint Conference on Artificial Intelligence · 43
2021 · Miguel López-Pérez, Mohamed Amgad, et al. · Scientific Reports · 32
2018 · Jinzheng Tu, Guoxian Yu, et al. · Proceedings · 29
2014 · Ciyang Qing, Ulle Endriss, et al. · UvA-DARE (University of Amsterdam) · 28
2016 · Richard Andersson, Olof Sandgren · Journal of Eye Movement Research · 26
2011 · Ping Zhang, Zoran Obradovic · Lecture notes in computer science · 26
2025 · Shahana Ibrahim, Panagiotis A. Traganitis, et al. · IEEE Signal Processing Magazine · 25
2016 · Tomonori Kodaira, Tomoyuki Kajiwara, et al. · Annual Meeting of the Association for Computational Linguistics: Student Research Workshop (ACL SRW) · 24
2016 · Xiaowei Jia, Ankush Khandelwal, et al. · IEEE International Conference on Big Data (BigData) · 23
Works count: 108
Citation count: 2,187
Year
Topic
Type