Keyword

annotation agreement

Description: The degree to which annotators assign matching labels or interpretations to the same data, used to assess annotation consistency and inform model training.
OpenAlex ID: keywords/annotator-agreement
2017 · Christian Stab, Iryna Gurevych · Computational Linguistics · 679
2015 · Martin Krallinger, Obdulia Rabal, et al. · Journal of Cheminformatics · 543
2013 · Daniel Dahlmeier, Hwee Tou Ng, et al. · Workshop on Innovative Use of NLP for Building Educational Applications · 477
2017 · Sven Buechel, Udo Hahn · Conference of the European Chapter of the Association for Computational Linguistics · 432
2005 · Florian Wolf, Edward Gibson · Computational Linguistics · 364
1997 · Poesio, Massimo, Vieira, Renata · arXiv (Cornell University) · 362
2019 · Ronak Kosti, Jose Alvarez, et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 320
2019 · Hala Mulki, Hatem Haddad, et al. · Workshop on Abusive Language Online (ALW) · 268
2014 · Davis J McCarthy, Peter Humburg, et al. · Genome Medicine · 232
2010 · Hayley Hung, Daniel Gatica-Perez · IEEE Transactions on Multimedia · 217
2015 · Lingjia Deng, Janyce Wiebe · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 188
2012 · Mara Breen,, Laura C. Dilley,, et al. · Corpus Linguistics and Linguistic Theory · 173
2019 · Lorenzo Tarantino, Philip N. Garner, et al. · Interspeech (USB) · 157
2021 · Jan Kocoń, Alicja Figas, et al. · Information Processing & Management · 145
2016 · Khalid Al‐Khatib, Henning Wachsmuth, et al. · University of Groningen research database (University of Groningen / Centre for Information Technology) · 140
2008 · Antonio Jimeno, Ernesto Jimenez-Ruiz, et al. · BMC Bioinformatics · 140
2009 · Changqin Quan, Fuji Ren · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 128
2009 · Phuong-Thai Nguyen, Xuan-Luong Vu, et al. · Linguistic Annotation Workshop · 118
2018 · Humam Alwassel, Fabian Caba Heilbron, et al. · Lecture notes in computer science · 113
2003 · Wanda Pratt, Meliha Yetisgen-Yildiz · Europe PMC (PubMed Central) · 112
2014 · Claire-Hélène Demarty, Cédric Penet, et al. · Multimedia Tools and Applications · 106
2019 · Hatem Haddad, Hala Mulki, et al. · Communications in computer and information science · 102
2018 · Julia Kreutzer, Joshua Uyheng, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 96
2009 · Beata Beigman Klebanov, Eyal Beigman · Computational Linguistics · 96
Works count: 682
Citation count: 11,520
Year
Topic
Type