Work

Modeling the Complexity of Manual Annotation Tasks: a Grid of Analysis

Year: 2012

Type: article

Abstract: Manual corpus annotation is getting widely used in Natural Language Processing (NLP). While being recognized as a difficult task, no in-depth analysis of its complexity has been performed yet. We provide in this article a grid of analysis of the different complexity dimensions of an annotation task, which helps estimating beforehand the difficulties and cost of annotation campaigns. We observe the applicability of this grid on existing annotation campaigns and detail its application on a real-world example.

Authors: Fort, Karen, Nazarenko, Adeline, Rosset, Sophie

Institutions: Université Sorbonne Paris Nord, Laboratoire d'Informatique de Paris-Nord, SEMAGRAMME: Analyse Sémantique de la Langue, Université Paris-Sud, Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur

Language: English

Topic: Computational and Text Analysis Methods

Subfield: General Social Sciences

Field: Social Sciences

Domain: Social Sciences

Open Access status: green

OpenAlex ID: W2250632121

FWCI: 12.85

Cites: 24

Cited by: 23

Related to: 10