Year: 2022
Type: article
Abstract: In this paper, we present a number of fine-grained resources for Natural Language Inference (NLI). In particular, we present a number of resources and validation methods for Greek NLI and a resource for precise NLI. First, we extend the Greek version of the FraCaS test suite to include examples where the inference is directly linked to the syntactic/morphological properties of Greek. The new resource contains an additional 428 examples, making it in total a dataset of 774 examples. Expert annotators have been used in order to create the additional resource, while extensive validation of the original Greek version of the FraCaS by non-expert and expert subjects is performed. Next, we continue the work initiated by (CITATION), according to which a subset of the RTE problems have been labeled for missing hypotheses and we present a dataset an order of magnitude larger, annotating the whole SuperGlUE/RTE dataset with missing hypotheses. Lastly, we provide a de-dropped version of the Greek XNLI dataset, where the pronouns that are missing due to the pro-drop nature of the language are inserted. We then run some models to see the effect of that insertion and report the results.
Authors: Amanaki, Erini, Bernardy, Jean-Philippe, Chatzikyriakidis, Stergios, Cooper, Robin, Dobnik, Simon, Karimi, Aram, Ek, Adam, Chrysovalantou Giannikouri, Eirini, Katsouli, Vasiliki, Kolokousis, Ilias, Chrysovalantou Mamatzaki, Eirini, Papadakis, Dimitrios, Petrova, Olga, Psaltaki, Erofili, Soupiona, Charikleia, Skoulataki, Effrosyni, Stefanidou, Christina
Institutions: University of Crete, University of Gothenburg
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Funders: Vetenskapsrådet, Göteborgs Universitet
OpenAlex ID: W7205193111