Work

Will my auxiliary tagging task help? Estimating Auxiliary Tasks Effectivity in Multi-Task Learning

Year: 2017

Type: conference-paper

Abstract: Multitask learning often improves system performance for morphosyntactic and semantic tagging tasks.However, the question of when and why this is the case has yet to be answered satisfactorily.Although previous work has hypothesised that this is linked to the label distributions of the auxiliary task, we argue that this is not sufficient.We show that information-theoretic measures which consider the joint label distributions of the main and auxiliary tasks offer far more explanatory value.Our findings are empirically supported by experiments for morphosyntactic tasks on 39 languages, and are in line with findings in the literature for several semantic tasks.

Source: University of Groningen research database (University of Groningen / Centre for Information Technology)

Author: Johannes Bjerva

Institution: University of Groningen

Language: English

Topic: Natural Language Processing Techniques

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

Funders: Rijksuniversiteit Groningen, Nederlandse Organisatie voor Wetenschappelijk Onderzoek

OpenAlex ID: W2624275270

FWCI: 2.202

Cites: 18

Cited by: 27

Related to: 10