Work

Hierarchical Low-Rank Tensors for Multilingual Transfer Parsing

Year: 2015

Type: conference-paper

Abstract: Accurate multilingual transfer parsing typically relies on careful feature engineering.In this paper, we propose a hierarchical tensor-based approach for this task.This approach induces a compact feature representation by combining atomic features.However, unlike traditional tensor models, it enables us to incorporate prior knowledge about desired feature interactions, eliminating invalid feature combinations.To this end, we use a hierarchical structure that uses intermediate embeddings to capture desired feature combinations.Algebraically, this hierarchical tensor is equivalent to the sum of traditional tensors with shared components, and thus can be effectively trained with standard online algorithms.In both unsupervised and semi-supervised transfer scenarios, our hierarchical tensor consistently improves UAS and LAS over state-of-theart multilingual transfer parsers and the traditional tensor model across 10 different languages.1

Source: Conference on Empirical Methods in Natural Language Processing (EMNLP)

DOI: 10.18653/v1/d15-1213

Authors: Yuan Zhang, Regina Barzilay

Institutions: MIT Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology

Language: English

Topic: Natural Language Processing Techniques

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

Funder: Army Research Office

Award: G7452299184