Work

Randomized Positional Encodings Boost Length Generalization of Transformers

Year: 2023

Type: conference-paper

Abstract: Anian Ruoss, Grégoire Delétang, Tim Genewein, Jordi Grau-Moya, Róbert Csordás, Mehdi Bennani, Shane Legg, Joel Veness. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). 2023.

Source: Proceedings of the conference - Association for Computational Linguistics. Meeting

DOI: 10.18653/v1/2023.acl-short.161

Authors: Anian Ruoss, Grégoire Delétang, Tim Genewein, Jordi Grau-Moya, Róbert Csordás, Mehdi Bennani, Shane Legg, Joel Veness

Institutions: University of Applied Sciences and Arts of Southern Switzerland, Dalle Molle Institute for Artificial Intelligence Research, Università della Svizzera italiana

Language: English

Topic: Topic Modeling

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

OpenAlex ID: W4385571459

FWCI: 3.506

Cites: 32

Cited by: 24

Related to: 10