Work

On Orthogonality Constraints for Transformers

Year: 2021

Type: conference-paper

Abstract: Aston Zhang, Alvin Chan, Yi Tay, Jie Fu, Shuohang Wang, Shuai Zhang, Huajie Shao, Shuochao Yao, Roy Ka-Wei Lee. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers). 2021.

DOI: 10.18653/v1/2021.acl-short.48

Authors: Aston Zhang, Alvin Chan, Yi Tay, Jie Fu, Shuohang Wang, Shuai Zhang, Huajie Shao, Shuochao Yao, Roy Ka-Wei Lee

Institutions: Université de Montréal, George Mason University, ETH Zurich, Mila - Quebec Artificial Intelligence Institute, Singapore University of Technology and Design

Language: English

Topic: Topic Modeling

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: gold

OpenAlex ID: W3175042876

FWCI: 0.693

Cites: 27

Cited by: 10

Related to: 10