Work

Why ADAM Beats SGD for Attention Models

Year: 2019

Type: article

Authors: Jingzhao Zhang, Sai Praneeth Karimireddy, Andreas Veit, Seungyeon Kim, Sashank J. Reddi, Sanjiv Kumar, Suvrit Sra

Language: English

Topic: Stochastic Gradient Optimization Techniques

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: closed

OpenAlex ID: W2992505801

FWCI: 4.427

Cites: 27

Cited by: 54

Related to: 10