Work

The Cost of Training NLP Models: A Concise Overview

Year: 2020
Type: preprint
Abstract: We review the cost of training large-scale language models, and the drivers of these costs. The intended audience includes engineers and scientists budgeting their model-training experiments, as well as non-practitioners trying to make sense of the economics of modern-day Natural Language Processing (NLP).
Language: English
Open Access status: green
OpenAlex ID: W3016339201
Cites: 11
Cited by: 174
Related to: 10