The Cost Of Training NLP Models: A Concise Overview
Or Sharir, Barak Peleg, Yoav Shoham . Arxiv 2020 – 114 citations
[Paper]
We review the cost of training large-scale language models, and the drivers of these costs. The intended audience includes engineers and scientists budgeting their model-training experiments, as well as non-practitioners trying to make sense of the economics of modern-day Natural Language Processing (NLP).
📬 Stay current on LLM research:
Subscribe to the Weekly Digest
— a quick summary of new papers, tools, and micro-trends.