Fairseq: A Fast, Extensible Toolkit For Sequence Modeling · Awesome LLM Papers Contribute to LLM-Bible

Fairseq: A Fast, Extensible Toolkit For Sequence Modeling

Myle Ott et al.. Proceedings of the 2019 Conference of the North 2019 – 694 citations

[Paper]    
Language Modeling Reinforcement Learning Training Techniques Time Series Large-Scale Training

fairseq is an open-source sequence modeling toolkit that allows researchers and developers to train custom models for translation, summarization, language modeling, and other text generation tasks. The toolkit is based on PyTorch and supports distributed training across multiple GPUs and machines. We also support fast mixed-precision training and inference on modern GPUs. A demo video can be found at https://www.youtube.com/watch?v=OtgDdWtHvto

Similar Work