Our Transformers library implements several state-of-the-art transformer architectures used for NLP tasks like text classification, information extraction, question answering, and text generation. It is used by researchers and companies alike, offering PyTorch and TensorFlow front-ends. Since the release of our TensorFlow implementation, we have been working on productionizing the models and makin