Google T5 (Text-To-Text Transfer Transformer) Base


The T5 transformer model described in the seminal paper “Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer”. This model can perform a variety of tasks, such as text summarization, question answering, and translation. More details about using the model can be found in the paper (

Live Demo Open in Colab Download Copy S3 URI

How to use

Either set the following tasks or have them inline with your input:

  • summarize:
  • translate English to German:
  • translate English to French:
  • stsb sentence1: Big news. sentence2: No idea.

The full list of tasks is in the Appendix of the paper:

document_assembler = DocumentAssembler() \
    .setInputCol("text") \

t5 = T5Transformer() \
    .pretrained("t5_base") \
    .setInputCols(["documents"]) \

pipeline = Pipeline().setStages([document_assembler, t5])
results =

val documentAssembler = new DocumentAssembler()

val t5 = T5Transformer

val pipeline = new Pipeline().setStages(Array(documentAssembler, t5))
val result =

import nlu
nlu.load("en.t5.base").predict("""Put your text here.""")

Model Information

Model Name: t5_base
Compatibility: Spark NLP 2.7.1+
Edition: Official
Input Labels: [sentence]
Output Labels: [t5]
Language: en

Data Source