Multilingual t5_base_english_japanese_pipeline pipeline T5Transformer from sonoisa

Description

Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.t5_base_english_japanese_pipeline is a Multilingual model originally trained by sonoisa.

Download Copy S3 URI

How to use


pipeline = PretrainedPipeline("t5_base_english_japanese_pipeline", lang = "xx")
annotations =  pipeline.transform(df)   


val pipeline = new PretrainedPipeline("t5_base_english_japanese_pipeline", lang = "xx")
val annotations = pipeline.transform(df)

Model Information

Model Name: t5_base_english_japanese_pipeline
Type: pipeline
Compatibility: Spark NLP 5.4.2+
License: Open Source
Edition: Official
Language: xx
Size: 520.9 MB

References

https://huggingface.co/sonoisa/t5-base-english-japanese

Included Models

  • DocumentAssembler
  • T5Transformer