Description
Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.idt5_base_qaqg_v1_0_pipeline
is a English model originally trained by hawalurahman.
How to use
pipeline = PretrainedPipeline("idt5_base_qaqg_v1_0_pipeline", lang = "en")
annotations = pipeline.transform(df)
val pipeline = new PretrainedPipeline("idt5_base_qaqg_v1_0_pipeline", lang = "en")
val annotations = pipeline.transform(df)
Model Information
Model Name: | idt5_base_qaqg_v1_0_pipeline |
Type: | pipeline |
Compatibility: | Spark NLP 5.5.1+ |
License: | Open Source |
Edition: | Official |
Language: | en |
Size: | 986.7 MB |
References
https://huggingface.co/hawalurahman/idt5-base-qaqg_v1-0
Included Models
- DocumentAssembler
- T5Transformer