Edit on GitHub
  • John Snow Labs
  • Aug 17, 2024

English doc2query_ppo_msmarco_batch_256_doc_43520_mono_pipeline pipeline T5Transformer from Hermi2023

  • en
  • open_source
  • pipeline
  • onnx

Description

Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.doc2query_ppo_msmarco_batch_256_doc_43520_mono_pipeline is a English model originally trained by Hermi2023.

Download Copy S3 URI

How to use


pipeline = PretrainedPipeline("doc2query_ppo_msmarco_batch_256_doc_43520_mono_pipeline", lang = "en")
annotations =  pipeline.transform(df)   



val pipeline = new PretrainedPipeline("doc2query_ppo_msmarco_batch_256_doc_43520_mono_pipeline", lang = "en")
val annotations = pipeline.transform(df)

Model Information

Model Name: doc2query_ppo_msmarco_batch_256_doc_43520_mono_pipeline
Type: pipeline
Compatibility: Spark NLP 5.4.2+
License: Open Source
Edition: Official
Language: en
Size: 989.8 MB

References

https://huggingface.co/Hermi2023/doc2query-ppo-msmarco-batch-256-doc-43520-mono

Included Models

  • DocumentAssembler
  • T5Transformer