Bengali bengali_multi_pipeline pipeline XlmRoBertaForQuestionAnswering from simoneZethof

Description

Pretrained XlmRoBertaForQuestionAnswering, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.bengali_multi_pipeline is a Bengali model originally trained by simoneZethof.

Download Copy S3 URI

How to use


pipeline = PretrainedPipeline("bengali_multi_pipeline", lang = "bn")
annotations =  pipeline.transform(df)   


val pipeline = new PretrainedPipeline("bengali_multi_pipeline", lang = "bn")
val annotations = pipeline.transform(df)

Model Information

Model Name: bengali_multi_pipeline
Type: pipeline
Compatibility: Spark NLP 5.5.0+
License: Open Source
Edition: Official
Language: bn
Size: 836.9 MB

References

https://huggingface.co/simoneZethof/Bengali_multi

Included Models

  • MultiDocumentAssembler
  • XlmRoBertaForQuestionAnswering