Persian fabert_pipeline pipeline BertEmbeddings from sbunlp

Description

Pretrained BertEmbeddings, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.fabert_pipeline is a Persian model originally trained by sbunlp.

Download Copy S3 URI

How to use


pipeline = PretrainedPipeline("fabert_pipeline", lang = "fa")
annotations =  pipeline.transform(df)   


val pipeline = new PretrainedPipeline("fabert_pipeline", lang = "fa")
val annotations = pipeline.transform(df)

Model Information

Model Name: fabert_pipeline
Type: pipeline
Compatibility: Spark NLP 5.5.0+
License: Open Source
Edition: Official
Language: fa
Size: 464.6 MB

References

https://huggingface.co/sbunlp/fabert

Included Models

  • DocumentAssembler
  • TokenizerModel
  • BertEmbeddings