Arabic arbert_arabic_dialect_identification_pipeline pipeline BertForSequenceClassification from lafifi-24

Description

Pretrained BertForSequenceClassification, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.arbert_arabic_dialect_identification_pipeline is a Arabic model originally trained by lafifi-24.

Download Copy S3 URI

How to use


pipeline = PretrainedPipeline("arbert_arabic_dialect_identification_pipeline", lang = "ar")
annotations =  pipeline.transform(df)   


val pipeline = new PretrainedPipeline("arbert_arabic_dialect_identification_pipeline", lang = "ar")
val annotations = pipeline.transform(df)

Model Information

Model Name: arbert_arabic_dialect_identification_pipeline
Type: pipeline
Compatibility: Spark NLP 5.5.1+
License: Open Source
Edition: Official
Language: ar
Size: 607.7 MB

References

https://huggingface.co/lafifi-24/arbert_arabic_dialect_identification

Included Models

  • DocumentAssembler
  • TokenizerModel
  • BertForSequenceClassification