Description
Pretrained XlmRoBertaForSequenceClassification, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.xlm_roberta_base_language_detection_silvanus_pipeline is a Multilingual model originally trained by rollerhafeezh-amikom.
How to use
pipeline = PretrainedPipeline("xlm_roberta_base_language_detection_silvanus_pipeline", lang = "xx")
annotations =  pipeline.transform(df)   
val pipeline = new PretrainedPipeline("xlm_roberta_base_language_detection_silvanus_pipeline", lang = "xx")
val annotations = pipeline.transform(df)
Model Information
| Model Name: | xlm_roberta_base_language_detection_silvanus_pipeline | 
| Type: | pipeline | 
| Compatibility: | Spark NLP 5.4.2+ | 
| License: | Open Source | 
| Edition: | Official | 
| Language: | xx | 
| Size: | 882.4 MB | 
References
https://huggingface.co/rollerhafeezh-amikom/xlm-roberta-base-language-detection-silvanus
Included Models
- DocumentAssembler
- TokenizerModel
- XlmRoBertaForSequenceClassification