Description
Pretrained RoBertaForSequenceClassification, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.profanity_model_3_1_pipeline
is a English model originally trained by parsawar.
How to use
pipeline = PretrainedPipeline("profanity_model_3_1_pipeline", lang = "en")
annotations = pipeline.transform(df)
val pipeline = new PretrainedPipeline("profanity_model_3_1_pipeline", lang = "en")
val annotations = pipeline.transform(df)
Model Information
Model Name: | profanity_model_3_1_pipeline |
Type: | pipeline |
Compatibility: | Spark NLP 5.4.2+ |
License: | Open Source |
Edition: | Official |
Language: | en |
Size: | 468.2 MB |
References
https://huggingface.co/parsawar/profanity_model_3.1
Included Models
- DocumentAssembler
- TokenizerModel
- RoBertaForSequenceClassification