Multilingual week5_eng_distilbert_base_multilingual_cased_finetuned_pipeline pipeline DistilBertForTokenClassification from ensw

Description

Pretrained DistilBertForTokenClassification, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.week5_eng_distilbert_base_multilingual_cased_finetuned_pipeline is a Multilingual model originally trained by ensw.

Download Copy S3 URI

How to use


pipeline = PretrainedPipeline("week5_eng_distilbert_base_multilingual_cased_finetuned_pipeline", lang = "xx")
annotations =  pipeline.transform(df)   


val pipeline = new PretrainedPipeline("week5_eng_distilbert_base_multilingual_cased_finetuned_pipeline", lang = "xx")
val annotations = pipeline.transform(df)

Model Information

Model Name: week5_eng_distilbert_base_multilingual_cased_finetuned_pipeline
Type: pipeline
Compatibility: Spark NLP 5.5.0+
License: Open Source
Edition: Official
Language: xx
Size: 505.4 MB

References

https://huggingface.co/ensw/week5-eng-distilbert-base-multilingual-cased-finetuned

Included Models

  • DocumentAssembler
  • TokenizerModel
  • DistilBertForTokenClassification