Edit on GitHub
  • John Snow Labs
  • May 25, 2025

Multilingual distilbert_base_multilingual_cased_pii_pipeline pipeline DistilBertForTokenClassification from yonigo

  • xx
  • open_source
  • pipeline
  • onnx

Description

Pretrained DistilBertForTokenClassification, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.distilbert_base_multilingual_cased_pii_pipeline is a Multilingual model originally trained by yonigo.

Predicted Entities

Download Copy S3 URI

How to use

pipeline = PretrainedPipeline("distilbert_base_multilingual_cased_pii_pipeline", lang = "xx")
annotations =  pipeline.transform(df)

val pipeline = new PretrainedPipeline("distilbert_base_multilingual_cased_pii_pipeline", lang = "xx")
val annotations = pipeline.transform(df)

Model Information

Model Name: distilbert_base_multilingual_cased_pii_pipeline
Type: pipeline
Compatibility: Spark NLP 5.5.1+
License: Open Source
Edition: Official
Language: xx
Size: 505.6 MB

References

References

https://huggingface.co/yonigo/distilbert-base-multilingual-cased-pii

Included Models

  • DocumentAssembler
  • TokenizerModel
  • DistilBertForTokenClassification