Portuguese Legal BERT Sentence Embedding Large Cased model

Description

Pretrained Legal BERT Sentence Embedding model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. bert-large-portuguese-cased-legal-mlm-nli-sts-v1 is a Portuguese model originally trained by stjiris.

Download Copy S3 URI

How to use

sent_embeddings = BertSentenceEmbeddings.pretrained("sent_bert_bert_large_portuguese_cased_legal_mlm_nli_sts_v1", "pt") \
  .setInputCols("sentence") \
  .setOutputCol("bert_sentence")

  nlp_pipeline = Pipeline(stages=[document_assembler, sentence_detector, sent_embeddings ])
    result = pipeline.fit(data).transform(data)
val sent_embeddings = BertSentenceEmbeddings.pretrained("sent_bert_bert_large_portuguese_cased_legal_mlm_nli_sts_v1", "pt")
  .setInputCols("sentence")
  .setOutputCol("bert_sentence")

  val pipeline = new Pipeline().setStages(Array(document_assembler, sentence_detector, sent_embeddings ))

Model Information

Model Name: sent_bert_bert_large_portuguese_cased_legal_mlm_nli_sts_v1
Compatibility: Spark NLP 4.3.2+
License: Open Source
Edition: Official
Input Labels: [sentence]
Output Labels: [bert_sentence]
Language: pt
Size: 1.3 GB
Case sensitive: true

References

  • https://huggingface.co/stjiris/bert-large-portuguese-cased-legal-mlm-nli-sts-v1
  • https://rufimelo99.github.io/SemanticSearchSystemForSTJ/
  • https://www.SBERT.net
  • https://github.com/rufimelo99
  • https://www.inesc-id.pt/projects/PR07005/