Edit on GitHub
  • John Snow Labs
  • Dec 13, 2023

Castilian, Spanish roberta_spanish_clinical_trials_ner RoBertaForTokenClassification from lcampillos

  • roberta
  • es
  • open_source
  • token_classification
  • onnx

Description

Pretrained RoBertaForTokenClassification model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.roberta_spanish_clinical_trials_ner is a Castilian, Spanish model originally trained by lcampillos.

Download Copy S3 URI

How to use



documentAssembler = DocumentAssembler() \
    .setInputCol("text") \
    .setOutputCol("document")
    
tokenizer = Tokenizer() \
        .setInputCols(["document"]) \
        .setOutputCol("token")
        
    
tokenClassifier = RoBertaForTokenClassification.pretrained("roberta_spanish_clinical_trials_ner","es") \
            .setInputCols(["document","token"]) \
            .setOutputCol("ner")

pipeline = Pipeline().setStages([documentAssembler, tokenizer, tokenClassifier])

pipelineModel = pipeline.fit(data)

pipelineDF = pipelineModel.transform(data)




val documentAssembler = new DocumentAssembler()
    .setInputCol("text") 
    .setOutputCol("document")

val tokenizer = Tokenizer() \
        .setInputCols(Array("document")) \
        .setOutputCol("token")

val tokenClassifier = RoBertaForTokenClassification  
    .pretrained("roberta_spanish_clinical_trials_ner", "es")
    .setInputCols(Array("document","token")) 
    .setOutputCol("ner") 

val pipeline = new Pipeline().setStages(Array(documentAssembler, tokenizer, tokenClassifier))

val pipelineModel = pipeline.fit(data)

val pipelineDF = pipelineModel.transform(data)

Model Information

Model Name: roberta_spanish_clinical_trials_ner
Compatibility: Spark NLP 5.2.1+
License: Open Source
Edition: Official
Input Labels: [documents, token]
Output Labels: [ner]
Language: es
Size: 442.3 MB

References

https://huggingface.co/lcampillos/roberta-es-clinical-trials-ner