Description
The explain_document_md is a pretrained pipeline that we can use to process text with a simple pipeline that performs basic processing steps. It performs most of the common text processing tasks on your dataframe
Open in Colab Download Copy S3 URI
How to use
from sparknlp.pretrained import PretrainedPipelinein
pipeline = PretrainedPipeline('explain_document_md', lang = 'it')
annotations = pipeline.fullAnnotate(""Ciao da John Snow Labs! "")[0]
annotations.keys()
val pipeline = new PretrainedPipeline("explain_document_md", lang = "it")
val result = pipeline.fullAnnotate("Ciao da John Snow Labs! ")(0)
import nlu
text = [""Ciao da John Snow Labs! ""]
result_df = nlu.load('it.explain.document').predict(text)
result_df
Results
| | document | sentence | token | lemma | pos | embeddings | ner | entities |
|---:|:-----------------------------|:----------------------------|:----------------------------------------|:----------------------------------------|:-------------------------------------------|:-----------------------------|:--------------------------------------|:--------------------|
| 0 | ['Ciao da John Snow Labs! '] | ['Ciao da John Snow Labs!'] | ['Ciao', 'da', 'John', 'Snow', 'Labs!'] | ['Ciao', 'da', 'John', 'Snow', 'Labs!'] | ['VERB', 'ADP', 'PROPN', 'PROPN', 'PROPN'] | [[-0.146050006151199,.,...]] | ['O', 'O', 'I-PER', 'I-PER', 'I-PER'] | ['John Snow Labs!'] |
Model Information
| Model Name: | explain_document_md |
| Type: | pipeline |
| Compatibility: | Spark NLP 3.0.0+ |
| License: | Open Source |
| Edition: | Official |
| Language: | it |