Packages

t

com.johnsnowlabs.nlp

HasBatchedAnnotate

trait HasBatchedAnnotate[M <: Model[M]] extends AnyRef

Self Type
HasBatchedAnnotate[M] with RawAnnotator[M]
Linear Supertypes
AnyRef, Any
Known Subclasses
AlbertForQuestionAnswering, AlbertForSequenceClassification, AlbertForTokenClassification, AlbertForZeroShotClassification, BartForZeroShotClassification, BertForMultipleChoice, BertForQuestionAnswering, BertForSequenceClassification, BertForTokenClassification, BertForZeroShotClassification, CamemBertForQuestionAnswering, CamemBertForSequenceClassification, CamemBertForTokenClassification, CamemBertForZeroShotClassification, DeBertaForQuestionAnswering, DeBertaForSequenceClassification, DeBertaForTokenClassification, DeBertaForZeroShotClassification, DistilBertForQuestionAnswering, DistilBertForSequenceClassification, DistilBertForTokenClassification, DistilBertForZeroShotClassification, LongformerForQuestionAnswering, LongformerForSequenceClassification, LongformerForTokenClassification, MPNetForQuestionAnswering, MPNetForSequenceClassification, MPNetForTokenClassification, RoBertaForQuestionAnswering, RoBertaForSequenceClassification, RoBertaForTokenClassification, RoBertaForZeroShotClassification, TapasForQuestionAnswering, XlmRoBertaForQuestionAnswering, XlmRoBertaForSequenceClassification, XlmRoBertaForTokenClassification, XlmRoBertaForZeroShotClassification, XlnetForSequenceClassification, XlnetForTokenClassification, NerDLModel, ZeroShotNerModel, AutoGGUFModel, BartTransformer, CPMTransformer, GPT2Transformer, LLAMA2Transformer, LLAMA3Transformer, M2M100Transformer, MarianTransformer, MistralTransformer, NLLBTransformer, Phi2Transformer, Phi3Transformer, QwenTransformer, StarCoderTransformer, T5Transformer, AlbertEmbeddings, BGEEmbeddings, BertEmbeddings, BertSentenceEmbeddings, CamemBertEmbeddings, DeBertaEmbeddings, DistilBertEmbeddings, E5Embeddings, InstructorEmbeddings, LongformerEmbeddings, MPNetEmbeddings, MxbaiEmbeddings, NomicEmbeddings, RoBertaEmbeddings, RoBertaSentenceEmbeddings, SnowFlakeEmbeddings, UAEEmbeddings, UniversalSentenceEncoder, XlmRoBertaEmbeddings, XlmRoBertaSentenceEmbeddings, XlnetEmbeddings
Ordering
  1. Grouped
  2. Alphabetic
  3. By Inheritance
Inherited
  1. HasBatchedAnnotate
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def batchAnnotate(batchedAnnotations: Seq[Array[Annotation]]): Seq[Seq[Annotation]]

    takes a document and annotations and produces new annotations of this annotator's annotation type

    takes a document and annotations and produces new annotations of this annotator's annotation type

    batchedAnnotations

    Annotations in batches that correspond to inputAnnotationCols generated by previous annotators if any

    returns

    any number of annotations processed for every batch of input annotations. Not necessary one to one relationship IMPORTANT: !MUST! return sequences of equal lengths !! IMPORTANT: !MUST! return sentences that belong to the same original row !! (challenging)

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def batchProcess(rows: Iterator[_]): Iterator[Row]
  6. val batchSize: IntParam

    Size of every batch (Default depends on model).

  7. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  8. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. def getBatchSize: Int

    Size of every batch.

  12. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  13. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  14. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  15. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  16. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  17. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  18. def setBatchSize(size: Int): HasBatchedAnnotate.this

    Size of every batch.

  19. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  20. def toString(): String
    Definition Classes
    AnyRef → Any
  21. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  22. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from AnyRef

Inherited from Any

getParam

param

setParam

Ungrouped