Packages

case class AccuracyReport(task: BenchmarkTask, overall: Map[String, Double], perClass: Map[String, Map[String, Double]] = Map.empty, support: Long = 0L, scoredColumns: Seq[String] = Seq.empty) extends Product with Serializable

Result of Benchmark.evaluate. The metric names in overall and perClass depend on the BenchmarkTask: label-accuracy tasks report accuracy/weightedPrecision/ weightedRecall/weightedF1 (support-weighted across labels); NER and word segmentation report entity/segment-level precision/recall/f1 (micro-averaged: pooled counts across every type, matching conlleval/seqeval, via exact span-boundary matching); dependency parsing reports uas/las; the text-similarity tasks report their own metric (bleu, rouge1/rouge2/rougeL, wer, or exactMatch/f1).

These averaging conventions differ by task and are NOT interchangeable: overall("f1") from a Classification report and from a NER report are computed differently and are not comparable to each other. They can also differ from a metric the same model already reported during its own training-time evaluation (which typically uses per-token tag accuracy for NER, or macro-averaged F1 for classification) -- that is expected, not a discrepancy to reconcile.

task

the task this report was scored against

overall

corpus-level metric name -> value

perClass

per-label/per-entity-type breakdown, metric name -> value; empty for tasks where a per-class breakdown doesn't apply (e.g. the text-similarity tasks)

support

number of scored items (tokens, spans, or documents, depending on the task)

scoredColumns

which of the pipeline's output columns this score was actually computed from

Linear Supertypes
Serializable, Serializable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. AccuracyReport
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new AccuracyReport(task: BenchmarkTask, overall: Map[String, Double], perClass: Map[String, Map[String, Double]] = Map.empty, support: Long = 0L, scoredColumns: Seq[String] = Seq.empty)

    task

    the task this report was scored against

    overall

    corpus-level metric name -> value

    perClass

    per-label/per-entity-type breakdown, metric name -> value; empty for tasks where a per-class breakdown doesn't apply (e.g. the text-similarity tasks)

    support

    number of scored items (tokens, spans, or documents, depending on the task)

    scoredColumns

    which of the pipeline's output columns this score was actually computed from

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  8. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  9. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  10. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  11. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  12. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  13. val overall: Map[String, Double]
  14. val perClass: Map[String, Map[String, Double]]
  15. val scoredColumns: Seq[String]
  16. val support: Long
  17. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  18. val task: BenchmarkTask
  19. def toString(): String
    Definition Classes
    AccuracyReport → AnyRef → Any
  20. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  22. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped