case class AccuracyReport(task: BenchmarkTask, overall: Map[String, Double], perClass: Map[String, Map[String, Double]] = Map.empty, support: Long = 0L, scoredColumns: Seq[String] = Seq.empty) extends Product with Serializable
Result of Benchmark.evaluate. The metric names in overall and perClass depend on
the BenchmarkTask: label-accuracy tasks report accuracy/weightedPrecision/
weightedRecall/weightedF1 (support-weighted across labels); NER and word segmentation
report entity/segment-level precision/recall/f1 (micro-averaged: pooled counts across
every type, matching conlleval/seqeval, via exact span-boundary matching); dependency parsing
reports uas/las; the text-similarity tasks report their own metric (bleu,
rouge1/rouge2/rougeL, wer, or exactMatch/f1).
These averaging conventions differ by task and are NOT interchangeable: overall("f1") from a
Classification report and from a NER report are computed differently and are not
comparable to each other. They can also differ from a metric the same model already reported
during its own training-time evaluation (which typically uses per-token tag accuracy for NER,
or macro-averaged F1 for classification) -- that is expected, not a discrepancy to reconcile.
- task
the task this report was scored against
- overall
corpus-level metric name -> value
- perClass
per-label/per-entity-type breakdown, metric name -> value; empty for tasks where a per-class breakdown doesn't apply (e.g. the text-similarity tasks)
- support
number of scored items (tokens, spans, or documents, depending on the task)
- scoredColumns
which of the pipeline's output columns this score was actually computed from
- Alphabetic
- By Inheritance
- AccuracyReport
- Serializable
- Serializable
- Product
- Equals
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
-
new
AccuracyReport(task: BenchmarkTask, overall: Map[String, Double], perClass: Map[String, Map[String, Double]] = Map.empty, support: Long = 0L, scoredColumns: Seq[String] = Seq.empty)
- task
the task this report was scored against
- overall
corpus-level metric name -> value
- perClass
per-label/per-entity-type breakdown, metric name -> value; empty for tasks where a per-class breakdown doesn't apply (e.g. the text-similarity tasks)
- support
number of scored items (tokens, spans, or documents, depending on the task)
- scoredColumns
which of the pipeline's output columns this score was actually computed from
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- val overall: Map[String, Double]
- val perClass: Map[String, Map[String, Double]]
- val scoredColumns: Seq[String]
- val support: Long
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
- val task: BenchmarkTask
-
def
toString(): String
- Definition Classes
- AccuracyReport → AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()