es.nlp.uned.weps.evaluation
Class TaskScorer

java.lang.Object
  extended by es.nlp.uned.weps.evaluation.TaskScorer

public class TaskScorer
extends java.lang.Object

The Class TaskScorer.


Field Summary
static java.lang.String ALL_IN_ONE_BASELINE
          The Constant ALL_IN_ONE_BASELINE.
static java.lang.String COMBINED_BASELINE
          The Constant COMBINED_BASELINE.
static java.lang.String ONE_IN_ONE_BASELINE
          The Constant ONE_IN_ONE_BASELINE.
 
Constructor Summary
TaskScorer(java.lang.String team_id, boolean answer_is_baseline, java.lang.String key_path, java.lang.String answer_path, java.lang.String description_path)
          Constructor.
 
Method Summary
 double getBCubedExtPrecision()
          Gets the BCubed extened precision measure.
 double getBCubedExtRecall()
          Gets the BCubed extended recall measure.
 double getInversePurity()
          Gets the inverse purity.
 double getMultiplicity()
          Gets the multiplicity measure.
 java.lang.String getNameSet()
          Gets the name set.
 double getPairsMeasure(int metricType)
          Calculates a pairs based measure.
 double getPurity()
          Gets the purity.
 boolean isAnswerBaseline()
          Checks if is answer baseline.
static void main(java.lang.String[] args)
          The main method.
 void removeDiscardedDocs()
          Removes the discarded docs.
 
Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

ALL_IN_ONE_BASELINE

public static final java.lang.String ALL_IN_ONE_BASELINE
The Constant ALL_IN_ONE_BASELINE.

See Also:
Constant Field Values

ONE_IN_ONE_BASELINE

public static final java.lang.String ONE_IN_ONE_BASELINE
The Constant ONE_IN_ONE_BASELINE.

See Also:
Constant Field Values

COMBINED_BASELINE

public static final java.lang.String COMBINED_BASELINE
The Constant COMBINED_BASELINE.

See Also:
Constant Field Values
Constructor Detail

TaskScorer

public TaskScorer(java.lang.String team_id,
                  boolean answer_is_baseline,
                  java.lang.String key_path,
                  java.lang.String answer_path,
                  java.lang.String description_path)
Constructor.

Parameters:
key_path - the key_path
answer_is_baseline - the answer_is_baseline
description_path - the description_path
answer_path - the answer_path
team_id - the team_id
Method Detail

isAnswerBaseline

public boolean isAnswerBaseline()
Checks if is answer baseline.

Returns:
true, if is answer baseline

getNameSet

public java.lang.String getNameSet()
Gets the name set.

Returns:
the name set

removeDiscardedDocs

public void removeDiscardedDocs()
Removes the discarded docs.


getPurity

public double getPurity()
Gets the purity.

Returns:
the purity

getInversePurity

public double getInversePurity()
Gets the inverse purity.

Returns:
the inverse purity

getPairsMeasure

public double getPairsMeasure(int metricType)
Calculates a pairs based measure.

Parameters:
metricType - the type of pair based metric (Measures.RAND_STATISTIC, Measures.JACCARD_COEFFICIENT or Measures.FOLKES_AND_MALLOWS).
Returns:
the pairs measure

getBCubedExtRecall

public double getBCubedExtRecall()
Gets the BCubed extended recall measure.

Returns:
the b cubed ext recall

getBCubedExtPrecision

public double getBCubedExtPrecision()
Gets the BCubed extened precision measure.

Returns:
the b cubed ext precision

getMultiplicity

public double getMultiplicity()
Gets the multiplicity measure.

Returns:
the multiplicity

main

public static void main(java.lang.String[] args)
The main method.

Parameters:
args - the args