es.nlp.uned.weps.evaluation
Class SimpleScorer

java.lang.Object
  extended by es.nlp.uned.weps.evaluation.SimpleScorer

public class SimpleScorer
extends java.lang.Object

The Class SimpleScorer evaluates a single clustering solution.


Field Summary
static java.lang.String ALL_IN_ONE_BASELINE
          The Constant ALL_IN_ONE_BASELINE.
static java.lang.String COMBINED_BASELINE
          The Constant COMBINED_BASELINE.
static java.lang.String ONE_IN_ONE_BASELINE
          The Constant ONE_IN_ONE_BASELINE.
 
Constructor Summary
SimpleScorer(java.lang.String baselineType, java.lang.String key_path)
          This Constructor creates one of the baseline systems for scoring.
SimpleScorer(java.lang.String team_id, java.lang.String key_path, java.lang.String answer_path)
          Constructor.
 
Method Summary
 ClusteringEvaluation getEvaluation(java.util.ArrayList<Measure> measures)
          Gets the evaluation for a clutering solution
static ClusteringEvaluation getZeroEvaluation(java.util.ArrayList<Measure> measures)
           
 boolean isAnswerBaseline()
          Checks if is answer baseline.
 void removeDiscardedDocs()
          Removes from the answer documents that have been discarded in the human annotation (usually because the human was not able to annotate that particular document).
 
Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

ALL_IN_ONE_BASELINE

public static final java.lang.String ALL_IN_ONE_BASELINE
The Constant ALL_IN_ONE_BASELINE.

See Also:
Constant Field Values

ONE_IN_ONE_BASELINE

public static final java.lang.String ONE_IN_ONE_BASELINE
The Constant ONE_IN_ONE_BASELINE.

See Also:
Constant Field Values

COMBINED_BASELINE

public static final java.lang.String COMBINED_BASELINE
The Constant COMBINED_BASELINE.

See Also:
Constant Field Values
Constructor Detail

SimpleScorer

public SimpleScorer(java.lang.String baselineType,
                    java.lang.String key_path)
This Constructor creates one of the baseline systems for scoring.

Parameters:
key_path - the key clustering file (WePS 2007 format)
baselineType - type of baseline (SystemScorer.ALL_IN_ONE_BASELINE, SystemScorer.ONE_IN_ONE_BASELINE or SystemScorer.COMBINED_BASELINE).

SimpleScorer

public SimpleScorer(java.lang.String team_id,
                    java.lang.String key_path,
                    java.lang.String answer_path)
Constructor.

Parameters:
key_path - the key clustering file (WePS 2007 format)
team_id - the team_id
answer_path - the answer clustering file (WePS 2007 format)
Method Detail

isAnswerBaseline

public boolean isAnswerBaseline()
Checks if is answer baseline.

Returns:
true, if is answer baseline

removeDiscardedDocs

public void removeDiscardedDocs()
Removes from the answer documents that have been discarded in the human annotation (usually because the human was not able to annotate that particular document).


getEvaluation

public ClusteringEvaluation getEvaluation(java.util.ArrayList<Measure> measures)
Gets the evaluation for a clutering solution


getZeroEvaluation

public static ClusteringEvaluation getZeroEvaluation(java.util.ArrayList<Measure> measures)