es.nlp.uned.weps.evaluation
Class TaskOverallScorer

java.lang.Object
  extended by es.nlp.uned.weps.evaluation.TaskOverallScorer

public class TaskOverallScorer
extends java.lang.Object

The Class TaskOverallScorer evaluates a set of system and outputs the final ranking.


Constructor Summary
TaskOverallScorer(java.lang.String keys_path, java.lang.String descriptions_path)
          The Constructor.
 
Method Summary
 TeamEvaluation evaluateBaseline(java.lang.String baseline_id)
          Evaluate baseline.
 TeamEvaluation evaluateTeam(java.lang.String team_id, java.lang.String answers_path)
          Evaluate team.
 double[] getAveragedEvaluation(java.lang.String eval_path)
          Gets the averaged evaluation.
static void main(java.lang.String[] args)
          The main method.
 
Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

TaskOverallScorer

public TaskOverallScorer(java.lang.String keys_path,
                         java.lang.String descriptions_path)
The Constructor.

Parameters:
descriptions_path - the descriptions_path
keys_path - the keys_path
Method Detail

evaluateBaseline

public TeamEvaluation evaluateBaseline(java.lang.String baseline_id)
Evaluate baseline.

Parameters:
baseline_id - the baseline_id
Returns:
the team evaluation

evaluateTeam

public TeamEvaluation evaluateTeam(java.lang.String team_id,
                                   java.lang.String answers_path)
Evaluate team.

Parameters:
answers_path - the answers_path
team_id - the team_id
Returns:
the team evaluation

getAveragedEvaluation

public double[] getAveragedEvaluation(java.lang.String eval_path)
                               throws java.io.IOException
Gets the averaged evaluation.

Parameters:
eval_path - the eval_path
Returns:
the averaged evaluation
Throws:
java.io.IOException - the IO exception

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception
The main method.

Parameters:
args - the args
Throws:
java.lang.Exception - the exception