|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectes.nlp.uned.weps.evaluation.SystemScorer
public class SystemScorer
The Class MultiSystemScorer evaluates a set of systems and outputs the final ranking.
Constructor Summary | |
---|---|
SystemScorer(java.io.File keysDir,
java.io.File systemsAnswersDir,
java.io.File outputDir,
java.util.ArrayList<Measure> measures,
java.util.HashSet<java.lang.String> baselines,
boolean overwriteEvaluations)
The Constructor for scoring multiple clustering problems and their corresponding solutions. |
Method Summary | |
---|---|
TeamEvaluation |
evaluateBaseline(java.lang.String baselineType)
Generates a baseline answer and evaluates it with the key. |
TeamEvaluation |
evaluateTeam(java.lang.String team_id,
java.io.File teamAnswersDir)
Evaluate team using all the clustering problems. |
double[] |
getAveragedScores(java.io.File evalFile)
Gets the averaged evaluation for a particular team. |
java.util.HashMap<java.lang.String,TeamEvaluation> |
getBaselineEvaluations(java.util.HashSet<java.lang.String> baselines,
java.io.File outputDir,
boolean overwriteEvaluations)
|
java.lang.String[] |
getColumnLabels(java.io.File evalFile)
|
java.util.HashMap<java.lang.String,TeamEvaluation> |
getEvaluations(java.io.File systemsAnswersDir,
java.io.File outputDir,
boolean overwriteEvaluations)
|
static void |
main(java.lang.String[] args)
The main method. |
Methods inherited from class java.lang.Object |
---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public SystemScorer(java.io.File keysDir, java.io.File systemsAnswersDir, java.io.File outputDir, java.util.ArrayList<Measure> measures, java.util.HashSet<java.lang.String> baselines, boolean overwriteEvaluations) throws java.io.IOException
keys_path
- the directory that contains all the key clustering files (following the WePS 2007 format)
java.io.IOException
Method Detail |
---|
public TeamEvaluation evaluateBaseline(java.lang.String baselineType)
baseline_id
- the baseline_id
public TeamEvaluation evaluateTeam(java.lang.String team_id, java.io.File teamAnswersDir)
answers_path
- the answers_pathteam_id
- the team_id
public java.util.HashMap<java.lang.String,TeamEvaluation> getEvaluations(java.io.File systemsAnswersDir, java.io.File outputDir, boolean overwriteEvaluations) throws java.io.IOException
java.io.IOException
public java.util.HashMap<java.lang.String,TeamEvaluation> getBaselineEvaluations(java.util.HashSet<java.lang.String> baselines, java.io.File outputDir, boolean overwriteEvaluations) throws java.io.IOException
java.io.IOException
public double[] getAveragedScores(java.io.File evalFile) throws java.io.IOException
eval_path
- the eval_path
java.io.IOException
- the IO exceptionpublic java.lang.String[] getColumnLabels(java.io.File evalFile) throws java.io.IOException
java.io.IOException
public static void main(java.lang.String[] args) throws java.lang.Exception
args
- the args
java.lang.Exception
- the exception
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |