Submission format

Format of data to be submitted to UNED by 10 July

One ASCII file in XML format from each site. The format must conform this dtd . You can download an example of use .

The dtd imposes this format:

<iclef-results site="SITEID">
<experiment searcher="SEARCHERID" topic="QUESTIONNUM" system="SYSTEMID">
<doc docno="CLEFDOCNO" rel="RELEVANCEJUDGEMENT" time="TIME"/>
...
</experiment>
<experiment searcher="SEARCHERID" topic="QUESTIONNUM" system="SYSTEMID">
<doc docno="CLEFDOCNO" rel="RELEVANCEJUDGEMENT" time="TIME"/>
...
</experiment>
...
</iclef-results>

where:

• SITEID : unique across sites
• SYSTEMID : unique within site to each of your displaying systems.
• SEARCHERID : unique within site to each of your searchers.
• TOPICNUM : a CLEF-2000 topic number
• CLEFDOCNO : a CLEF document identifier
• RELEVANCEJUDGEMENT : one of the following values:
  • 0 (not relevant)
  • 1 (somewhat relevant)
  • 2 (relevant)
  • 3 (unsure)
  • 4 (not judged)
• TIME : elapsed time in seconds between document display and relevance judgment. A value of 0 should be provided when the judgment was made without examining the document or when the document was not judged.

Fernando López Ostenero - Webmaster - Design and implementation

Home i CLEF '06 Past events i CLEF ' 2005 i CLEF ' 2004 i CLEF ' 2003 i CLEF ' 2002 i CLEF ' 2001 Guidelines Track Questions Data providedSearcher task Instructions Questionnaires Data to be submittedEvaluationExp. Schedule Analysis Schedule Submission formatExperiment design Data Coordinators CLEF