Home

Quite a long period of research on Question Answering (QA) has been driven by the annual tracks at CLEF, TREC and NTCIR. Since the QA at CLEF track was started in 2003, numerous groups have participated over the years and experiments have been conducted in many different language pairs. The result is that there are now several QA research groups in almost all the European countries and they have sufficient expertise to create systems which can perform complex tasks.

However, there is a continuous need of redefining the research field, and determine with some advance what are the next steps in QA systems development, research and evaluation.

Following the success of ResPubliQA 2009, the second evaluation campaign of QA systems over European Legislation has been held within the framework of CLEF 2010 conference. The aims of the approach were:

  • to move towards a domain of potential users;
  • to propose a setting which allows the direct comparison of performance across languages;
  • to allow QA technologies to be evaluated against IR approaches.

The workshop intends to address challenging issues for research in Multilingual Question Answering.

Two types of written contributions are invited, which may be selected for oral or poster presentations.

  1. Each participant in the ResPubliQA 2010 evaluation campaign is requested to submit a paper (8-10 pages) describing the system, how the runs were produced, and summarizing the main details and results of their experiments.
  2. Additionally, the submission of position papers (2-4 pages) is most welcome. A position paper presents an arguable opinion about an issue. The goal of a position paper is to convince the audience that your opinion is valid and worth listening to, without the need to present a completed research work and/or validated results. A position paper may be a short report and discussion of ideas focused on the topic "next steps in QA research, system development and evaluation".

Submissions will be reviewed by members of the programme committee and judged on technical quality, clarity and relevance to the workshop. A number of accepted papers will be selected for oral or poster presentations.