How to conduct experiments using CLEF data?
Introduction
The training and test datasets are provided in this package.
- Training data:
- a collection of medically related web documents, provided in the Data section,
- 5 development queries provided in the Topics section,
- a result set of web documents provided in the Assessments section.
- Test data: 50 test queries provided in the Topics section.
Documentation provided to the participants of the 2013 eHealth CLEF Lab is described in the Guidelines section.
Official results obtained by the participants and working notes papers are provided in the Working Notes Section.
Evaluation Procedure
Based on the above elements, an evaluation can be carried out as follows:
- Training: explore the training materials and develop automated techniques.
- Testing: conduct the evaluation using the 50 test queries.
- Assessments: check the post submission relevance assessments (results set for test queries in the Assessments section).
- Analysis: analyse your results by comparing them to those of participants having done the experiment in similar conditions.