Known items search task
We use pre-defined settings for KI / RI of 0.33 and 0.66;
We’ve calculated Precision and Recall for 4 combinations of these, reporting 0.66/0.33 in the notebook;
Paul’s analysis shows stability of submitted runs across different parameter combinations;
Lesson learned … we could use pre-defined shots with bounds for retrieval and evaluation, but that’s not real life;