Hey,
We are doing the Milestone 2 and have a question about the assignment. It’s said that " You will upload (1) docker images with an updated version of your dataset containing qrels "
Which qrels should we upload for milestone 2? The ones that were sent to us or run.txt in BM25-output?
Dear @irisr,
Thanks for reaching out!
It was intended that you produce qrels for the run.txt that was sent to you.
(Should be roughly 50 documents per topic.)
Best regards,
Maik
Hey,
after running steps 0-2, we have generated a working HTML file as well as a run.txt in the first format listed in the assigment (qid 0 docno relevance).
The .txt we recieved via e-mail is in the format of the second one listed in the assigment (qid Q0 docno rank score tag).
After following the steps of the tutorial, we still aren’t really sure where this text file we recieved via mail is supposed to come into play, since you said we produce the qrels for the run file we have been sent? I don’t really see in which steps of the tutorial this file actually gets used?
Thanks, Yannick
Dear Yannick,
Sorry for the late response, I somehow overlooked your message.
The instructions are indeed not very clear.
I will discuss with @theelstner and @hscells how we can improve this, and will report back when we have clarified the instructions.
Best regards,
Maik
Dear @ybrenning,
We have now clarified and updated the assignment, thanks again for pointing us to the problem.
Theresa and Harry will write a mail with the updated assignment in a moment 
Best regards,
Maik
