Announcements for Task 3: Image Retrieval for Arguments (2022)

Touché
1

I’ll use this topic for announcements regarding the task. You can watch the topic by clicking on the button with the bell icon and selecting a respective option.

Feel free to comment on announcements here.

2

New Dataset Version

2021-12-01

  • Removed 13 images where the XPaths were irregular due to faulty HTML (thanks to team Aramis for pointing out this problem!)
  • Removed images from the training data that are no longer in the dataset
3

New Dataset Version

2021-12-14

  • Added missing images (557) and entries in the rankings.jsonl related to topic 25
  • Added the original-rankings-baseline.py script that produces a run file using only the rankings.jsonl
4

New Dataset Version

2022-01-21

  • Removed 1211 images for which different HTML parsers provided different image XPaths. Thanks to team Aramis for detecting these!
  • Removed 5 images from the trainings-qrels accordingly