Post-Hoc Experimentation

Here we provide a short screencast and tutorial on how post-hoc experiments (i.e., repeatability, applicability, and reproducibility) can be conducted after a shared task is completed using the archived repository fo the shared task.

You can try out everything yourself using this example archive of the shared task on clickbait spoiling (hosted at SemEval 2023):

You can also watch a screencast that guides you through post-hoc experiments:

Please do not hesitate to contribute additional examples, resources, or similar to the forum if you see fit.