IMPORTANT - Zip Archive format for submitting to "Profiling Irony and Stereotype Spreaders on Twitter" task

When you choose the option to upload a zip archive with your results for test dataset, please consider that the correct structure of the archive is very important for evaluator and the evaluation process will return nothing if the structure of the archive is different.

The expected structure of the archive should be similar to the structure of the training dataset, e.g. the generated xml-files need to be saved in the en folder and this folder should be in the root of the archive:

➜ zipinfo results.zip                                                                                                                                                
Archive:  results.zip
Zip file size: 1615 bytes, number of entries: 180
drwxrwxrwx  2.0 unx        0 bx stor 22-May-23 05:53 en/
-rwxrwxrwx  2.0 unx       71 bx defN 22-May-23 05:49 en/11af5d73a6168f5d449788d432d3a71c.xml
-rwxrwxrwx  2.0 unx       71 bx defN 22-May-23 05:49 en/100ff179983b65bf748ebc64f2966cda.xml
-rwxrwxrwx  2.0 unx       71 bx defN 22-May-23 05:49 en/124b8295f6a00d05825c229a39207586.xml
-rwxrwxrwx  2.0 unx       71 bx defN 22-May-23 05:49 en/1337cd846e2b71e353442d641e5acec4.xml
-rwxrwxrwx  2.0 unx       70 bx defN 22-May-23 05:49 en/1272428df3ae67f538fb0f7b3e0f3f6c.xml
...
180 files, 354 bytes uncompressed, 357 bytes compressed:  -0.8%

Check, if your previous submissions follow the required format. Please reupload your results if it did not and run evaluator again.

1 Like