Hi
I’ve uploaded around eight runs, and I noticed that some of the results appear to match exactly. I’m quite certain these are not duplicate model uploads, as I deleted each model after uploading it before proceeding with the next run. I just wanted to check whether this might be expected behavior or if there could have been an issue during processing.
Additionally, could you please let me know when the main leaderboard is expected to be announced? I’m hoping to include the final ranking in the paper if the timeline allows.
Thank you very much for your time and help — I really appreciate the effort that you and the team are putting into organizing everything.
Best regards,
Adnan
Dear Adnan,
I can see that the submissions have been uploaded under the same docker image tag. When each of those docker images was build from scratch and uploaded one after another it should be fine, but it still can be prone to error (e.g., maybe the same image has been uploaded multiple times because of a mistake or typo).
You could upload them again and run them again, this would be fine from our side. I can unblind the results as they come in.
For the final evaluation: we still need time for this, please see the Discord chat for an explanation and updates/details.
Best regards,
Maik
Maik, could you please share the discord group link? (I didn’t find the one on the task page / tira platform)
– Yurii
Sure, no problem, the discord invite is linked at the conference page (under the community section).
Best regards,
Maik
1 Like
Thanks for the response, i am in the process of reuploading the runs, but when i go to tira to run on the dataset, i don’t see any resources available.
Regards
Adnan
Ah, yes, I can add them again, please already add all your submissions, I would then add the executors again (likely in the afternoon direction), and then run everything.
Best regards,
Maik
1 Like
Noted, I will add all of the submisson shortly
Regards
Adnan
Cool, thanks!
I think I should be able to run all of them today, but in case there is some delay, please prepare your notebook paper in a way that you describe all your submissions and maybe skip the evaluation for the once that are running. (we can add the eval later :))
1 Like
Appreciate the Help.
I have uploaded all of the models
Regards
Adnan
Cool, thanks!
I will likely be able to run them today evening 
I report back when this is done.
Best regards,
Maik
2 Likes
Really appreciate the help
Just curios as some of the results of my submissions are hidden, should this be the case? as well as is there a timeline on the final tira leaderboard where i can see my rank among the other submissions
Kindest regards
Adnan
Dear Adnan, sorry for the delay.
I now started everything and unblinded all executions that already finished. (this is a manual process)
It is not yet clear when the final leaderboard will be public, we will anounce this in the Discord chat.
Best regards,
Maik
1 Like
