No output was produced, watermark challenge

Support
1

image
image1454×1442 133 KB

After a successful tira-cli code-submission, triggering a run on the spot-check dataset produces:

  • Time: 0

  • output/ directory exists but is empty (0 directories, 0 files)

  • STDOUT empty, STDERR empty (aside from the downstream evaluator’s ValueError: directory does not exist)

Could you spot the reason why the container isn’t being executed?

Thanks!

2

Dear @yyLeaves,

Thanks for reaching out! I will look into this and report back soon.

Best regards,

Maik

3

Dear @yyLeaves,

there was an configuration error, this is now resolved.
(Your software runs and produces valid outputs, please note that the evaluation scores that are shown are for a dummy evalautor, I will deploy the real evaluator that got finished last week tomorrow, then the evaluation results will also be fine. The final test set and obfuscator is now also finished for text watermarking, I will deploy them tomorrow as well.)

Best regards,

Maik