Smoke test Generative AI Authorship Verification PAN@CLEF 2025

PAN
1

I was reviewing the files for previous submissions of this task and noticed the presence of the smoke test, which is not available in this year’s task. Is there a release date for these tests?

2

Hi @Doffy143,

Thanks for reaching out! You can use the 2025 smoke test dataset, the formats are the same for Authorship verification in 2026. I will upload the 2026 variant (which is the 2025 variant) today to make this more clear.

Thanks and best regards,

Maik

3

I’ve been trying different ways to upload an image to the Tira task, including using Actions on GitHub, but it’s not working because this year’s smoke test is missing from the platform’s datasets. Is there no way to upload images to the task at the moment?

4

Hi @Doffy143,

Sorry for the delay!
The setup of the verification task is not yet finished for the 2026 edition, I will finalize this until monday and will update you when it is ready.
Best regards,

Maik

1 Like
5

Thanks for your help. I was able to access the smoke test without any problems, but now when I try to upload the image, I get an access error. Could it be that image reception is currently not active in task PAN26, or am I doing something wrong?

The error I have is the following, it should be noted that I am using the token provided by the task:
.APIError: 401 Client Error for http+docker://localnpipe/v1.53/auth: Unauthorized (“Get “https://registry.webis.de/v2/”: unauthorized: HTTP Basic: Access denied. If a password was provided for Git authentication, the password was incorrect or you’re required to use a token instead of a password. If a token was provided, it was either incorrect, expired, or improperly scoped. See https://git.webis.de/help/user/profile/account/two_factor_authentication_troubleshooting.md#error-http-basic-access-denied-if-a-password-was-provided-for-git-authentication-”)

6

Hi @Doffy143,

The spot-check dataset for 2026 is now available, [instructions are available here](pan-code/clef26/generative-authorship-verification/pan26_genai_baselines at master · pan-webis-de/pan-code · GitHub).

I look into the authentication problem, I think some internal token might be outdated. I will report back when I have resolved the problem (I think I need up to a day to resolve this).

Best regards,

Maik

1 Like
7

Hi @maik_froebe,

I’m running into an issue accessing my API key as the /admin/api/keys route returns a 404, and the admin panel itself is also inaccessible. I’m listed as an owner on the project but it seems my permissions don’t extend to the TIRA application layer.

Would you be able to manually generate/assign an API key to my team when you get a chance?

Thanks you!

1 Like
8

Dear @alexandrasz,

The description that points to /admin/api/keys is a bit misleading (sorry for that), this URL is intended only for admin API keys.

To get your API key for participation, please (1) go to the task page, then (2) click on “Submit”, then (3) click on “Code Submission” and there is a step-by-step instruction that shows you the API key for participation and how to verify the key.

(Please do not hesitate to contact me in case you have problems)

Best regards,

Maik

9

Dear all,

I now wrote a small script to refresh all authentication tokens (the 401 Client Error described above). All accounts that had an invalid authentication token should now work. In case the problem re-occurs for some newly created accounts, please drop me a short message, I can then re-run the script to refresh the tokens.

Best regards,

Maik