Getting Started

TIRA is a platform for reproducible participation in shared tasks from IR, NLP, and machine learning.

As a participant, you can register for tasks and submit your software using TIRA. TIRA will execute your software on a dataset, evaluate the output, and report the scores back to you.

As a task organizer, you can provide (private) datasets to participants, manage submissions, and review the results.


User Management

Task Management:


Legacy Guides