That’s ok to use the human or automated rewrites. We explicitly encourage to use the human rewrites actually to get the upper-bound performance on non-conversational task but you should indicate this explicitly in the submission so that we can compare apples to apples in the end. We will make a separate leaderboard to measure performance on non-conversational questions.