This paper (accepted at EMNP 2022) might has some pre-training approaches that might be helpful for spoiling as well [2205.10455] Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection
This paper (accepted at EMNP 2022) might has some pre-training approaches that might be helpful for spoiling as well [2205.10455] Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection