BigBird is shown to dramatically improve performance across long-context NLP tasks, producing SOTA results in question answering and summarization.
BigBird is shown to dramatically improve performance across long-context NLP tasks, producing SOTA results in question answering and summarization.