Search

Home > NLP Highlights > 96 - Question Answering as an Annotation Format, with Luke Zettlemoyer
Podcast: NLP Highlights
Episode:

96 - Question Answering as an Annotation Format, with Luke Zettlemoyer
Category: Science & Medicine
Duration: 00:29:54
Publish Date: 2019-11-12 22:36:42
Description: In this episode, we chat with Luke Zettlemoyer about Question Answering as a format for crowdsourcing annotations of various semantic phenomena in text. We start by talking about QA-SRL and QAMR, two datasets that use QA pairs to annotate predicate-argument relations at the sentence level. Luke describes how this annotation scheme makes it possible to obtain annotations from non-experts, and discusses the tradeoffs involved in choosing this scheme. Then we talk about the challenges involved in using QA-based annotations for more complex phenomena like coreference. Finally, we briefly discuss the value of crowd-labeled datasets given the recent developments in pretraining large language models. Luke is an associate professor at the University of Washington and a Research Scientist at Facebook AI Research.
Total Play: 0