MRQA 2018: Machine Reading for Question Answering

Workshop at ACL 2018
Date: Thursday, July 19, 2018
Contact: mrqa2018@googlegroups.com

Machine Reading for Question Answering (MRQA) has become an important testbed for evaluating how well computer systems understand human language, as well as a crucial technology for industry applications such as search engines and dialog systems. The research community has recently created a multitude of large-scale datasets over text sources such as Wikipedia (WikiReading, SQuAD, WikiHop), news and other articles (CNN/Daily Mail, NewsQA, RACE), fictional stories (MCTest, CBT, NarrativeQA), and general web sources (MS MARCO, TriviaQA, SearchQA). These new datasets have in turn inspired an even wider array of new question answering systems.

This workshop will gather researchers to address and discuss important research topics surrounding MRQA, including:

  • Accuracy: How can we make MRQA systems more accurate?
  • Interpretability: How can systems provide rationales for their predictions?
  • Speed and Scalability: How can systems scale to consider larger contexts, from long documents to the whole web?
  • Robustness: How can systems generalize to other datasets and settings beyond the training distribution?
  • Dataset Creation: What are effective methods for building new MRQA datasets?
  • Dataset Analysis: What challenges do current MRQA datasets pose?
  • Error Analysis: What types of questions or documents are particularly challenging for existing systems?

Invited Speakers

Confirmed speakers:

Important Dates

  • Deadline for submission: Monday, April 23, 2018
  • Notification of acceptance: Tuesday, May 15, 2018
  • Deadline for camera-ready version: Monday, May 28, 2018
  • Early registration deadline: TBD
  • Workshop Date: Thursday, July 19, 2018

All submission deadlines are 11:59 PM GMT -12 (anywhere in the world).

Organization

Steering Committee:

Organizing Committee:

Sponsors

Naver

Facebook