Journal of Beijing University of Posts and Telecommunications

  • EI核心期刊

JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM ›› 2019, Vol. 42 ›› Issue (6): 126-133,141.doi: 10.13190/j.jbupt.2019-202

• Reports • Previous Articles     Next Articles

Unanswerable Questions Recognition by Semantic Discrepancy Detection

LIU Yong-bin1, WANG Xiao-jie1, YUAN Cai-xia1, YI Lian2   

  1. 1. School of Telecommunication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China;
    2. Alibaba(Beijing) Software Services Company Limited, Beijing 100022, China
  • Received:2019-09-28 Online:2019-12-28 Published:2019-11-15

Abstract: Machine reading comprehension (MRC) with unanswerable questions is challenging to the field of natural language processing research. Unlike previous work which ignores the mechanism of answerable and unanswerable, the semantic conflicts detection-based MRC network (SCDNet) was proposed aiming at detections of no-answer (NA) questions through semantic conflicts detection network. The basic idea is that if the given question is unanswerable, there exists semantic absence or conflicts between the question and the reference passages. Therefore, SCDNet predicts the NA probability by checking whether the passage covers the integral semantics of the question. Besides, in order to extract the exact answer from the passage, SCDNet is applied an answer length penalty in the loss function, which helps the learning objective to be more consistent with the evaluation metrics. SCDNet packs the NA question predictor and the answer extractor in a joint model and is trained in an end-to-end manner. Experiments show that SCDNet performs better than some strong baseline models, and achieve an F1 score of 72.43 and 76.96 NA accuracy on SQuAD 2.0 dataset.

Key words: machine reading comprehension, question answering, unanswerable question

CLC Number: