Journal of Beijing University of Posts and Telecommunications

  • EI核心期刊

Journal of Beijing University of Posts and Telecommunications ›› 2022, Vol. 45 ›› Issue (4): 37-43.doi: 10.13190/j.jbupt.2021-242

• Special Topics on Intelligent Medical • Previous Articles     Next Articles

Medical Question-Answer Matching Base on Adversarial Training

FU Jieqiong1,2, SUN Yawei1,2, LIU Jianyi3, LI Jinbin4   

  1. 1. School of Computer Science(National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China;
    2. Key Laboratory of Trustworthy Distributed Computing and Service(Ministry of Education), Beijing University of Posts and Telecommunications, Beijing 100876, China;
    3. School of Cyberspace Security, Beijing University of Posts and Telecommunications, Beijing 100876, China;
    4. National Population Health Data Center, Chinese Academy of Medical Sciences, Beijing 100005, China
  • Received:2021-10-18 Online:2022-08-28 Published:2022-06-26

Abstract: Compared with the question-answer matching task in the English open domain, the task in the Chinese professional medical field is more challenging.In view of the complexity of Chinese semantics and the diversity of medical data,most researchers focus on designing complex neural networks to explore deeper text semantics, and this kind of idea is relatively simple.At the same time, the neural network model is easy to make misjudgments due to small disturbances, and the poor generalization ability of the model.To solve these issues,a question-answer matching model is proposed based on adversarial training. A bidirectional pre-training encoder is used in this model to capture the semantic information of question-answer sentences and to obtain the corresponding vector representation. Then, adversarial samples are generated by adding a disturbance factor to the word embedding representation.Finally, the initial samples and adversarial samples are jointly input into the model with linear layers for classification prediction.Comparative experiments demonstrate that adversarial training can effectively improve the performance of the question-answer matching model on the cMedQA V2.0 dataset.

Key words: medical question-answer, adversarial training, natural language processing

CLC Number: