智能对话系统架构及算法

doi:10.13190/j.jbupt.2019-169

北京邮电大学学报 ›› 2019, Vol. 42 ›› Issue (6): 10-19.doi: 10.13190/j.jbupt.2019-169

智能对话系统架构及算法

黄毅, 冯俊兰, 胡珉, 吴晓婷, 杜晓宇

中国移动研究院, 北京 100053

收稿日期:2019-07-31 发布日期:2019-11-15
通讯作者: 冯俊兰(1974-),女,国家特聘专家,E-mail:fengjunlan@chinamobile.com. E-mail:fengjunlan@chinamobile.com
作者简介:黄毅(1989-),男,研究员.

Architecture and Algorithms of Intelligent Dialogue System

HUANG Yi, FENG Jun-lan, HU Min, WU Xiao-ting, DU Xiao-yu

China Mobile Research Institute, Beijing 100053, China

Received:2019-07-31 Published:2019-11-15

摘要/Abstract

摘要： 智能人机对话系统综合应用了人工智能领域多项核心技术，随着深度学习、强化学习等基础算法的快速发展，人机对话系统的总体架构、算法体系以及应用模式都有了重大的改变和提升.从人机对话系统的架构、人机对话系统的核心算法和该领域面临的挑战以及技术研究方面做了综述.

关键词: 对话系统, 深度学习, 人机交互

Abstract: Intelligent human-machine dialogue system comprehensively utilizes a number of core technologies in the field of artificial intelligence. In recent years, with the development of basic algorithms such as deep learning and reinforcement learning, the overall structure, algorithm system and application mode of human-machine dialogue system have been changed and improved greatly. In order to sort out and summarize this technology, the architecture of human-machine dialogue system, the core algorithm of human-machine dialogue system, challenges and technical directions in this field are reviewed.

Key words: dialogue system, deep learning, human-machine interaction

中图分类号:

TP391.1

黄毅, 冯俊兰, 胡珉, 吴晓婷, 杜晓宇. 智能对话系统架构及算法[J]. 北京邮电大学学报, 2019, 42(6): 10-19.

HUANG Yi, FENG Jun-lan, HU Min, WU Xiao-ting, DU Xiao-yu. Architecture and Algorithms of Intelligent Dialogue System[J]. Journal of Beijing University of Posts and Telecommunications, 2019, 42(6): 10-19.

参考文献

[1] Turing Alan M. Computing machinery and intelligence[J]. Mind, 1950, LIX(236):433-460.
[2] 陈晨, 朱晴晴, 严睿, 等. 基于深度学习的开放领域对话系统研究综述[J]. 计算机学报, 2019, 42(7):1439-1466. Chen Chen, Zhu Qingqing, Yan Rui, et al. Survey on deep learning based open domain dialogue system[J]. Chinese Journal of Computers, 2019, 42(7):1439-1466.
[3] López-Cózar Ramón, Zoraida Callejas, Griol David, et al. Review of spoken dialogue systems[J]. Loquens, 2015, 1(2):2386-2637.
[4] Chen Hongshen, Liu Xiaorui, Yin Dawei, et al. A survey on dialogue systems:recent advances and new frontiers[J]. SIGKDD Explorations, 2017, 19(2):25-35.
[5] Young Steve, Gašić Milica, Thomson Blaise, et al. POMDP-based statistical spoken dialogue systems:a review[J]. Proceedings of the IEEE, 2013, 101(5):1160-1179.
[6] Lee Sungjin, Zhu Qi, Takanobu Ryuichi, et al. ConvLab:multi-domain end-to-end dialog system platform[C]//Proceedings of the 57^th Annual Meeting of the Association for Computational Linguistics(ACL). Florence:[s.n.], 2019:64-69.
[7] Wen Tsung-Hsien, Vandyke David, Mrkši Nikola, et al. A network-based end-to-end trainable task-oriented dialogue system[C]//European Chapter of the Association for Computational Linguistics(EACL). Valencia:[s. n.], 2017:438-449.
[8] Huang Po-Sen, He Xiaodong, Gao Jianfeng, et al. Learning deep structured semantic models for web search using click through data[C]//Proceedings of the 22^nd ACM International Conference on Information and Knowledge Management. Amazon:[s.n.], 2013:2333-2338.
[9] Shen Yelong, He Xiaodong, Gao Jianfeng, et al. A latent semantic model with convolutional-pooling structure for information retrieval[C]//Proceedings of the 23^rd ACM International Conference on Information and Knowledge Management(CIKM). NewYork:ACM Press, 2014:101-110.
[10] Shen Yelong, He Xiaodong, Gao Jianfeng, et al. Learning semantic representations using convolutional neural networks for web search[C]//Proceedings of the 23^rd International Conference on WWW. Seoul:[s.n.], 2014:373-374.
[11] Hu Baotian, Lu Zhengdong, Li Hang, et al. Convolutional neural network architectures for matching natural language sentences[C]//Proceedings of the Advances in Neural Information Processing System. Montreal:[s.n.], 2014:2042-2050.
[12] Tai Kai Sheng, Socher Richard, Manning Christopher D. Improved semantic representations from tree-structured long short-term memory networks[C]//Proceedings of the 53^rd Annual Meeting of the Association for Computational(ACL). Beijing:[s.n.], 2015:15-26.
[13] Yin Wenpeng, Schutze Hinrich, Xiang Bing, et al. ABCNN:attention-based convolutional neural network for modeling sentence[J]. arXiv preprint arXiv:1512. 05193.
[14] Pang Liang, Lan Yanyan, Guo Jiafeng, et al. Text matching as image recognition[C]//Proceedings of the 30^th AAAI Conference on Artificial Intelligence. Phoenix:[s.n.], 2016:2793-2799.
[15] Chen Qian, Zhu Xiaodan, Ling Zhenhua, et al. Enhanced LSTM for natural language inference[C]//Proceedings of the 55^th Annual Meeting of the Association for Computational Linguistics(ACL). Vancouver:[s.n.], 2017:17-29.
[16] Tur Gokhan, Deng Li, Hakkani-Tur Dilek, et al. Towards deeper understanding:deep convex networks for semantic utterance classification[C]//2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Kyoto:[s.n.], 2012:5045-5048.
[17] Lee Ji Young, Dernoncourt Franck. Sequential short-text classification with recurrent and convolutional neural networks[C]//Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies. San Diego California:[s.n.], 2016:515-520.
[18] Liu Bing, Ian Lane. Attention-based recurrent neural network models for joint intent detection and slot filling[C]//Interspeech 2016, 17^th Annual Conference of the International Speech Communication Association. San Francisco:[s.n.], 2016:685-689.
[19] Goo Chih-Wen, Gao Guang, Hsu Yun-Kai, et al. Slot-gated modeling for joint slot filling and intent prediction[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies. New Orleans:[s.n.], 2018:753-757.
[20] Aaron Jaech, Heck Larry, Ostendorf Mari. Domain adaptation of recurrent neural networks for natural language understanding[C]//Interspeech 2016, 17^th Annual Conference of the International Speech Communication Association. San Francisco:[s.n.], 2016:690-694.
[21] Franck Dernoncourt, Lee Ji Young, Bui Trung H. Robust dialog state tracking for large ontologies[M]. Singapore:Springer, 2016:475-485.
[22] Williams Jason, Young Steve. Partially observable Markov decision processes for spoken dialog systems[J]. Computer Speech & Language, 2007, 21(2):393-422.
[23] Mrkšić Nikola, Séaghdha Diarmuid Ó, Wen Tsung Hsien, et al. Neural belief tracker:data-driven dialogue state tracking[C]//Proceedings of the 55^th Annual Meeting of the Association for Computational Linguistics. Vancouver:[s.n.], 2017:1777-1788.
[24] Xu Puyang, Hu Qi. An end-to-end approach for handling unknown slot values in dialogue state tracking[C]//Proceedings of the 56^th Annual Meeting of the Association for Computational Linguistics. Melbourne, Australia:[s.n.], 2018:1448-1457.
[25] Zhong Victor, Xiong Caiming, Socher Richard. Global-locally self-attentive dialogue state tracker[EB/OL]. 2018(2018-09-01)[2019-12-15]. http://arxiv.org/abs/1805.09655.
[26] Ren Liliang, Xie Kaige, Chen Lu, et al. Towards universal dialogue state tracking[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Brussels, Belgium:[s.n.], 2018:2780-2786.
[27] Williams Jason. Multi-domain learning and generalization in dialog state tracking[C]//Proceedings of the SIGDIAL 2013 Conference, the 14^th Annual Meeting of the Special Interest Group on Discourse and Dialogue. Metz, France:[s.n.], 2013:433-441.
[28] Mrkšić Nikola, Séaghdha Diarmuid Ó, Thomson Blaise, et al. Multi-domain dialog state tracking using recurrent neural networks[C]//Proceedings of the 53^rd Annual Meeting of the Association for Computational Linguistics and the 7^th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing. Beijing, China:[s.n.], 2015:794-799.
[29] Zhou Keyan, Zong Chengqing, Wu Hua, et al. Predicting and tagging dialog-act using MDP and SVM[C]//2008 6^th International Symposium on Chinese Spoken Language Processing. Kunming:IEEE, 2008:293-296.
[30] Li Yuxi. Deep reinforcement learning:an overview[EB/OL]. 2017(2017-01-01)[2019-12-10]. http://arxiv.org/abs/1701.07274.
[31] Mnih Volodymyr, Kavukcuoglu Koray, Silver David, et al. Human-level control through deep reinforcement learning[J]. Nature, 2015, 518(7540):529-533.
[32] Cuayáhuitl Heriberto. SimpleDS:a simple deep reinforcement learning dialogue system[J]. Springer, 2017(427):109-118.
[33] Cuayáhuitl Heriberto, Yu Seunghak, Williamson Ashley, et al. Scaling up deep reinforcement learning for multi-domain dialogue systems[C]//2017 International Joint Conference on Neural Networks (IJCNN). Anchorage, AK, USA:[s.n.], 2017:3339-3346.
[34] Ultes Stefan, Rojas-Barahona Lina, Su Pei-Hao, et al. Pydial:a multi-domain statistical dialogue system toolkit[C]//Proceedings of the 55^th Annual Meeting of the Association for Computational Linguistics-System Demonstrations. Canada:Vancouver, 2017:73-78.
[35] Casanueva Iñigo, Budzianowski Paweł, Su Pei-Hao, et al. A benchmarking environment for reinforcement learning based task oriented dialogue management[EB/OL]. 2018(2018-04-03)[2019-12-09]. http://arxiv.org/abs/1711.11023.
[36] Weisz Gellert, Budzianowski Pawel, Su Pei-Hao, et al. Sample efficient deep reinforcement learning for dialogue systems with large action spaces[J]. IEEE/ACM Transactions on Audio Speech and Language Processing, 2018, 26(11):2083-2097.
[37] Li Xiujun, Chen Yun-Nung, Li Lihong, et al. End-to-end task-completion neural dialogue systems[C]//Proceedings of the Eighth International Joint Conference on Natural Language Processing(IJCNLP). Taipei:[s.n.], 2017:733-743.
[38] Paulus Romain, Xiong Caiming, Socher Richard. A deep reinforced model for abstractive summarization[C]//6^th International Conference on Learning Representations(ICLR). Vancouver, BC, Canada:[s.n.], 2018.
[39] Budzianowski Paweł, Wen Tsung-hsien, Tseng Bo-hsiang, et al. MultiWOZ-A large-scale multi-domain wizard-of-oz dataset for task-oriented dialogue modelling[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Brussels:[s.n.], 2018:5016-5026.
[40] Zhao Tiancheng, Xie Kaige, Eskenazi M. Rethinking action spaces for reinforcement learning in end-to-end dialog agents with latent variable models[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies(NAACL-HLT). Minneapolis, MN, USA:[s.n.], 2019:1208-1218.
[41] Galley Michel, Brockett Chris, Gao Xiang, et al. End-to-end conversation modeling:Dstc7 task 2 description[C]//Dialog System Technology Challenges. Honolulu:[s.n.], 2018.
[42] Keneshloo Yaser, Shi Tian, Ramakrishnan Naren, et al. Deep reinforcement learning for sequence-to-sequence models[EB/OL]. 2019(2019-04-01)[2019-12-15]. http://arxiv.org/abs/1805.09461.
[43] Peters Matthew E, Neumann Mark, Iyyer Mohit, et al. Deep contextualized word representations[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies(NAACL-HLT). New Orleans, Louisiana, USA:[s.n.], 2018:2227-2237.
[44] Radford Alec, Narasimhan Karthik, Salimans Tim, et al. Improving language understanding by generative pre-training[EB/OL]. 2018(2018-05-08)[2019-09-23]. https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf.
[45] Devlin Jacob, Chang Ming-Wei, Lee Kenton, et al. BERT:pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies(NAACL-HLT). Minneapolis, MN, USA:[s.n.], 2019:4171-4186.

智能对话系统架构及算法

Architecture and Algorithms of Intelligent Dialogue System

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	刘阳, 滕颖蕾, 牛涛, 郅佳琳. 基于深度强化学习的滤波器剪枝方案[J]. 北京邮电大学学报, 2023, 46(3): 31-36.
[2]	靳梦凡, 黄智濒, 储志强. 复杂环境下多模态指导的点云补全方法[J]. 北京邮电大学学报, 2023, 46(3): 103-108.
[3]	荣震宇刘建毅. 基于Transformer和MLP的眼底血管分割算法[J]. 北京邮电大学学报, 2023, 46(1): 26-31.
[4]	黄宏程孔田田胡敏陶洋寇兰. 知识驱动的人机主动对话管理策略[J]. 北京邮电大学学报, 2022, 45(5): 109-114.
[5]	刘金桐, 杨国兴, 刘晓鸿, 王光宇. 针对心电图分类模型的平滑攻击算法[J]. 北京邮电大学学报, 2022, 45(4): 44-50.
[6]	黄柳婷, 刘可欣, 牛凯, 常春, 贺志强. 基于深度学习的哮喘患者CT影像黏液栓自动识别[J]. 北京邮电大学学报, 2022, 45(4): 58-63.
[7]	柳长源, 虎浩媛, 毕晓君. 双线性融合网络的驾驶员分心行为识别[J]. 北京邮电大学学报, 2022, 45(2): 79-84.
[8]	赵海英, 朱会, 侯小刚. 基于改进EMA单元的传统服饰图像语义分割[J]. 北京邮电大学学报, 2022, 45(1): 69-74.
[9]	张滨宇, 赵衍运, 杜昀昊, 万俊峰, 佟知航. 一种基于深度学习的PCB图像字符检测方法[J]. 北京邮电大学学报, 2022, 45(1): 108-114.
[10]	贾珺, 冯春燕, 夏海轮, 张天魁, 李成钢. 基于样本均衡与特征交互的通信网络故障预测方法[J]. 北京邮电大学学报, 2021, 44(6): 59-66.
[11]	普运伟, 郭江, 刘涛涛, 吴海潇. 基于多学习单元卷积神经网络的雷达辐射源信号识别[J]. 北京邮电大学学报, 2021, 44(6): 74-82.
[12]	王艺霏, 莫爽, 吴文睿, 范少华, 肖丁. 基于内外卷积网络的网络入侵检测[J]. 北京邮电大学学报, 2021, 44(5): 94-100.
[13]	高慧, 张继威, 来扬, 王文东. 深度学习的人体图像半自动标注系统[J]. 北京邮电大学学报, 2021, 44(1): 104-109.
[14]	蒲悦逸, 王文涵, 朱强, 陈朋朋. 基于CNN-ResNet-LSTM模型的城市短时交通流量预测算法[J]. 北京邮电大学学报, 2020, 43(5): 9-14.
[15]	马向亮, 李冰, 杨丹, 黄克振, 段晓毅. 基于深度学习的类SM4算法S盒逆向分析[J]. 北京邮电大学学报, 2020, 43(5): 118-124.