论文标题

基于学习的基于学习的进攻语义审查制度的聊天机器人

A Reinforcement Learning-based Offensive semantics Censorship System for Chatbots

论文作者

Cai, Shaokang, Han, Dezhi, Zheng, Zibin, Li, Dun, NoelCrespi

论文摘要

人工智能(AI)技术的快速发展使大规模的AI应用程序能够降落在市场和实践中。但是,尽管AI技术在生产过程中为人们带来了许多便利,但它也暴露了许多安全问题。特别是,聊天机器人的在线学习漏洞的攻击经常发生。因此,本文提出了基于强化学习的语义审查聊天机器人系统,该系统主要由两个部分组成:进攻语义审查模型和语义纯化模型。进攻语义审查可以结合用户输入句子的背景,以检测进攻语义的快速发展并响应进攻语义的响应。聊天机器人模型的语义净化模型,通过加强学习算法所学到的进攻性答复,而不是回到早期版本中,从而受到大量进攻语义的污染。此外,通过整合曾经直通的学习方法,语义净化的速度得到了加速,同时降低了对答复质量的影响。实验结果表明,我们提出的方法降低了聊天模型产生进攻性答复的可能性,并且少数图学习算法的集成迅速提高了训练速度,同时有效地降低了BLEU值的下降。

The rapid development of artificial intelligence (AI) technology has enabled large-scale AI applications to land in the market and practice. However, while AI technology has brought many conveniences to people in the productization process, it has also exposed many security issues. Especially, attacks against online learning vulnerabilities of chatbots occur frequently. Therefore, this paper proposes a semantics censorship chatbot system based on reinforcement learning, which is mainly composed of two parts: the Offensive semantics censorship model and the semantics purification model. Offensive semantics review can combine the context of user input sentences to detect the rapid evolution of Offensive semantics and respond to Offensive semantics responses. The semantics purification model For the case of chatting robot models, it has been contaminated by large numbers of offensive semantics, by strengthening the offensive reply learned by the learning algorithm, rather than rolling back to the early versions. In addition, by integrating a once-through learning approach, the speed of semantics purification is accelerated while reducing the impact on the quality of replies. The experimental results show that our proposed approach reduces the probability of the chat model generating offensive replies and that the integration of the few-shot learning algorithm improves the training speed rapidly while effectively slowing down the decline in BLEU values.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源