论文标题

通过网络分析检测虚假信息活动活动

On the Detection of Disinformation Campaign Activity with Network Analysis

论文作者

Vargas, Luis, Emami, Patrick, Traynor, Patrick

论文摘要

近年来,随着国家赞助的虚假信息运动试图通过大规模的协调努力来影响和两极分化政治话题,对信息的在线操纵变得越来越普遍。在此过程中,这些努力留下了文物,研究人员利用这些努力来分析被击倒后的虚假信息运动所采用的策略。事实证明,协调网络分析有助于了解虚假信息运动的运作方式;但是,这些法医工具作为检测机制的有用性仍然是一个悬而未决的问题。在本文中,我们探讨了使用协调网络分析来生成以区分虚假信息活动与合法Twitter活动的活动的功能。这样做将为人类分析师考虑撤下更多的证据。我们为Twitter虚假广告活动和合法的Twitter社区创建了一个时间序列的每日协调网络,并根据这些网络提取的统计功能培训二进制分类器。我们的结果表明,分类器可以以很高的精度预测已知虚假信息运动的未来协调活动(F1 = 0.98)。在分布外活动分类的更具挑战性的任务上,性能下降仍然有望(F1 = 0.71),这主要是由于假阳性率的提高。通过进行此分析,我们表明,虽然协调模式对于提供虚假活动活动的证据可能很有用,但仍需要进一步研究以在大规模部署之前对此方法进行改进。

Online manipulation of information has become more prevalent in recent years as state-sponsored disinformation campaigns seek to influence and polarize political topics through massive coordinated efforts. In the process, these efforts leave behind artifacts, which researchers have leveraged to analyze the tactics employed by disinformation campaigns after they are taken down. Coordination network analysis has proven helpful for learning about how disinformation campaigns operate; however, the usefulness of these forensic tools as a detection mechanism is still an open question. In this paper, we explore the use of coordination network analysis to generate features for distinguishing the activity of a disinformation campaign from legitimate Twitter activity. Doing so would provide more evidence to human analysts as they consider takedowns. We create a time series of daily coordination networks for both Twitter disinformation campaigns and legitimate Twitter communities, and train a binary classifier based on statistical features extracted from these networks. Our results show that the classifier can predict future coordinated activity of known disinformation campaigns with high accuracy (F1 = 0.98). On the more challenging task of out-of-distribution activity classification, the performance drops yet is still promising (F1 = 0.71), mainly due to an increase in the false positive rate. By doing this analysis, we show that while coordination patterns could be useful for providing evidence of disinformation activity, further investigation is needed to improve upon this method before deployment at scale.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源