论文标题
GTFLAT:基于游戏理论的插件,用于授权联合学习聚合技术
GTFLAT: Game Theory Based Add-On For Empowering Federated Learning Aggregation Techniques
论文作者
论文摘要
GTFLAT作为基于游戏理论的附加组件,解决了一个重要的研究问题:联合学习算法如何通过设置更有效的适应性权重以平均模型聚合阶段来实现更好的性能和训练效率?回答问题的理想方法的主要目标是:(1)授权联邦学习算法能够在更少的沟通回合中达到更好的性能,尤其是面对异构的场景,而最后但并非最不重要的一点,(2)易于与最先进的联邦学习算法一起作为新的模块作为新的模块。为此,GTFLAT将平均任务建模为活跃用户中的战略游戏。然后,它提出了基于人口游戏和进化动力学的系统解决方案,以找到平衡。与现有的方法对参与者的权重相反,GTFLAT结束了客户之间的自我执行协议,以使他们都没有动机分别偏离它。结果表明,使用GTFLAT平均而言,将TOP-1测试的准确性提高了1.38%,而沟通回合的次数则需要21.06%才能达到准确性。
GTFLAT, as a game theory-based add-on, addresses an important research question: How can a federated learning algorithm achieve better performance and training efficiency by setting more effective adaptive weights for averaging in the model aggregation phase? The main objectives for the ideal method of answering the question are: (1) empowering federated learning algorithms to reach better performance in fewer communication rounds, notably in the face of heterogeneous scenarios, and last but not least, (2) being easy to use alongside the state-of-the-art federated learning algorithms as a new module. To this end, GTFLAT models the averaging task as a strategic game among active users. Then it proposes a systematic solution based on the population game and evolutionary dynamics to find the equilibrium. In contrast with existing approaches that impose the weights on the participants, GTFLAT concludes a self-enforcement agreement among clients in a way that none of them is motivated to deviate from it individually. The results reveal that, on average, using GTFLAT increases the top-1 test accuracy by 1.38%, while it needs 21.06% fewer communication rounds to reach the accuracy.