论文标题
通过无线网络的时间触发的联邦学习
Time-triggered Federated Learning over Wireless Networks
论文作者
论文摘要
新兴的联邦学习(FL)框架提供了一种新的方式来以隐私的方式培训机器学习模型。但是,传统的FL算法是基于事件触发的聚合,该聚合遭受了散乱者和沟通架空问题的困扰。为了解决这些问题,在本文中,我们在无线网络上提出了一种时间触发的FL算法(TT-FED),这是经典同步和异步FL的广义形式。考虑到无线通信的限制资源和不可靠的性质,我们共同研究用户选择和带宽优化问题,以最大程度地减少FL培训损失。为了解决这个关节优化问题,我们为TT-FED提供了彻底的收敛分析。基于获得的分析收敛上限,相对于每个全局聚合回合,优化问题被分解为可牵引的子问题,最后由我们提出的在线搜索算法解决。仿真结果表明,与异步用户层(FIDAT)基准的异步FL(FedAsync)和FL相比,我们提出的TT-FED算法将收敛的测试准确性提高了高达12.5%和5%,在高度不平衡和非平衡数据和非平衡数据中,同时大大降低了交流的交流。
The newly emerging federated learning (FL) framework offers a new way to train machine learning models in a privacy-preserving manner. However, traditional FL algorithms are based on an event-triggered aggregation, which suffers from stragglers and communication overhead issues. To address these issues, in this paper, we present a time-triggered FL algorithm (TT-Fed) over wireless networks, which is a generalized form of classic synchronous and asynchronous FL. Taking the constrained resource and unreliable nature of wireless communication into account, we jointly study the user selection and bandwidth optimization problem to minimize the FL training loss. To solve this joint optimization problem, we provide a thorough convergence analysis for TT-Fed. Based on the obtained analytical convergence upper bound, the optimization problem is decomposed into tractable sub-problems with respect to each global aggregation round, and finally solved by our proposed online search algorithm. Simulation results show that compared to asynchronous FL (FedAsync) and FL with asynchronous user tiers (FedAT) benchmarks, our proposed TT-Fed algorithm improves the converged test accuracy by up to 12.5% and 5%, respectively, under highly imbalanced and non-IID data, while substantially reducing the communication overhead.