论文标题

与挥发性客户的联合学习的随机客户选择

Stochastic Client Selection for Federated Learning with Volatile Clients

论文作者

Huang, Tiansheng, Lin, Weiwei, Shen, Li, Li, Keqin, Zomaya, Albert Y.

论文摘要

作为保护隐私的机器学习范式而产生的联合学习(FL)已受到公众的显着关注。在每一轮同步FL培训中,只有一小部分可用的客户参与,而选择决策可能会对培训效率以及最终模型性能产生重大影响。在本文中,我们在动荡的环境下研究了客户选择问题,在这种情况下,由于各种原因和不同级别的频率,异质客户的本地培训可能会失败。 {\ color {black}凭直觉,过多的训练失败可能会降低训练效率,而对稳定性更高的客户的选择过多可能会引起偏见,从而导致培训效力的退化。为了解决这一权衡,我们在本文中,在共同考虑有效参与和公平的共同考虑下制定了客户选择问题。}此外,我们提出了E3CS,这是一种随机客户选择方案,以解决该问题,并通过进行实际数据基于数据的实验来证实其有效性。根据我们的实验结果,与最先进的选择方案相比,提出的选择方案能够达到更快地收敛到固定模型精度的2倍,同时保持相同水平的最终模型精度。

Federated Learning (FL), arising as a privacy-preserving machine learning paradigm, has received notable attention from the public. In each round of synchronous FL training, only a fraction of available clients are chosen to participate, and the selection decision might have a significant effect on the training efficiency, as well as the final model performance. In this paper, we investigate the client selection problem under a volatile context, in which the local training of heterogeneous clients is likely to fail due to various kinds of reasons and in different levels of frequency. {\color{black}Intuitively, too much training failure might potentially reduce the training efficiency, while too much selection on clients with greater stability might introduce bias, thereby resulting in degradation of the training effectiveness. To tackle this tradeoff, we in this paper formulate the client selection problem under joint consideration of effective participation and fairness.} Further, we propose E3CS, a stochastic client selection scheme to solve the problem, and we corroborate its effectiveness by conducting real data-based experiments. According to our experimental results, the proposed selection scheme is able to achieve up to 2x faster convergence to a fixed model accuracy while maintaining the same level of final model accuracy, compared with the state-of-the-art selection schemes.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源