论文标题
通过频谱分配优化和设备选择增强联合学习
Enhancing Federated Learning with spectrum allocation optimization and device selection
论文作者
论文摘要
机器学习(ML)是为移动设备和应用程序提供自定义服务的广泛接受手段。联合学习(FL)是实施机器学习的一种有前途的方法,同时解决数据隐私问题,通常涉及大量无线移动设备来收集模型培训数据。在这种情况下,面对有限的资源,例如对无线带宽,功耗和参与设备的计算限制,FL有望满足严格的培训潜伏要求。由于实际的考虑,FL选择了一部分设备来参与每次迭代的模型培训过程。因此,有效的资源管理和设备选择的任务将对FL的实际用途产生重大影响。在本文中,我们提出了一种通过无线移动网络增强FL的频谱分配优化机制。具体而言,提议的频谱分配优化机制可以最大程度地延迟FL的时间延迟,同时考虑各个参与设备的能源消耗。因此,确保所有参与的设备都有足够的资源来培训其本地模型。在这方面,为了确保FL的快速收敛,还提出了鲁棒的设备选择,以帮助FL迅速融合,尤其是当设备的本地数据集不是独立且分布相同的(非IID)时。实验结果表明,(1)提出的频谱分配优化方法优化了时间延迟,同时满足各个能量限制; (2)提出的设备选择方法使FL能够在非IID数据集上实现最快的收敛性。
Machine learning (ML) is a widely accepted means for supporting customized services for mobile devices and applications. Federated Learning (FL), which is a promising approach to implement machine learning while addressing data privacy concerns, typically involves a large number of wireless mobile devices to collect model training data. Under such circumstances, FL is expected to meet stringent training latency requirements in the face of limited resources such as demand for wireless bandwidth, power consumption, and computation constraints of participating devices. Due to practical considerations, FL selects a portion of devices to participate in the model training process at each iteration. Therefore, the tasks of efficient resource management and device selection will have a significant impact on the practical uses of FL. In this paper, we propose a spectrum allocation optimization mechanism for enhancing FL over a wireless mobile network. Specifically, the proposed spectrum allocation optimization mechanism minimizes the time delay of FL while considering the energy consumption of individual participating devices; thus ensuring that all the participating devices have sufficient resources to train their local models. In this connection, to ensure fast convergence of FL, a robust device selection is also proposed to help FL reach convergence swiftly, especially when the local datasets of the devices are not independent and identically distributed (non-iid). Experimental results show that (1) the proposed spectrum allocation optimization method optimizes time delay while satisfying the individual energy constraints; (2) the proposed device selection method enables FL to achieve the fastest convergence on non-iid datasets.