论文标题
分散的联合学习:基本面,最新技术,框架,趋势和挑战
Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challenges
论文作者
论文摘要
近年来,联邦学习(FL)在培训协作模型中获得了相关性,而无需共享敏感数据。自出生以来,集中式佛罗里达州(CFL)一直是文献中最常见的方法,其中中央实体创建了全球模型。但是,一种集中式的方法导致由于瓶颈,对系统故障的脆弱性的增加以及影响负责全球模型创建的实体的可信赖性问题而导致潜伏期的增加。通过促进分散的模型聚合并最大程度地减少对集中式体系结构的依赖,出现了分散的联合学习(DFL),以解决这些问题。但是,尽管在DFL中完成了工作,但文献尚未研究(i)区分DFL和CFL的主要方面。 (ii)分析了DFL框架以创建和评估新解决方案; (iii)使用DFL审查了应用程序方案。因此,本文根据联邦体系结构,拓扑,通信机制,安全方法和关键绩效指标来确定和分析DFL的主要基础。此外,手头的论文探讨了现有的机制,以优化关键的DFL基本面。然后,对当前DFL框架的最相关功能进行了审查和比较。之后,它分析了最常用的DFL应用程序方案,并根据先前定义的基本原理和框架识别解决方案。最后,研究了现有的DFL解决方案的演变,以提供趋势,经验教训和开放挑战的清单。
In recent years, Federated Learning (FL) has gained relevance in training collaborative models without sharing sensitive data. Since its birth, Centralized FL (CFL) has been the most common approach in the literature, where a central entity creates a global model. However, a centralized approach leads to increased latency due to bottlenecks, heightened vulnerability to system failures, and trustworthiness concerns affecting the entity responsible for the global model creation. Decentralized Federated Learning (DFL) emerged to address these concerns by promoting decentralized model aggregation and minimizing reliance on centralized architectures. However, despite the work done in DFL, the literature has not (i) studied the main aspects differentiating DFL and CFL; (ii) analyzed DFL frameworks to create and evaluate new solutions; and (iii) reviewed application scenarios using DFL. Thus, this article identifies and analyzes the main fundamentals of DFL in terms of federation architectures, topologies, communication mechanisms, security approaches, and key performance indicators. Additionally, the paper at hand explores existing mechanisms to optimize critical DFL fundamentals. Then, the most relevant features of the current DFL frameworks are reviewed and compared. After that, it analyzes the most used DFL application scenarios, identifying solutions based on the fundamentals and frameworks previously defined. Finally, the evolution of existing DFL solutions is studied to provide a list of trends, lessons learned, and open challenges.