论文标题

编码弹性计算中的异构计算分配

Heterogeneous Computation Assignments in Coded Elastic Computing

论文作者

Woolsey, Nicholas, Chen, Rong-Rong, Ji, Mingyue

论文摘要

我们研究了异质编码的弹性计算(CEC)网络的最佳设计,其中机器具有不同的相对计算速度。 Yang {\ it等人}引入的CEC是一个框架,可减轻机器连接并离开网络的弹性事件的影响。使用最大距离可分离(MDS)代码在存储约束机器之间分布一组数据,以使特定尺寸的任何子集都可以执行所需的计算。该设计消除了每个弹性事件后重新分发数据的需求。在这项工作中,我们开发了一个任意异质计算网络的过程,以通过定义最佳计算负载或分配给每台计算机的计算数量来最大程度地减少整体计算时间。然后,我们提出了一种算法来定义使用MDS代码并满足最佳计算负载的计算机之间的特定计算分配。

We study the optimal design of a heterogeneous coded elastic computing (CEC) network where machines have varying relative computation speeds. CEC introduced by Yang {\it et al.} is a framework which mitigates the impact of elastic events, where machines join and leave the network. A set of data is distributed among storage constrained machines using a Maximum Distance Separable (MDS) code such that any subset of machines of a specific size can perform the desired computations. This design eliminates the need to re-distribute the data after each elastic event. In this work, we develop a process for an arbitrary heterogeneous computing network to minimize the overall computation time by defining an optimal computation load, or number of computations assigned to each machine. We then present an algorithm to define a specific computation assignment among the machines that makes use of the MDS code and meets the optimal computation load.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源