论文标题
更多是不同的:原型制作和分析具有大量移动SOC的新形式的边缘服务器
More is Different: Prototyping and Analyzing a New Form of Edge Server with Massive Mobile SoCs
论文作者
论文摘要
巨大的能源消耗对边缘云构成了重大挑战。为此,我们引入了一种新型的边缘服务器,即SOC群集,该服务器通过芯片网络精心策划了多个低功率移动系统芯片(SOCS)。我们第一次开发了一个混凝土SOC群集,该集群由60个Qualcomm Snapdragon 865 SOC组成,该socs存储在2U架上,该机架已成功地商业化并广泛地部署在边缘云中。由于移动SOC和本地手机游戏之间的兼容性,云游戏是在这些已部署的SOC集群上的主要工作量而出现的。 在这项研究中,我们旨在揭开SOC群集是否可以有效地提供更普遍的典型边缘工作量。因此,我们开发了一个基准套件,该套件采用了最先进的库来实现两个关键的边缘工作负载,即视频转码和深度学习推断。该套件评估吞吐量,延迟,功耗和其他特定于应用程序的指标,例如视频质量。此后,我们进行了一项彻底的测量研究,并直接将SOC群集与传统的边缘服务器进行了比较,涉及用电和货币成本。我们的结果定量地揭示了与传统服务器相比,移动SOC何时和哪些应用显示出更高的能源效率,以及它们随着传入负载的比例扩展功耗的能力。这些结果提供了深刻的含义,并为进一步改进SOC集群提供了宝贵的方向,以促进其在更广泛的边缘方案中的部署。
Huge energy consumption poses a significant challenge for edge clouds. In response to this, we introduce a new type of edge server, namely SoC Cluster, that orchestrates multiple low-power mobile system-on-chips (SoCs) through an on-chip network. For the first time, we have developed a concrete SoC Cluster consisting of 60 Qualcomm Snapdragon 865 SoCs housed in a 2U rack, which has been successfully commercialized and extensively deployed in edge clouds. Cloud gaming emerges as the principal workload on these deployed SoC Clusters, owing to the compatibility between mobile SoCs and native mobile games. In this study, we aim to demystify whether the SoC Cluster can efficiently serve more generalized, typical edge workloads. Therefore, we developed a benchmark suite that employs state-of-the-art libraries for two critical edge workloads, i.e., video transcoding and deep learning inference. This suite evaluates throughput, latency, power consumption, and other application-specific metrics like video quality. Following this, we conducted a thorough measurement study and directly compared the SoC Cluster with traditional edge servers, with regards to electricity usage and monetary cost. Our results quantitatively reveal when and for which applications mobile SoCs exhibit higher energy efficiency than traditional servers, as well as their ability to proportionally scale power consumption with fluctuating incoming loads. These outcomes provide insightful implications and offer valuable direction for further refinement of the SoC Cluster to facilitate its deployment across wider edge scenarios.