论文标题
利用神经疗法的纳米线网络中的自适应动力进行转移学习
Harnessing adaptive dynamics in neuro-memristive nanowire networks for transfer learning
论文作者
论文摘要
纳米线网络(NWNS)代表了用于神经形态信息处理的独特硬件平台。除了在其交叉点连接处表现出类似突触的电阻开关记忆外,它们的自组装还赋予了电路的神经网络样拓扑,这是通过常规的自上而下的制造方法无法实现的。除了其低功率要求,成本效益和有效的互连外,神经形态NWN还具有容忍性和自我修复。这些高度吸引人的属性可以主要归因于其复杂的网络连接,从而使自适应非线性动力学的丰富曲目(包括Chaos的关键性)。在这里,我们展示了如何利用神经形态NWN固有的自适应动力学来实现转移学习。我们通过对储层计算实现的模拟来证明这一点,其中NWNS执行了Mackey-Glass(MG)信号预测的众所周知的基准测试任务。首先,我们展示了NWN如何使用任意程度的不可预测性(即混乱)预测MG信号。然后,我们表明,在没有MG信号的情况下,预测在预测中的NWN在预测中的表现更好。这种类型的转移学习是通过网络对先前状态的集体记忆来启用的。总体而言,它们的自适应信号处理能力使神经形态NWN有望在远处,特别是在IoT设备中新兴的实时应用程序的候选人。
Nanowire networks (NWNs) represent a unique hardware platform for neuromorphic information processing. In addition to exhibiting synapse-like resistive switching memory at their cross-point junctions, their self-assembly confers a neural network-like topology to their electrical circuitry, something that is impossible to achieve through conventional top-down fabrication approaches. In addition to their low power requirements, cost effectiveness and efficient interconnects, neuromorphic NWNs are also fault-tolerant and self-healing. These highly attractive properties can be largely attributed to their complex network connectivity, which enables a rich repertoire of adaptive nonlinear dynamics, including edge-of-chaos criticality. Here, we show how the adaptive dynamics intrinsic to neuromorphic NWNs can be harnessed to achieve transfer learning. We demonstrate this through simulations of a reservoir computing implementation in which NWNs perform the well-known benchmarking task of Mackey-Glass (MG) signal forecasting. First we show how NWNs can predict MG signals with arbitrary degrees of unpredictability (i.e. chaos). We then show that NWNs pre-exposed to a MG signal perform better in forecasting than NWNs without prior experience of an MG signal. This type of transfer learning is enabled by the network's collective memory of previous states. Overall, their adaptive signal processing capabilities make neuromorphic NWNs promising candidates for emerging real-time applications in IoT devices in particular, at the far edge.