论文标题
大脑过度的大脑:梦想进化以协助概括
The Overfitted Brain: Dreams evolved to assist generalization
论文作者
论文摘要
在过去的十年中,对睡眠进化的生物学功能的理解已经大大发展。但是,没有出现对梦的同等理解。当代的神经科学理论通常将梦视为表皮瘤,而少数关于其生物学功能的建议与梦想本身的现象学相矛盾。现在,最近深层神经网络(DNNS)的出现终于提供了一个新颖的概念框架,以了解梦想的发展功能。值得注意的是,所有DNN都面临着过度拟合的问题,即当一个数据集的性能增加但网络的性能未能概括时(通常是通过培训对培训与测试数据集的性能的分歧来衡量的)。建模者通常以嘈杂或损坏的输入形式通过“噪声注射”来解决DNN中无处不在的问题。本文的目的是争辩说,大脑面临类似的过度拟合挑战,而夜间梦则进化为与大脑在日常学习中的过度拟合作斗争。也就是说,梦想是一种生物学机制,可以通过创建神经结构层次结构的随机活动的损坏的感觉投入来提高普遍性。睡眠损失,尤其是梦想中的损失,导致大脑过多,仍然可以记住和学习,但无法适当地概括。在此,这种“过度拟合的大脑假说”是明确开发的,然后与现有的当代神经科学理论进行了比较。在神经科学和深度学习中都调查了该假设的现有证据,并提出了一组可测试的预测,可以在体内和计算机中进行。
Understanding of the evolved biological function of sleep has advanced considerably in the past decade. However, no equivalent understanding of dreams has emerged. Contemporary neuroscientific theories generally view dreams as epiphenomena, and the few proposals for their biological function are contradicted by the phenomenology of dreams themselves. Now, the recent advent of deep neural networks (DNNs) has finally provided the novel conceptual framework within which to understand the evolved function of dreams. Notably, all DNNs face the issue of overfitting as they learn, which is when performance on one data set increases but the network's performance fails to generalize (often measured by the divergence of performance on training vs. testing data sets). This ubiquitous problem in DNNs is often solved by modelers via "noise injections" in the form of noisy or corrupted inputs. The goal of this paper is to argue that the brain faces a similar challenge of overfitting, and that nightly dreams evolved to combat the brain's overfitting during its daily learning. That is, dreams are a biological mechanism for increasing generalizability via the creation of corrupted sensory inputs from stochastic activity across the hierarchy of neural structures. Sleep loss, specifically dream loss, leads to an overfitted brain that can still memorize and learn but fails to generalize appropriately. Herein this "overfitted brain hypothesis" is explicitly developed and then compared and contrasted with existing contemporary neuroscientific theories of dreams. Existing evidence for the hypothesis is surveyed within both neuroscience and deep learning, and a set of testable predictions are put forward that can be pursued both in vivo and in silico.