论文标题

地球学,非线性和新颖档案搜索档案

Geodesics, Non-linearities and the Archive of Novelty Search

论文作者

Salehi, Achkan, Coninx, Alexandre, Doncieux, Stephane

论文摘要

十多年前提出了新颖的搜索(NS)算法。但是,其经验成功背后的机制仍未被正式化/理解。此简短说明着重于档案对勘探的影响。来自一些应用领域的实验证据表明,基于存档的NS通常比仅针对人群计算的新颖性更好。文献中经常遇到的一个论点是,档案馆阻止了探索回溯或骑自行车,即无法重新访问先前遇到的行为空间中的区域。我们认为,这不是一个完整或准确的解释,因为档案实际上可以启用回溯(通常是理想的)。通过低维/分析示例,我们表明该档案的关键效果是,它抵消了探索偏见,而除其他因素外,由于使用不充分的行为指标和行为映射的非线性性。我们的观察似乎暗示,将更为积极的作用归因于档案中的采样可能是有益的。

The Novelty Search (NS) algorithm was proposed more than a decade ago. However, the mechanisms behind its empirical success are still not well formalized/understood. This short note focuses on the effects of the archive on exploration. Experimental evidence from a few application domains suggests that archive-based NS performs in general better than when Novelty is solely computed with respect to the population. An argument that is often encountered in the literature is that the archive prevents exploration from backtracking or cycling, i.e. from revisiting previously encountered areas in the behavior space. We argue that this is not a complete or accurate explanation as backtracking - beside often being desirable - can actually be enabled by the archive. Through low-dimensional/analytical examples, we show that a key effect of the archive is that it counterbalances the exploration biases that result, among other factors, from the use of inadequate behavior metrics and the non-linearities of the behavior mapping. Our observations seem to hint that attributing a more active role to the archive in sampling can be beneficial.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源