论文标题
通过双网络在顺序推荐中删除过去的未来建模
Disentangling Past-Future Modeling in Sequential Recommendation via Dual Networks
论文作者
论文摘要
顺序推荐(SR)在个性化推荐系统中起着重要的作用,因为它捕获了用户实时增加行为的动态和多样化的偏好。与标准的自回旋培训策略不同,未来数据(在培训期间也可以使用)用于促进模型培训,因为它提供了有关用户当前兴趣的更丰富的信号,并且可用于提高建议质量。但是,这些方法遭受了严重的训练差距,即过去和将来的环境在训练时由同一编码器建模,而在推断期间只有历史行为。这种差异导致潜在的性能降解。为了减轻训练推动差距,我们提出了一个新的框架Dualrec,该框架通过新颖的双网络实现了过去的未发现和过去的相互增强。具体而言,双重网络结构被利用以分别对过去和未来上下文进行建模。双向知识转移机制增强了双网络所学的知识。在四个现实世界数据集上进行的广泛实验证明了我们的方法优于基线方法。此外,我们通过使用RNN,Transformer和Filter-MLP作为骨架来实例化DualRec的兼容性。进一步的经验分析验证了在我们的DualRec框架下对未来环境进行建模的高度效用。 DualRec代码可在https://github.com/zhy99426/dualrec上公开获得。
Sequential recommendation (SR) plays an important role in personalized recommender systems because it captures dynamic and diverse preferences from users' real-time increasing behaviors. Unlike the standard autoregressive training strategy, future data (also available during training) has been used to facilitate model training as it provides richer signals about user's current interests and can be used to improve the recommendation quality. However, these methods suffer from a severe training-inference gap, i.e., both past and future contexts are modeled by the same encoder when training, while only historical behaviors are available during inference. This discrepancy leads to potential performance degradation. To alleviate the training-inference gap, we propose a new framework DualRec, which achieves past-future disentanglement and past-future mutual enhancement by a novel dual network. Specifically, a dual network structure is exploited to model the past and future context separately. And a bi-directional knowledge transferring mechanism enhances the knowledge learnt by the dual network. Extensive experiments on four real-world datasets demonstrate the superiority of our approach over baseline methods. Besides, we demonstrate the compatibility of DualRec by instantiating using RNN, Transformer, and filter-MLP as backbones. Further empirical analysis verifies the high utility of modeling future contexts under our DualRec framework. The code of DualRec is publicly available at https://github.com/zhy99426/DualRec.