论文标题
组成性感知图2SEQ学习
Compositionality-Aware Graph2Seq Learning
论文作者
论文摘要
图是一种高度表达的数据结构,但是人类通常很难从复杂的图中找到模式。因此,从图中产生人解剖序列引起了人们的兴趣,称为Graph2Seq学习。可以预期,图中的组分性可以与许多Graph2Seq任务中的输出序列中的组成性相关联。因此,应用组合性意识的GNN体系结构将改善模型性能。在这项研究中,我们采用了多层次注意集合(MLAP)体系结构,这些架构可以从多个级别的信息局部汇总图形表示。作为现实世界的示例,我们采用了极端的源代码摘要任务,其中模型从其源代码估算了程序函数的名称。我们证明,具有MLAP体系结构的模型优于先前的最新模型,其参数少于七倍以上。
Graphs are a highly expressive data structure, but it is often difficult for humans to find patterns from a complex graph. Hence, generating human-interpretable sequences from graphs have gained interest, called graph2seq learning. It is expected that the compositionality in a graph can be associated to the compositionality in the output sequence in many graph2seq tasks. Therefore, applying compositionality-aware GNN architecture would improve the model performance. In this study, we adopt the multi-level attention pooling (MLAP) architecture, that can aggregate graph representations from multiple levels of information localities. As a real-world example, we take up the extreme source code summarization task, where a model estimate the name of a program function from its source code. We demonstrate that the model having the MLAP architecture outperform the previous state-of-the-art model with more than seven times fewer parameters than it.