论文标题
用于人群计数的混合图神经网络
Hybrid Graph Neural Networks for Crowd Counting
论文作者
论文摘要
由于大规模和密度变化,人群计数是一项重要但具有挑战性的任务。最近的调查表明,将多尺度特征之间的丰富关系提炼出来,并利用辅助任务(即本地化)中的有用信息对于此任务至关重要。然而,如何在统一的网络体系结构中全面利用这些关系仍然是一个具有挑战性的问题。在本文中,我们提出了一种称为Hybrid Graph神经网络(HYGNN)的新型网络结构,该结构的目标是通过编织人群密度及其辅助任务(本地化)的多尺度特征来缓解问题,并将关节推理在一起。具体而言,HYGNN集成了混合图以共同表示不同量表的特定特征图作为节点,而两种类型的关系为边缘:(i)用于捕获跨量表的特征依赖关系的多尺度关系,并且(ii)相互益处建立了计数与位置之间的合作关系。因此,通过消息传递,HYGNN可以在节点之间提炼丰富的关系以获得更强大的表示形式,从而导致稳健而准确的结果。我们的HYGNN在四个具有挑战性的数据集上表现出色:A Shanghaitech A Part,Shanghaitech B部分,UCF_CC_50和UCF_QNRF,优于最先进的方法。
Crowd counting is an important yet challenging task due to the large scale and density variation. Recent investigations have shown that distilling rich relations among multi-scale features and exploiting useful information from the auxiliary task, i.e., localization, are vital for this task. Nevertheless, how to comprehensively leverage these relations within a unified network architecture is still a challenging problem. In this paper, we present a novel network structure called Hybrid Graph Neural Network (HyGnn) which targets to relieve the problem by interweaving the multi-scale features for crowd density as well as its auxiliary task (localization) together and performing joint reasoning over a graph. Specifically, HyGnn integrates a hybrid graph to jointly represent the task-specific feature maps of different scales as nodes, and two types of relations as edges:(i) multi-scale relations for capturing the feature dependencies across scales and (ii) mutual beneficial relations building bridges for the cooperation between counting and localization. Thus, through message passing, HyGnn can distill rich relations between the nodes to obtain more powerful representations, leading to robust and accurate results. Our HyGnn performs significantly well on four challenging datasets: ShanghaiTech Part A, ShanghaiTech Part B, UCF_CC_50 and UCF_QNRF, outperforming the state-of-the-art approaches by a large margin.