论文标题
步态:通过有效的基于条带的特征表示和多层框架的步态识别
GaitStrip: Gait Recognition via Effective Strip-based Feature Representations and Multi-Level Framework
论文作者
论文摘要
许多步态识别方法将人体步态置于N部分,然后将它们组合起来以建立基于部分的特征表示。他们的步态识别性能通常会受到分区策略的影响,这些策略是在不同数据集中经验选择的。但是,我们观察到,作为零件的基本组成部分,条形与不同的分区策略不可知。在这一观察结果的推动下,我们提出了一个基于条带的多层步态识别网络,名为Gaitstrip,以在不同级别提取全面的步态信息。具体来说,我们的高级分支探讨了步态序列的上下文,而我们的低级分支则专注于详细的姿势变化。我们介绍了一种基于带状的新型特征提取器(SPB),以直接将人体的每个条带作为基本单元,以学习基于剥离的特征表示。此外,我们提出了一种新型的多分支结构,称为增强的卷积模块(ECM),以提取步态的不同表示。 ECM由时空特征提取器(ST),帧级特征提取器(FL)和SPB组成,并且具有两个明显的优势:首先,每个分支都集中在特定的表示上,可用于改善网络的鲁棒性。具体而言,ST旨在提取步态序列的时空特征,而FL用于生成每个帧的特征表示。其次,通过引入结构重新参数化技术,可以在测试中降低ECM的参数。广泛的实验结果表明,我们的步条在正常的步行和复杂条件下都能达到最先进的表现。
Many gait recognition methods first partition the human gait into N-parts and then combine them to establish part-based feature representations. Their gait recognition performance is often affected by partitioning strategies, which are empirically chosen in different datasets. However, we observe that strips as the basic component of parts are agnostic against different partitioning strategies. Motivated by this observation, we present a strip-based multi-level gait recognition network, named GaitStrip, to extract comprehensive gait information at different levels. To be specific, our high-level branch explores the context of gait sequences and our low-level one focuses on detailed posture changes. We introduce a novel StriP-Based feature extractor (SPB) to learn the strip-based feature representations by directly taking each strip of the human body as the basic unit. Moreover, we propose a novel multi-branch structure, called Enhanced Convolution Module (ECM), to extract different representations of gaits. ECM consists of the Spatial-Temporal feature extractor (ST), the Frame-Level feature extractor (FL) and SPB, and has two obvious advantages: First, each branch focuses on a specific representation, which can be used to improve the robustness of the network. Specifically, ST aims to extract spatial-temporal features of gait sequences, while FL is used to generate the feature representation of each frame. Second, the parameters of the ECM can be reduced in test by introducing a structural re-parameterization technique. Extensive experimental results demonstrate that our GaitStrip achieves state-of-the-art performance in both normal walking and complex conditions.