论文标题
用于SSVEP分类的基于变压器的深神网络模型
A Transformer-based deep neural network model for SSVEP classification
论文作者
论文摘要
稳态视觉诱发电位(SSVEP)是脑部计算机界面(BCI)系统中最常用的控制信号之一。但是,SSVEP分类的常规空间滤波方法高度取决于主体特定的校准数据。需要减轻对校准数据需求的方法的需求变得紧迫。近年来,开发可以在受试者间分类方案中起作用的方法已成为一个有希望的新方向。作为当今流行的深度学习模型,变形金刚具有出色的性能,并已用于脑电信号分类任务。因此,在这项研究中,我们提出了一个基于变压器结构的SSVEP分类的深度学习模型,该模型被称为SSVEPFormer,这是变压器在SSVEP分类中的第一个应用。受到先前研究的启发,该模型采用了SSVEP数据的频谱作为输入,并探讨了用于分类的光谱和空间域信息。此外,为了充分利用谐波信息,提出了基于过滤器库技术(FB-SSVEPFormer)的扩展SSVEPFormer,以进一步改善分类性能。使用两个开放数据集(数据集1:10,12级任务;数据集2:35主题,40级任务)进行了实验。实验结果表明,与其他基线方法相比,提出的模型可以在分类准确性和信息传输速率方面获得更好的结果。提出的模型验证了基于变压器结构的SSVEP分类任务的深度学习模型的可行性,并可以作为减轻基于SSVEP的BCI系统的实际应用中的校准程序的潜在模型。
Steady-state visual evoked potential (SSVEP) is one of the most commonly used control signal in the brain-computer interface (BCI) systems. However, the conventional spatial filtering methods for SSVEP classification highly depend on the subject-specific calibration data. The need for the methods that can alleviate the demand for the calibration data become urgent. In recent years, developing the methods that can work in inter-subject classification scenario has become a promising new direction. As the popular deep learning model nowadays, Transformer has excellent performance and has been used in EEG signal classification tasks. Therefore, in this study, we propose a deep learning model for SSVEP classification based on Transformer structure in inter-subject classification scenario, termed as SSVEPformer, which is the first application of the transformer to the classification of SSVEP. Inspired by previous studies, the model adopts the frequency spectrum of SSVEP data as input, and explores the spectral and spatial domain information for classification. Furthermore, to fully utilize the harmonic information, an extended SSVEPformer based on the filter bank technology (FB-SSVEPformer) is proposed to further improve the classification performance. Experiments were conducted using two open datasets (Dataset 1: 10 subjects, 12-class task; Dataset 2: 35 subjects, 40-class task) in the inter-subject classification scenario. The experimental results show that the proposed models could achieve better results in terms of classification accuracy and information transfer rate, compared with other baseline methods. The proposed model validates the feasibility of deep learning models based on Transformer structure for SSVEP classification task, and could serve as a potential model to alleviate the calibration procedure in the practical application of SSVEP-based BCI systems.