论文标题
使用以自我为中心视频的颈椎损伤后,在家中测量手用途
Measuring hand use in the home after cervical spinal cord injury using egocentric video
论文作者
论文摘要
背景:以自我为中心的视频已成为监测社区中四肢瘫痪者的手部功能的潜在解决方案,尤其是因为它能够在家庭环境中检测功能使用。目的:开发和验证一个基于可穿戴视力的系统,以测量四肢瘫痪的人的家庭使用。方法:开发并比较了几种用于检测功能手动相互作用的深度学习算法。最准确的算法用于从20位参与者在四个参与者中记录的65小时的无脚本视频中提取手部功能的度量。这些措施是:总记录时间(PERC)的交互时间百分比;单个相互作用的平均持续时间(DUR);每小时相互作用的数量(NUM)。为了证明技术的临床有效性,以验证的措施与经过验证的手部功能和独立性的临床评估相关(逐渐定义了强度,敏感性和预性的评估 - GrassP,上肢运动评分 - UEM- UEM和脊髓独立措施 - SICIM)。结果:手动相互作用以0.80(0.67-0.87)的中位数得分自动检测到手动相互作用。我们的结果表明,更高的UEM和更好的预性与所花费的时间更长有关,而较高的cim和更好的手动感觉会导致在以egentric中心的视频记录期间进行的更多相互作用。结论:第一次,在四肢瘫痪者中自动估计的手部功能的测量已通过国际接受的手部功能衡量标准进行了验证。未来的工作将需要对基于以以中心为中心的手工使用的绩效指标的可靠性和响应能力进行正式评估。
Background: Egocentric video has recently emerged as a potential solution for monitoring hand function in individuals living with tetraplegia in the community, especially for its ability to detect functional use in the home environment. Objective: To develop and validate a wearable vision-based system for measuring hand use in the home among individuals living with tetraplegia. Methods: Several deep learning algorithms for detecting functional hand-object interactions were developed and compared. The most accurate algorithm was used to extract measures of hand function from 65 hours of unscripted video recorded at home by 20 participants with tetraplegia. These measures were: the percentage of interaction time over total recording time (Perc); the average duration of individual interactions (Dur); the number of interactions per hour (Num). To demonstrate the clinical validity of the technology, egocentric measures were correlated with validated clinical assessments of hand function and independence (Graded Redefined Assessment of Strength, Sensibility and Prehension - GRASSP, Upper Extremity Motor Score - UEMS, and Spinal Cord Independent Measure - SCIM). Results: Hand-object interactions were automatically detected with a median F1-score of 0.80 (0.67-0.87). Our results demonstrated that higher UEMS and better prehension were related to greater time spent interacting, whereas higher SCIM and better hand sensation resulted in a higher number of interactions performed during the egocentric video recordings. Conclusions: For the first time, measures of hand function automatically estimated in an unconstrained environment in individuals with tetraplegia have been validated against internationally accepted measures of hand function. Future work will necessitate a formal evaluation of the reliability and responsiveness of the egocentric-based performance measures for hand use.