Abstract
Rehabilitation benefits from a careful understanding of people's movements, but there are few widely used tools to facilitate this beyond a goniometer or, in special cases, a gait laboratory. Easy to use and accurate kinematic tracking would allow better characterization of patient's impairments, allow quantitatively tracking improvements in response to treatment, and support research for more effective therapies. Two rapidly evolving technologies are poised to make this more available: wearable inertial sensors and video based motion tracking, which provide complementary information. However, both present challenges ranging from ease of use to the clinical relevance of their outputs. Pose estimation frequently struggles with ambiguities from the image. Wearable sensors often require precise placement and calibration to produce meaningful outputs, and often suffer from drift. This work addresses these challenges with a pipeline that fuses stereo video with inertial data to produce temporally-smooth pose estimates. Biomechanical constraints during optimization permit mapping the estimated pose trajectories to joint angles. The fusion also finds the relative rotation of the wearable sensors on the subject, which allows estimating joint angles without video. The system is tested in the rehabilitation setting on a participant with spinal cord injury using a wheelchair and is able to track shoulder elevation, elevation plane, internal rotation, elbow flexion and wrist pronation both in the fused condition and from inertial sensors alone during wheelchair propulsion.
Original language | English (US) |
---|---|
Title of host publication | Proceedings - 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2020 |
Editors | Vitomir Struc, Francisco Gomez-Fernandez |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 508-514 |
Number of pages | 7 |
ISBN (Electronic) | 9781728130798 |
DOIs | |
State | Published - Nov 2020 |
Event | 15th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2020 - Buenos Aires, Argentina Duration: Nov 16 2020 → Nov 20 2020 |
Publication series
Name | Proceedings - 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2020 |
---|
Conference
Conference | 15th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2020 |
---|---|
Country/Territory | Argentina |
City | Buenos Aires |
Period | 11/16/20 → 11/20/20 |
Funding
This work was supported by the Craig H. Neilsen foundation. Thank you to Shirley Ryan AbilityLab and staff for additional support with this research, as well as the subjects that participated.
Keywords
- kinematic monitoring
- markerless pose estimation
- rehabilitation
- wearable sensors
ASJC Scopus subject areas
- Computer Vision and Pattern Recognition
- Artificial Intelligence