Extracting kinematics and kinetics from video data
Accurate 3D kinematics estimation of human body is crucial in various applications for human health and mobility, such as rehabilitation, injury prevention, and diagnosis, as it helps to understand the biomechanical loading experienced during movement. Conventional marker-based motion capture is expensive in terms of financial investment, time, and the expertise required. Moreover, due to the scarcity of datasets with accurate annotations, existing markerless motion capture methods suffer from challenges including unreliable 2D keypoint detection, limited anatomic accuracy, and low generalization capability. In this work, we propose a novel biomechanics-aware approach using virtual and synthetic videos. The proposed approach trained on artificial data, outperforms previous state-of-the-art methods when evaluated across multiple datasets, revealing a promising direction for enhancing video-based human motion capture.
✓
3D Kinematics Estimation from Video with a Biomechanical Model and Synthetic Training Data
Zhi-Yi Lin, Bofan Lyu, Judith Cueto Fernandez, Eline van der Kruk, Ajay Seth, Xucong Zhang

Finished graduation projects
Collaborating PI’s on this project

Xucong Zhang
Assistant Professor
Faculty of Electrical Engineering, Mathematics and Computer Science
Intelligent Systems, TU Delft

Ajay Seth
Associate Professor
Faculty of Mechanical Engineering, Biomechanical Engineering, TU Delft

Eline van der Kruk
Assistant Professor
Faculty of Mechanical Engineering, Biomechanical Engineering, TU Delft
MSc students working on this project
Graduated MSc students

Punitha Devaraja
Thesis: ODAH-SpeedSkater
Development of a Virtual Video Dataset for Kinematic Analysis in Speed Skating
