Picture for Richard Yee

Richard Yee

BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimation

Add code
Jun 23, 2022
Ivan Grishchenko, Valentin Bazarevsky, Andrei Zanfir, Eduard Gabriel Bazavan, Mihai Zanfir, Richard Yee, Karthik Raveendran, Matsvei Zhdanovich, Matthias Grundmann, Cristian Sminchisescu
Figure 1 for BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimation
Figure 2 for BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimation
Figure 3 for BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimation
Figure 4 for BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimation

We present BlazePose GHUM Holistic, a lightweight neural network pipeline for 3D human body landmarks and pose estimation, specifically tailored to real-time on-device inference. BlazePose GHUM Holistic enables motion capture from a single RGB image including avatar control, fitness tracking and AR/VR effects. Our main contributions include i) a novel method for 3D ground truth data acquisition, ii) updated 3D body tracking with additional hand landmarks and iii) full body pose estimation from a monocular image.

* 4 pages, 4 figures; CVPR Workshop on Computer Vision for Augmented and Virtual Reality, New Orleans, LA, 2022 
Viaarxiv icon
Github IconAccess Paper or Ask Questions
Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon