Efficient and Robust Shape Matching for Model Based Human Motion Capture

33rd Annual Symposium of the German Association for Pattern Recognition (DAGM 2011)

Gerard Pons-Moll, Laura Leal Taixe, Tri Truong, Bodo Rosenhahn

Abstract

---

In this paper we present a robust and efficient shape matching approach for Marker-less Motion Capture. Extracted features such as contour, gradient orientations and the turning function of the shape are embedded in a 1-D string. We formulate shape matching as a Linear Assignment Problem and pro- pose to use Dynamic Time Warping on the string representation of shapes to discard unlikely correspondences and thereby to reduce ambiguities and spurious local minima. Furthermore, the proposed cost matrix pruning results in robustness to scaling, rotation and topological changes and allows to greatly reduce the computational cost. We show that our approach can track fast human motions where standard articulated Iterative Closest Point algorithms fail.

Method

---

Results

---

Cartwheel sequence: top row: original image with mesh overlaid; bottom row: 3D animation

Jumping and dancing sequence: top row: original image with mesh overlaid; bottom row: 3D animation

Comparison with ICP

---

Robust shape matching allows motion capture of highly dynamic motions:

ICP
Proposed
ICP
Proposed

Video

---