MovieReshape: Tracking and Reshaping of Humans in Videos, SIGGRAPH Asia 2010

We present a system for quick and easy manipulation of the body shape and proportions of a human actor in arbitrary video footage. The approach is based on a morphable model of 3D human shape and pose that was learned from laser scans of real people. The algorithm commences by spatio-temporally fitting the pose and shape of this model to the actor in either single-view or multi-view video footage. Once the model has been fitted, semantically meaningful attributes of body shape, such as height, weight or waist girth, can be interactively modified by the user. The changed proportions of the virtual human model are then applied to the actor in all video frames by performing an image-based warping. By this means, we can now conveniently perform spatio-temporal reshaping of human actors in video footage which we show on a variety of video sequences.

Arjun Jain, Thorsten Thormählen, Hans-Peter Seidel, Christian Theobalt

MovieReshape: Tracking and Reshaping of Humans in Videos

ACM Trans. Graph. 29 (5) (Proc. SIGGRAPH Asia 2010)





@article{Jain:2010:MovieReshape, author = {Arjun Jain and Thorsten Thorm\"{a}hlen and Hans-Peter Seidel and Christian Theobalt }, title = {MovieReshape: Tracking and Reshaping of Humans in Videos}, journal = {ACM Trans. Graph. (Proc. SIGGRAPH Asia 2010)}, year = {2010}, volume = {29}, number = {5} }

We thank

the Max Planck Center for Visual Computing and Communication (BMBF-KZ 01IM10001) for partially funding this project,

all reviewers for their helpful suggestions,

Ben Galehouse for the voice-over,

Betafilm and FremantleMedia Ltd for the permission to use the Baywatch footage

University of Surrey [Gkalelis et al. 2009] as well as [Hasler et al. 2009] for making their data available,

and all participants of the user studies.

The project is currently getting quite a lot of coverage on all sorts of media. Here is a (random) subset of the outlets that have featured MovieReshape: