Direkt zum Inhalt springen
Machine Learning for Robotics
TUM School of Computation, Information and Technology
Technical University of Munich

Technical University of Munich

Menu

Links

Informatik IX

Professorship for Machine Learning for Robotics

Smart Robotics Lab

Boltzmannstrasse 3
85748 Garching info@srl.in.tum.de

Follow us on:
SRL  CVG  DVL 


BodySlam: Joint Camera Localisation, Mapping, and Human Motion Tracking

Authors: Dorian Henning*, Tristan Laidlow*, Stefan Leutenegger (*Dyson Robotics Lab)

Abstract

Estimating human motion from video is an active research area due to its many potential applications. Most state-of-the-art methods predict human shape and posture estimates for individual images and do not leverage the temporal information available in video. Many "in the wild" sequences of human motion are captured by a moving camera, which adds the complication of conflated camera and human motion to the estimation. We therefore present BodySLAM, a monocular SLAM system that jointly estimates the position, shape, and posture of human bodies, as well as the camera trajectory. We also introduce a novel human motion model to constrain sequential body postures and observe the scale of the scene. Through a series of experiments on video sequences of human motion captured by a moving monocular camera, we demonstrate that BodySLAM improves estimates of all human body parameters and camera poses compared to estimating these separately.


Export as PDF, XML, TEX or BIB

2022
Conference and Workshop Papers
[]BodySLAM: Joint Camera Localisation, Mapping, and Human Motion Tracking (D Henning, T Laidlow and S Leutenegger), In European Conference on Computer Vision (ECCV), 2022. ([video][project page]) [bibtex] [pdf]
Powered by bibtexbrowser
Export as PDF, XML, TEX or BIB

Rechte Seite

Informatik IX

Professorship for Machine Learning for Robotics

Smart Robotics Lab

Boltzmannstrasse 3
85748 Garching info@srl.in.tum.de

Follow us on:
SRL  CVG  DVL