1. University
  2. Faculties
  3. Faculty of Applied Computer Science
  4. Institute of Computer Science
  5. Chairs and Professors
  6. Machine Learning & Computer Vision
  7. Research
  8. Research Projects
  9. Deep Sports Pose

Deep Sports Pose

Project goal: Tracking body keypoints of athletes in long- and triple jump (and swimming) in monocular recordings to infer motion timing and kinematic parameters.

 

Video recordings of athletes are an important tool in many sport types, including swimming and long/triple jump, to evaluate performance and assess possible improvements. For a quantitative evaluation the video material often has to be annotated manually, leading to a vast workload overhead. This limits such an analysis to top-tier athletes only. In this joint project with the Olympic Training Centers (OSPs) Hamburg/Schleswig-Holstein and Hessen we research deep neural network based human pose estimation and video event detection that can be applied to various sport types and environments. We evaluate our research using the very different examples of start phases in swimming and long/triple jump recordings. Our main focus lies on time-continuous predictions and the fusion of multiple synchronous camera streams. The goal of the project is to provide a reliable and automatic pose and event detection system that makes quantitative performance evaluation accessible to more athletes more frequently.

 

This joint project is funded by the Federal Institute for Sports Science (Bundesinstitut für Sportwissenschaft, BISp) based on a resolution of the German Bundestag, starting January 2017.

 

For more information please contact  Moritz Einfalt.

 

References:

 

  • Moritz Einfalt, Rainer Lienhart.
    Decoupling Video and Human Motion: Towards Practical Event Detection in Athlete Recordings.
    The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops 2020. Seattle, WA, USA, June 2020. [ arXiv  CVF   PDF]
  • Moritz Einfalt, Charles Dampeyrou, Dan Zecha, Rainer Lienhart.
    Frame-level Event Detection in Athletics Videos with Pose-based Convolutional Sequence Networks.
    Second International ACM Workshop on Multimodal Content Analysis in Sports (ACM MMSports'19), part of ACM Multimedia 2019. Nice, France, October 2018. [ ACM DL   PDF]
  • Rainer Lienhart, Moritz Einfalt, Dan Zecha. 
    Mining Automatically Estimated Poses from Video Recordings of Top Athletes.
    IJCSS, December 2018. [ IJCSS   PDF]
  • Moritz Einfalt, Dan Zecha, Rainer Lienhart.
    Activity-conditioned continuous human pose estimation for performance analysis of athletes using the example of swimming.
    IEEE Winter Conference on Applications of Computer Vision 2018 (WACV18), Lake Tahoe, NV, USA, March 2018. [ arXiv   IEEE   PDF]

 

Automatically inferred jump phases of a triple jump athlete via detection of floor contacts and the first contact with the sand pit.

 

 

© University of Augsburg

Search