Activity-Aware Video Stabilization for Ball Camera

We present a video stabilization algorithm for ball camera systems that undergo extreme egomotion during sports play. In particular, we focus on the BallCam system which is an American football embedded with an action camera at the tip of the ball. We propose an activity-aware video stabilization algorithm which is able to understand the current activity of the BallCam, which uses estimated activity labels to inform a robust video stabilization algorithm. Activity recognition is performed with a deep convolutional neural network, which uses optical flow.

Papers:

Ryohei Funakoshi, Vishnu Naresh Boddeti, Kris Kitani, and Hideki Koike. 2017. Video segmentation and stabilization for BallCam. In Proceedings of the 8th Augmented Human International Conference (AH '17). ACM, New York, NY, USA, Article 40, 2 pages. DOI: https://doi.org/10.1145/3041164.3041210 (PDF)

Ryohei Funakoshi, Vishnu Naresh Boddeti, Kris Kitani, Hideki Koike:, Activity-aware video stabilization for BallCam, In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16 Adjunct). ACM, New York, NY, USA, 197-198. (PDF)