Leveraging Contextual Cues for Generating Basketball Highlights

ACM Multimedia, Amsterdam, Netherlands, October 2016

Block Diagram [PNG]
Vinay Bettadapura
Google, Inc.
vinaykb [at] google.com
Caroline Pantofaru
Google Inc.
cpantofaru [at] google.com
Irfan Essa
Google, Inc.
College of Computing, Georgia Tech
irfan [at] cc.gatech.edu

The massive growth of sports videos has resulted in a need for automatic generation of sports highlights that are comparable in quality to the hand-edited highlights produced by broadcasters such as ESPN. Unlike previous works that mostly use audio-visual cues derived from the video, we propose an approach that additionally leverages contextual cues derived from the environment that the game is being played in. The contextual cues provide information about the excitement levels in the game, which can be ranked and selected to automatically produce high-quality basketball highlights. We introduce a new dataset of 25 NCAA games along with their play-by-play stats and the ground-truth excitement data for each basket. We explore the informativeness of five different cues derived from the video and from the environment through user studies. Our experiments show that for our study participants, the highlights produced by our system are comparable to the ones produced by ESPN for the same games.

Paper [PDF]
Download PDF

Video Demo - Automatically Generated Highlights

       Author = {Vinay Bettadapura and Caroline Pantofaru and Irfan Essa},
       Booktitle = {Proceedings of ACM Conference on Multimedia (ACM-MM)},
       Month = {October},
       Organization = {ACM},
       Title = {Leveraging Contextual Cues for Generating Basketball Highlights},
       Year = {2016}

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without explicit permission of the copyright holder.

GOOGLE Logo  ---  --- COC@GT Logo  ---  --- RIM@GT Logo