Visual Reasoning on Complex Events in Soccer Videos Using Answer Set Programming

12 pages•Published: December 10, 2019

Abdullah Khan, Loris Bozzato, Luciano Serafini and Beatrice Lazzerini

Abstract

In the context of computer vision, most of the traditional action recognition techniques assign a single label to a video after analyzing the whole video. We believe that under- standing of the visual world is not limited to recognizing a specific action class or individual object instances, but also extends to how those objects interact in the scene, which im- plies recognizing events happening in the scene. In this paper we present an approach for identifying complex events in videos, starting from detection of objects and simple events using a state-of-the-art object detector (YOLO). We provide a logic based representation of events by using a realization of the Event calculus that allows us to define complex events in terms of logical rules. Axioms of the calculus are encoded in a logic program under Answer Set semantics in order to reason and formulate queries over the extracted events. The applicability of the framework is demonstrated over the scenario of recognizing different kinds of kick events in soccer videos.

Keyphrases: answer set programming, event calculus, event detection in video

In: Diego Calvanese and Luca Iocchi (editors). GCAI 2019. Proceedings of the 5th Global Conference on Artificial Intelligence, vol 65, pages 42-53.

Links:	https://easychair.org/publications/paper/83zQ
	https://doi.org/10.29007/pjd4

BibTeX entry

@inproceedings{GCAI2019:Visual_Reasoning_Complex_Events,
  author    = {Abdullah Khan and Loris Bozzato and Luciano Serafini and Beatrice Lazzerini},
  title     = {Visual Reasoning on Complex Events in Soccer Videos Using Answer Set Programming},
  booktitle = {GCAI 2019. Proceedings of the 5th Global Conference on Artificial Intelligence},
  editor    = {Diego Calvanese and Luca Iocchi},
  series    = {EPiC Series in Computing},
  volume    = {65},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2398-7340},
  url       = {/publications/paper/83zQ},
  doi       = {10.29007/pjd4},
  pages     = {42-53},
  year      = {2019}}

Download PDF Open PDF in browser