Publication

Common-sense reasoning for human action recognition
Common-sense reasoning for human action recognition
M.J. Santofimia
Journal: Pattern Recognition Letters
Date: 2012
Pages: 8112-8134
ISSN: 0167-8655
Volume: 12
Issue: 6
Publisher: Elsevier
[link]
Abstract
This paper presents a novel method that leverages reasoning capabilities in a computer vision system dedicated to human action recognition. The proposed methodology is decomposed into two stages. First, a machine learning based algorithm – known as bag of words – gives a first estimate of action classification from video sequences, by performing an image feature analysis. Those results are afterward passed to a common-sense reasoning system, which analyses, selects and corrects the initial estimation yielded by the machine learning algorithm. This second stage resorts to the knowledge implicit in the rationality that motivates human behaviour. Experiments are performed in realistic conditions, where poor recognition rates by the machine learning techniques are significantly improved by the second stage in which common-sense knowledge and reasoning capabilities have been leveraged. This demonstrates the value of integrating common-sense capabilities into a computer vision pipeline.