- Label UNT : Unisciel, UNIT
- Date de réalisation : 1 Décembre 2011
- Durée du programme : 45 min
- Classification Dewey : Vision par ordinateur
- Auteur(s) : SCHMID Cordelia
- producteur : Région PACA , INRIA (Institut national de recherche en informatique et automatique)
- Réalisateur(s) : VSP - Vidéo Sud Production
- Editeur : INRIA (Institut national de recherche en informatique et automatique) , UNS , CNRS - Centre National de la Recherche Scientifique
Dans la même collectionHow to build quality software: the Eiffel experience Self-Supervised Visual Learning and Synthesis Theoretical Foundations for Runtime Monitoring The Legacy of Rudolph Kalman Reasoning over large-scale biological systems with heterogeneous and incomplete data The quest for long-lived quantum bit
Action recognition from video: some recent results
While recognition in still images has received a lot of attention over the past years, recognition in videos is just emerging. In this talk I will present some recent results.
Bags of features have demonstrated good performance for action recognition in videos. We briefly review the underlying principles and introduce trajectory-based video features, which have shown to outperform the state of the art. These features are obtained by dense point sampling in each frame and tracking them based on displacement information from a dense optical flow field. Trajectory descriptors are obtained from motion boundary histograms, which are robust to camera motion.
We then show how to integrate temporal structure into a bag-of-features model based on so-called actom sequences. We localize actions based on sequences of atomic actions, i.e., represent the temporal structure by sequences of histograms of actom-anchored visual features. This representation is flexible, sparse and discriminative. The resulting model is shown to significantly improve performance over existing methods for temporal action localization. Finally, we show how to move towards more structured representations by explicitly modeling human-object interactions. We learn how to represent human actions as interactions between persons and objects. We localize in space and track over time both the object and the person, and represent an action as the trajectory of the object with respect to the person position, i.e., our human-object interaction features capture the relative trajectory of the object with respect to the human. This is shown to improve over existing methods for action localization.