- Date de réalisation : 28 Juin 2018
- Durée du programme : 48 min
- Classification Dewey : Reconnaissance des formes par ordinateur, Vision par ordinateur
- Catégorie : Conférences
- Niveau : niveau Master (LMD), niveau Doctorat (LMD), Recherche
- Disciplines : Traitement signal et image, Informatique
- Collections : Colloquium Jacques Morgenstern : recherches en STIC - nouveaux thèmes scientifiques, nouveaux domaines d’application, et enjeux
- ficheLom : Voir la fiche LOM
- Auteur(s) : FERRARI Vittorio
- producteur : INRIA (Institut national de recherche en informatique et automatique)
- Editeur : CNRS - Centre National de la Recherche Scientifique , UNS , INRIA (Institut national de recherche en informatique et automatique)
Dans la même collectionHow to build quality software: the Eiffel experience Self-Supervised Visual Learning and Synthesis Theoretical Foundations for Runtime Monitoring The Legacy of Rudolph Kalman Reasoning over large-scale biological systems with heterogeneous and incomplete data The quest for long-lived quantum bit
Knowledge transfer and human-machine collaboration for training object class detector
Object class detection is a central area of computer vision. It requires recognizing and localizing all objects of predefined set of classes in an image. Detectors are usually trained under full supervision, which requires manually drawing object bounding-boxes in a large number of training images. This is tedious and very time consuming. In this talk I will present two recent techniques for reducing this effort.
In the first part I will explore a knowledge transfer scenario: training object detectors for target classes with only image-level labels, helped by a set of source classes with bounding-box annotations. I will present a unified knowledge transfer framework based on training a single neural network multi-class object detector over all source classes, organized in a semantic hierarchy. This generates proposals with scores at multiple levels in the hierarchy, which we use to explore knowledge transfer over a broad range of generality, ranging from class-specific (bicycle to motorbike) to class-generic (objectness to any class). Experiments on 200 object classes from the ILSVRC 2013 dataset demonstrate large improvements over weakly supervised baselines. Moreover, we also carry out several across-dataset knowledge transfer experiments, which establish the general applicability of our method
In the second part I will consider a human-machine collaboration scenario, where a human interacts with a computer model to carry the bounding-box annotation process together. I will introduce Intelligent Annotation Dialogs: we train an agent to automatically choose a sequence of actions for a human annotator to produce a bounding box in a minimal amount of time. We consider two actions: box verification, where the annotator verifies a box generated by an object detector, and manual box drawing. We explore two kinds of agents, one based on predicting the probability that a box will be positively verified, and the other based on reinforcement learning. We experimentally demonstrate that our agents are able to learn efficient annotation strategies in several scenarios, automatically adapting to the image difficulty, the desired quality of the boxes, and the detector strength.