Canal-U

Mon compte
Laboratoire de Linguistique Formelle

Multimodality and Memory: Outlining Interface Topics in Multimodal Natural Language Processing


Copier le code pour partager la vidéo :
<div style="position:relative;padding-bottom:56.25%;padding-top:10px;height:0;overflow:hidden;"><iframe src="https://www.canal-u.tv/video/llf/embed.1/multimodality_and_memory_outlining_interface_topics_in_multimodal_natural_language_processing.62147?width=100%&amp;height=100%" style="position:absolute;top:0;left:0;width:100%;height: 100%;" width="550" height="306" frameborder="0" allowfullscreen scrolling="no"></iframe></div> Si vous souhaitez partager une séquence, indiquez le début de celle-ci , et copiez le code : h m s
Producteur Canal-U :
Laboratoire de Linguistique Formelle
Contacter la chaine
J’aime
Imprimer
partager facebook twitter

Multimodality and Memory: Outlining Interface Topics in Multimodal Natural Language Processing

Multimodal dialogue, the use of speech and non-speech signals, is the basic form of interaction. As such, it is couched in the basic interaction mechanism of grounding and repair. This apparently straightforward view already has a couple of repercussions: firstly, non-speech gestures need representations that are subject to parallelism constraints for clarification requests known from verbal expressions. Secondly, co-activity between speaker and addressee on some channel is the rule virtually for the whole timecourse of interaction and leads to multimodal overlap as a norm, thereby questioning the orthodox notion of sequential turns. Thirdly, if turns are difficult to maintain, a new form of interaction has to be given: we propose to think of it in terms of polyphonic interaction inspired by (classical) music. The multimodal speech and non-speech examples given throughout the talk all seem to be explainable only when considering at least the interaction of contents and dialogue semantics, working memory constraints, and attentional mechanisms, and hence are examples of interface topics for cognitive science.

  •  
  •  
    Date de réalisation : 20 Mai 2021
    Durée du programme : 0 min
    Classification Dewey : Linguistique
  •  
    Catégorie : Colloques
    Niveau : niveau Doctorat (LMD), Recherche
    Disciplines : Linguistique
    Collections : Dialogue, Memory and Emotion
    ficheLom : Voir la fiche LOM
  •  
  •  
    Langue : Anglais
    Mots-clés : Mémoire
    Conditions d’utilisation / Copyright : Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)
 

commentaires


Ajouter un commentaire Lire les commentaires
*Les champs suivis d’un astérisque sont obligatoires.
Aucun commentaire sur cette vidéo pour le moment (les commentaires font l’objet d’une modération)
 

Dans la même collection

FMSH
 
Facebook Twitter
Mon Compte