Let’s explore transformer together

Séquence du séminaire les Rencontres de Statistique Appliquée 

Brainpower Meets Machine Power: Chat-GPT synergies with social scientists

Kamel Smaïli (Lorraine University - Loria)

In this presentation, we will provide a detailed explanation of the Transformer architecture, which forms the foundation for state-of-the-art generative AI systems.

We will delve into the intricacies of both the encoder and the decoder, emphasizing the significance of positional encoding and multi-head attention. The presentation will be enriched with illustrative examples. Regarding the decoder, we will highlight the distinction between the two types of multi-head attention employed within it