4  Transformers

Week 4

Lecture: Basics of transformer models
Lab: Fine tuning transformers for text classification

4.1 Lecture

Content to be added.

4.2 Lab

Content to be added.

4.3 Readings

  • Widmann, T. and Wich, M. (2023) ‘Creating and Comparing Dictionary, Word Embedding, and Transformer-Based Models to Measure Discrete Emotions in German Political Text’, Political Analysis, 31(4), pp. 626–641. https://doi.org/10.1017/pan.2022.15
  • Laurer, M. et al. (2024) ‘Less Annotating, More Classifying: Addressing the Data Scarcity Issue of Supervised Machine Learning with Deep Transfer Learning and BERT-NLI’, Political Analysis, 32(1), pp. 84–100. https://doi.org/10.1017/pan.2023.20