Advanced 5 h 2 lessons

Transformers and Attention

Explain conceptually how attention lets a transformer weigh context and why it scales to large language models.

Lessons

  1. 1 Course outline Reading
  2. 2 Key concepts Reading