AI Folks
  • Courses
  • Web Of AI
  • Enterprise
Log in

AI & ML Engineering · NLP and Transformers · Lesson 4 of 6

The Attention Mechanism

Self-attention: how a model decides which words matter to each other.

⠋░░░░░░░░░░░░░░░░░░░░░░░░Loading the lesson

Previous lessonWord EmbeddingsNext lessonTransformer Architecture