AI · Attention
What is a transformer?
What you’ll see
A transformer reads a whole sequence at once. Each piece sends out a question, and every other piece answers how relevant it is. To guess what comes after this red circle, it looks back to the last red circle, and at what followed it: a blue square. Layer after layer these links mix, and out comes a guess.
