Transformer Concept

Multi-Head Attention

Switch heads — same sentence, but each head learns a different pattern.

Head 1
lowhigh attention
multihead.py