Trans
former
Simulator
Encoder Forward Pass · Interactive · Step-by-Step
Configuration & Controls
Input:
▶ Start
Next Step →
↺ Replay
Speed:
1.5×
🔬 Detailed Math Mode
①
Tokenize
②
Embed+PE
③
Q,K,V
④
Attention
⑤
Multi-Head
⑥
Residual+LN
⑦
FFN
⑧
Output
↓ scroll to see current stage