← ~/visualizations

transformer-block #

Vertical stack showing transformer architecture: embedding, attention, feed-forward layers with skip connections.

canvasclick to interact

⏮◀◀▶▶STEP0.25x1xZOOM

t=0s

practical uses #

• 01.Teaching transformer architecture
• 02.Explaining layer composition
• 03.Visualizing skip connections
• 04.Demonstrating attention-based models

technical notes #

7-block vertical diagram. Active block highlighted as data flows. Skip connections shown on left side.

← word-embeddingsslope-and-rate-of-change →