← ~/visualizations

entropy #

Bar chart showing probability distribution transitioning from uniform (high entropy) to peaked (low entropy).

canvasclick to interact

⏮◀◀▶▶STEP0.25x1xZOOM

t=0s

practical uses #

• 01.Teaching information theory basics
• 02.Explaining uncertainty measures
• 03.Visualizing distribution shapes
• 04.Demonstrating entropy calculation

technical notes #

4-category distribution. Transitions between uniform (H=2 bits) and peaked. Entropy value computed and displayed.

← loss-landscapesoftmax-function →