Entropy and information measure
Information Theory and Coding · Engineering
Gas piston lab
Interactive 3DHeat the gas and watch molecules speed up — pressure obeys the gas laws live.
Controls
Drag the sliders or type a value — the simulation updates live.
K
200K600K
×
0.5×2×
Study notes
Fair coin: H=1 bit. Biased 90/10: H=0.47 (less surprise). Uniform max. Entropy measures information; compression removes redundancy.