Reinventing Entropy | Compression is Intelligence Part 1

7 June 2026 32:20 1.67M views 0 logs

+ Log this video YouTube ↗

Popular reviews

No reviews yet.Watched it? Say something.

More from 3Blue1Brown

Measuring the entropy of English

Tie random ends: How many loops?

Covering 10 points, a surprisingly tricky puzzle.

The last IMO problem AI could not solve

Ratings

–

0 ratings

½★★★★★

About

How to study the compressibility of language.
Check out our virtual career fair: https://3b1b.co/talent
See new projects before they go live: https://3b1b.co/support

Animation credit:
Manim scenes by Aaron Gostein and Grant Sanderson
Shannon’s story, as well as those for various pi creatures, by Mitchell Zemil.
Lunar robot and prediction/compression coin by Paul Dancstep
NanoGPT animations by Clayton Rabideau

The way of visualizing entropy shown here is something I first came across in this excellent post by Chris Olah:
https://colah.github.io/posts/2015-09-Visual-Information/

Shannon’s ...