← Back to video hub
YouTube • YouTube — Andrej Karpathy
But what is cross-entropy? | Compression is Intelligence Part 2
Jul 16
Description
There's a kind of wild paper from 2002 called Language Trees and Zipping, which shows how you can find structure between languages just by using very general file compression. For example, let's say I give you a bunch of text documents in many different languages, and your goal…