From the original source:
YouTube — Andrej Karpathy
Read full article at YouTube — Andrej KarpathyThis material was compiled from public sources. If its publication affects your rights → Request removal
Measuring the entropy of English
Claude Shannon figured out how the compressibility of English text depends on how predictable it is, so he made multiple attempts at understanding the probability of each new character in English. His earliest experiments involved looking at specific short sequences of…
AI Summary & Key Takeaways
- Claude Shannon figured out how the compressibility of English text depends on how predictable it is, so he made multiple attempts at understanding the probability of each new character in English
- His earliest experiments involved looking at specific short sequences of…
Related stories
Anthropic pitches AI safety bill that may block a model if 50+ people could be killed
The proposed policy seems to offer protections against AI run amok but actually forbids federal agencies from blocking a model's release without the permission of a judge.
Stop paying for AI, run everything locally (here’s how)
Big labs are not going to talk about this but continual learning the idea of improving the models for your [music] own use cases for your own workflows. Big labs have no incentive of providing users with that [music] because they're training their models for the normal…
Anthropic’s cloud partnerships are getting messy
Anthropic is reportedly struggling to secure enough compute from cloud providers that increasingly view it as a competitor, even as its infrastructure spending balloons ahead of a planned November IPO.
OpenAI acquires startup Orchestra Bio to develop biotech
OpenAI acquired startup Orchestra Bio for development in biotechnologies.