Astana time
AI QAZAQSTANKZ · AIBeta

Smart portal about artificial intelligence and high technology in Kazakhstan

Research1 min read

From the original source:

YouTube — Andrej Karpathy

Read full article at YouTube — Andrej Karpathy

This material was compiled from public sources. If its publication affects your rights → Request removal

Let's build the GPT Tokenizer

hi everyone so in this video I'd like us to cover the process of tokenization in large language models now you see here that I have a set face and that's because uh tokenization is my least favorite part of working with large language models but unfortunately it is necessary to…

YouTube — Andrej KarpathyBy: Andrej KarpathyOctober 14, 2026 (6 days ago)
Available in 1 languages

AI Summary & Key Takeaways

  • hi everyone so in this video I'd like us to cover the process of tokenization in large language models now you see here that I have a set face and that's because uh tokenization is my least favorite part of working with large language models but unfortunately it is necessary to…
Share:

Related stories

Back to list