Все опубликованные аналитические материалы, исследования суверенного стека, новости экосистемы и обзоры моделей ИИ.
Hello, today we are looking at context rot how increasing input tokens impacts LLM performance. This paper looks at what happens if with these long context models now we are just sort of putting more and more stuff into the context of LLMs and even though all of these models do…
Hello. I'm out of my usual room today. As you can see, I'm flying to the US for work, but I wanted to give some quick updates on OpenAI's new model launches the past week. So, they've released an open- source model in different variants, and they've also released a new frontier…
Hello there. Today we are looking at the free transformer from France Fur at Farret Meta. This transformer is extending the classic decoderbased transformer with uh a series of latent variables that can be used to kind of make underlying decisions about the sequence to be…
Hello, this is in many ways a response video to Theo or T3 GGG's video called MCP is the wrong abstraction and it is also a video about this Cloudflare article which that video is about called code mode the better way to use MCP and I want to show you this article but also point…
Hello there. Today we're going to look at on the theoretical limitations of embedding based retrieval. And this paper is really interesting uh because it proves something about embedding based retrieval. So think vector databases in rag and things like this. And the paper proves…
[фыркает] Привет. Сегодня мы рассмотрим, как Титаны учатся запоминать во время тестов. Это статья исследования Google, которая была опубликована как часть публикаций Nurips. Итак, об этом есть сообщение в блоге, и люди написали об этом в социальных сетях, и я должен признать, что…
Здравствуйте, сегодня мы рассматриваем доклад TiDaR Thinking Diffusion Talk и авторегрессию от исследователей из Nvidia. И это действительно классная статья, потому что она фактически подтверждает, что вы уже заметили, что у нас нет полного использования графического процессора во время авторегрессионной модели большого языка…
Здравствуйте, были ли вы когда-нибудь в ситуации, когда вы подслушивали разговор и до вас дошло, что этот человек из лучших побуждений ошибается в чем-то незначительном, но важном для вас, и долг Вселенной вынуждает вас сказать ему, почему он неправ. Посмотрите это. Я перерабатываю пластик…
If you can add and multiply, then you can do matrix stuff! Hooray! StatQuest. Hello, I'm Josh Starmer and welcome to StatQuest. Today we're going to talk about essential matrix algebra for neural networks and it's going to be clearly explained. Start small but then build as big…
hello I'm Josh starmer and welcome to human stories in AI with stack Quest and lightning AI in this series we'll hear about the career journeys of passionate AI experts from their humble beginnings to conquered challenges will be inspired by the realworld experiences of…
hello I'm Josh starmer and welcome to human stories in AI with stack Quest and lightning AI in this series we'll hear about the career journeys of passionate AI experts from their humble beginnings to conquered challenges will be inspired by the realworld experiences of…
The initials GPT stand for Generative Pretrained Transformer. So that first word is straightforward enough, these are bots that generate new text. Pretrained refers to how the model went through a process of learning from a massive amount of data, and the prefix insinuates that…
Hello, I'm Josh Starmer and welcome to Human Stories in AI with Stack Quest and Lightning AI. In this series, we'll hear about the career journeys of passionate AI experts from their humble beginnings to conquer challenges. We'll be inspired by the real-world experiences of…
hello I'm Josh starmer and welcome to human stories and AI with stack Quest and lightning AI in this series we'll hear about the career journeys of passionate AI experts from their humble beginnings to conquered challenges will be inspired by the realworld experiences of…
In the last chapter, you and I started to step through the internal workings of a transformer. This is one of the key pieces of technology inside large language models, and a lot of other tools in the modern wave of AI. It first hit the scene in a now-famous 2017 paper called…
we're going to do a lot of math row by column aray stat Quest hello I'm Josh starmer and welcome to stat Quest today we're going to talk about the Matrix math behind Transformer neural networks and we're going to go through it one step at a time this stat Quest is brought to you…
If you feed a large language model the phrase, Michael Jordan plays the sport of blank, and you have it predict what comes next, and it correctly predicts basketball, this would suggest that somewhere, inside its hundreds of billions of parameters, it's baked in knowledge about…
from slams import J stor and statistics and machine learning when you take the log you use base e and statistics and machine learning when you take the log you use base E when where you take the L you log base e base e is for you and for me you can use it with the log function…
[Music] hello I'm Josh starmer and welcome to human stories in AI brought to you by stat quest in this series we'll hear about the career journeys of passionate AI experts from their humble beginnings to conquered challenges we'll be inspired by the real world experiences of…
hello I'm Josh starmer and welcome to human stories and AI with stack Quest and lightning AI in this series we'll hear about the career journeys of passionate AI experts from their humble beginnings to conquered challenges will be inspired by the realworld experiences of…
The most common question I get about 3Blue1Brown is, what do I use to animate the videos? The short answer is that I wrote a custom Python library, its name is Manim, so it's all programmatic and it's also very bespoke. What I wanted to do with this video is offer a behind the…
Сегодня у меня для тебя небольшая серия головоломок, и если ты хоть отдаленно любишь математику, то я могу практически гарантировать, что решение каждой из них приведет тебя в восторг. В конце мы с тобой объединим их в более широкую тему о высших измерениях, как в смысле того,…
hello I'm Josh starmer and welcome to human stories and AI with stack Quest and lightning AI in this series we'll hear about the career journeys of passionate AI experts from their humble beginnings to conquered challenges will be inspired by the realworld experiences of…
hello I'm Josh starmer and welcome to human stories and AI with stack Quest and lightning AI in this series we'll hear about the career journeys of passionate AI experts from their humble beginnings to conquered challenges will be inspired by the realworld experiences of…
[Submit subtitle corrections at criblate.com] Imagine you happen across a short movie script that describes a scene between a person and their AI assistant. The script has what the person asks the AI, but the AI's response has been torn off. Suppose you also have this powerful…
Hello, I'm Josh Starmer and welcome to Human Stories in AI with Stack Quest and Lightning AI. In this series, we'll hear about the career journeys of passionate AI experts from their humble beginnings to conquer challenges. We'll be inspired by the real-world experiences of…
We're going to code a transformer from scratch. Hooray! StatQuest. Hello, I'm Josh Starmer and welcome to StatQuest. Today, we're going to talk about coding transformers from scratch in PyTorch. This StatQuest is brought to you by the letters A, B, and C. A, always be B. C,…
[Music] hello I'm Josh starmer and welcome to human stories in AI brought to you by Stack quest in this series we'll hear about the career journeys of passionate AI experts from their humble beginnings to conquered challenges we'll be inspired by the real world experiences of…
A few more lessons from my pop, hooray, StatQuest. Hello, I'm Josh Starmer and welcome to StatQuest. Today, we're going to talk about a few more lessons from my pop. This StatQuest is brought to you by the letters A, B, and C. A, always be B, C, curious. Always be curious. If…
За последние несколько лет системы искусственного интеллекта стали поразительно хорошо превращать текстовые реквизиты в видеоролики. В основе работы этих моделей лежит глубокая связь с физикой. Для создания моделей изображений и видео используется процесс, известный как…