All published intelligence, sovereign stack research, ecosystem news, and AI foundation model reviews.
Admit, this was actually much more simple than I was imagining, but nonetheless, it's interesting to read. So, we we The title gives it away, right? Embarrassingly >> [laughter] >> In in a previous uh journal club, we read a paper on self-distillation, and in that paper uh there…
Hi, in this video I'm going to walk you through a multi-agent setup of AutoResearch. I use open source models and an open source code harness, OpenCode, and I implement AutoResearch, which is a project by Andre Carpathie where he takes a nano GPT project, an LLM in its simplest…
Good morning everyone. How's it going today? Today we're going to be talking about the fine web data set. Now, this is a project by Hugging Face and it is a great example of how to gather all the data that you need to train a large language model. This actually is also available…
This paper is doing something if I understand correctly that is very similar to what pipeline RL proposed for reinforcement learning which is where you want to basically have like really decoupled generators from learners from trainers um but you have the additional complexity…
Всем привет. Если вы работаете с ИИ, у вас наверняка уже есть аккаунт на Hugging Face Hub, где удобно демонстрировать свои модели, скачивать модели с открытым кодом, использовать публичные наборы данных и создавать демоверсии своих моделей. Но публичный хаб—это только начало. В…
Let [clears throat] me think where to start. Okay, so we've got the Kim K3 report and it's quite a beast in terms of details, which is pretty awesome. And the bits that I focused on were really just the the pre- uh sorry, the post-training parts. And even that I wasn't able to…
Uh, this paper is actually quite interesting. It dives into something that that has been I guess a question an open question for the Ember communities the Um, we can call them like scaling laws for post-training. And then how is pre-training allocation of compute impact…
Okay, so this is quite um interesting paper and a bit uh surprising that uh how it works, but uh basically the idea is that uh in post-training, you have usually uh a pipeline where you have a model and then you uh run RL over that model. And ideally that uh post-RL model should…
I'm thrilled to introduce this course on fast and efficient LLM inference, built in partnership with Red Hat, and taught by Sergey Kliger. Deploying open source LLMs efficiently, so they can serve many users at once with low latency and reasonable cost, is challenging. In this…
All right. So this paper um is about a model called Faraday um which was trained by this new startup called inherent and what they train the model to do is to do a very narrow part of like scientific replication. So if I understood correctly, basically they want to take a bunch…
Yeah, I think it's a really cool paper. Um, I think we've talked a bit about this before or like I think it has been a bit in the in the common discourse that like now that implementation is sped up so much, um, like the the value that researchers can provide is more in their…
We just shipped more than 200 WebGPU kernels for browser AI and they are all available open source on the Hugging Face Hub. We also shipped a new library called Hugging Face Kernels that allows you to load and to execute all of those kernels. Let's have a look at this little…
We finally released Transformers.js version 4.3 and it's packed with really cool features. Yes, it has been a while since 4.2 and the main reason for that is that we spent a lot of time with the new Hugging Face Canvas library that released last week. But let's have a look at…
Everybody um I am Oritro and uh with me is Emma. So hi. Say hi Emma. >> Hello. >> And uh today what we think we are going to do is a private huddle call uh in hugging face and we are just going to make it live to everybody. And the entire um idea behind this uh call would be to…
Hello everyone. Welcome to this video on stop wasting bandwidth. If you work with large datasets, you're probably re-uploading the same bytes over and over again. But there's a better way, and that's what we're going to discuss in this video. Here's what we're going to cover in…
[music] >> Over the last year, AI Dev Scale from a few hundred people to this one of about [music] 3,000 attendees. So many hallway conversations, great presentations. Someone told me it feels like a music festival to have so many people here chatting, buzzing, talking about…
Добро пожаловать на курс по разработке на основе спецификаций, созданный совместно с JetBrains. Разработка на основе спецификаций —это лучший на сегодня рабочий процесс для создания серьезных приложений с помощью ИИ-агентов. Вы даете ИИ-агенту Markdown-файл или подробный промпт…
Good morning, everyone. How's it going? So, PewDiePie is doing AI now, and I figured that this is a great moment and a great opportunity to explain to you exactly what he is building, how he's doing it, and how you can do the same thing. Because I figured that a lot of you might…
Hi, I'm Joe Reis and today I'm excited to share with you the launch of a series of courses, the Data Engineering Professional Certificate Program in partnership with Deep Learning AI and Amazon Web Services. If you're someone who is just getting started on your own data…
Good morning everyone. How's it going? Today we're going to be taking a very quick look at how to create a dashboard for a business analyst use case uh from a data set. So suppose that you have your CSV file and you want to create a business dashboard to showcase to your…
hi everyone today we are continuing our implementation of make more now in the last lecture we implemented the multier perceptron along the lines of benj 2003 for character level language modeling so we followed this paper took in a few characters in the past and used an MLP to…
hi everyone so recently I gave a 30-minute talk on large language models just kind of like an intro talk um unfortunately that talk was not recorded but a lot of people came to me after the talk and they told me that uh they really liked the talk so I would just I thought I…
hi everyone so in this video I'd like us to cover the process of tokenization in large language models now you see here that I have a set face and that's because uh tokenization is my least favorite part of working with large language models but unfortunately it is necessary to…
大家好，在这个视频中，我想继续我们关于大型语言模型（例如 chpd）的普通观众系列，现在在上一个视频中深入探讨 llms，您可以在我的 YouTube 上找到这些模型，我们深入了解了这些模型如何训练的许多底层基础知识......
大家好，今天我们将继续我们的《从零到英雄》系列，特别是今天我们将重现 gpt2 模型，它的 1.24 亿版本，所以当 openi 发布 gpt2 时，那是 2019 年，他们通过这篇博客文章发布了它……
大家好，我想制作这个视频有一段时间了，它是对 Chachi PT 这样的大型语言模型的全面但一般观众的介绍，我希望在这个视频中实现的是给你一种思维模型，让你思考这是什么......
Научная корпорация имплантировала чип для восстановления зрения первому пациенту с болезнью Старгардта.
Cerebras CEO 安德鲁·费尔德曼向散布末日警告的 AI 领袖传达信息：也许该闭嘴了？在 TechCrunch Disrupt 大会上，他指出行业过度关注 AI 的风险，掩盖了其潜在益处。
Ученые MIT исследуют, как искусственные нейронные сети могут самоорганизовываться.