Материал түпнұсқа тілінде: English.
Generative modeling with sparse transformers
We’ve developed the Sparse Transformer, a deep neural network which sets new records at predicting what comes next in a sequence—whether text, images, or sound. It uses an algorithmic improvement of the attention mechanism to extract patterns from sequences 30x longer than possible previously.
2019 ж. 23 сәуір · Дереккөз: OpenAI news
Толық мәтін дереккөзде қолжетімді.