The transformer architecture, explained. You may have heard about the transformer architecture: it resulted in momentou…
From @harpercarrollai on Instagram — 656.8K followers · See full profile →
The transformer architecture, explained. You may have heard about the transformer architecture: it resulted in momentous improvements in large language models (LLMs) and thus helped enable systems like ChatGPT. It also produced “emergent behavior” - capabilities of an AI model not present in the training data - which had never before been seen in LLMs. I have a video on emergent behavior on my page, a few videos back. These graphics are from 3Blue1Brown’s series on Transformers on YT. Check it…
Tags: GPT · AI Infra · Reel
Topics in this post
GPT · AI Infra · OpenAI · Transformer
More from @harpercarrollai
- Addressing some questions. I’m partway through Zuck’s interview on Rogan, and I heard this and wanted to share. I’m exc…
- Why AI is the Next Electricity ⚡️ Imagine if we didn’t have electrical appliances since… they were basically death trap…
- “How to spot deepfakes” guides miss the impending reality: any tell-tale signs we identify today won’t be evident tomor…
- Have you tried NotebookLM’s other features? Is this something you’d use? More broadly, how do you see AI enhancing your…
- AI watermarks act like invisible labels that help people tell if something was created by artificial intelligence. This…
- Did you know the most sophisticated AI systems were actually so chaotic? Yep - this AI meme is actually pretty accurate…