The transformer architecture, explained. You may have heard about the transformer architecture: it resulted in momentou…
From @harpercarrollai on Instagram — 619.9K followers · See full profile →
The transformer architecture, explained. You may have heard about the transformer architecture: it resulted in momentous improvements in large language models (LLMs) and thus helped enable systems like ChatGPT. It also produced “emergent behavior” - capabilities of an AI model not present in the training data - which had never before been seen in LLMs. I have a video on emergent behavior on my page, a few videos back. These graphics are from 3Blue1Brown’s series on Transformers on YT. Check it…