Legendary AI educator Andrej Karpathy released microgpt.py today on GitHub — it’s a transformer (the groundbreaking neu…
From @harpercarrollai on Instagram — 619.9K followers · See full profile →
Legendary AI educator Andrej Karpathy released microgpt.py today on GitHub — it’s a transformer (the groundbreaking neural network architecture behind modern AI), fully implemented for both training and inference, in its barest form. I taught a class yesterday and we covered open-source AI models and what large language models (LLMs) look like in code - and how the code itself is not that extensive, especially when libraries are used. Was fun to see Andrej release this this morning - no…
Github · Py · Karpathy · Transformer