Nanogpt
5 mentions across 1 person
Visit ↗All mentions
“I have this like running obsession of like maybe a decade or two of just like simplifying and boiling down the uh basically LLMs uh to like their bare essence. And I've had a number of projects along these lines. So like nano GPT and um make more and uh micro GP microrad etc. So I feel like micro GPT is now the state-of-the-art of me trying to like just boil it down to just the essence”
The Future of Engineering in the Age of AI Agents ↗“You'll recognize this file as a slightly tweaked nanoGPT, an earlier project of mine.”
Karpathy's llm.c: GPT-2/3 Pretraining in Pure C/CUDA, Outpacing PyTorch Nightly ↗“when I go to a GitHub repo like my nanoGPT repo, I can't feed this to an LLM and ask questions about it”
Software Evolution: From Code to Programmable LLMs and Partial Autonomy ↗