Micro Gpt
3 mentions across 1 person
Visit ↗“In support of this, we show that stability is satisfied in a minimal set of experiments with microgpt. Our code is available at https://github.com/SamSpo1/microgpt-sketch.”
Efficient Data Deletion Scheme for Deep Learning Models ↗
“I have this like running obsession of like maybe a decade or two of just like simplifying and boiling down the uh basically LLMs uh to like their bare essence. And I've had a number of projects along these lines. So like nano GPT and um make more and uh micro GP microrad etc. So I feel like micro GPT is now the state-of-the-art of me trying to like just boil it down to just the essence”
The Future of Engineering in the Age of AI Agents ↗“# microgpt """ The most atomic way to train and run inference for a GPT in pure, dependency-free Python. This file is the complete algorithm. Everything else is just efficiency. @karpathy """”
Deconstructing GPT Architecture: From Atomic Implementation to Metaweight Heuris ↗