I recreated an entire GPT architecture in a spreadsheet.
It is a nanoGPT designed by @karpathy with about 85000 parameters, small enough to be packed into a spreadsheet file.

It is great for learning about how transformer works as it shows all the data and parameters going… pic.twitter.com/qC6hmpEp0h

— Dabo (@chendabo) June 9, 2024