Post
Fortunately, that bridge itself is easy as heck to copy and make free. At this point pretty much everything that was gained from the initial pre-training is in fact, universally shared. Differences between models that people pay for are now all post training.
1 repost44 likes
Here's that bridge for less than a single dollar worth of on-demand GPU compute github.com/kellerjordan...
github.comGitHub - KellerJordan/modded-nanogpt: NanoGPT (124M) in 90 secondsNanoGPT (124M) in 90 seconds. Contribute to KellerJordan/modded-nanogpt development by creating an account on GitHub.