A list of resources I have found useful for programming. Mainly for my own reference later:
Author: Martin
Running local Python code on a remote GPU (using modal and lob.py)
I explored in a previous post how to run nanoGPT on modal – both the training and sampling. It was successful, but tiresome. There were a lot of changes to the downloaded code which made me unhappy. If I want to try different projects out that are on Github etc. I don’t want to be…
Modal.com and NanoGPT continued: producing output; using tiktoken for bigger tokens
In the previous post we explored how to get NanoGPT training on Modal. There was quite a bit to that, so I left the text generation part to now just to cap that post off. Let’s do that now and then try some more stuff out with NanoGPT. Let’s make some Shakespam With all the…
No local GPU? No Problem! Running Andrej Karpathy’s NanoGPT on Modal.com
Andrej Karpathy released a series of timeless lectures teaching us mortal 9-5 programmers from scratch how to train an “AI” language model, a bit like that GPT4 or ChatGPT you may have heard of. He goes into a deep dive that includes building your own tiny Pytorch from scratch, setting up bigram models, and simple…
NextJS – Undocumented Features
I have recently being playing around with the app router in NextJS. This is “new paradigm for building applications using React’s latest features”, and was introduces in v13. Personally I find this a real headache to work with. Mainly because the documentation is a bit scant and only covers the happy path. It feels a…
How to make Windows 11 livable
Bring back the old File Explorer right-click menu Enable the old menu for the explorer shell. The one that had everything on it rather than just 6 or so things! Like this: To do this, run these from the “cmd” command prompt. (This will close any explorer windows by the way). Add VSCode to the…
Learning List
This is the stuff I want to read and learn at the moment: General Learning Stuff Machine Learning Computers in general
Firebase Firestore Rules Recipes and Tips
Er… Why? Having done a complete web app using Firebase, I did find there are a few non-obvious things about it. One thing that kept tripping me up is the Firestore rules. If you want users to directly read and write the data in Firestore, without needing a function or a separate server (like Node.js…