Debugging the Android Kernel with Just a USB Cable
kgdb on a Pixel 6 over the same USB-C cable that carries adb, with no UART adapter or debug board, by polling the dwc3 USB controller while the kernel is stopped.
Dom 🆚 Machine
I'm a security researcher/engineer. This is where I post notes on vulnerability research, exploit development, offensive security, and what I'm learning about AI/ML safety & internals.
Posts are drafted from my Obsidian notes with AI assistance.
Sampling from a Transformer
Porting the generation loop into PvML, the strategies to turn logits into a token, and the one-token bug that made a trained model emit nothing but commas.
Training a Transformer
Continuation of the Understanding Transformers post, where the weights stop being downloaded and start being learned. A loss, a data pipeline, a trainer, and experiments.
Understanding Transformers
Notes from rebuilding GPT-2 from scratch while working through ARENA's curriculum, module by module, with the shapes and diagrams I needed to follow it.