Hi, I'm Pablo, a computer vision and machine learning engineer. I write about how the tools we use every day work inside, usually by rebuilding them.
Series
Rebuilding PyTorch
Rebuilding the core of PyTorch from scratch in Raxis to understand how it works inside, one piece at a time, in the order I learned it.
9 articles
- Why I rebuilt PyTorch's core from scratch
- What a PyTorch tensor really is
- Interlude: What the CPU does when your code reads memory
- How PyTorch walks a tensor of any shape
- How PyTorch prepares the loop of every operation
- How a PyTorch kernel uses the vector registers of every CPU
- How PyTorch sums a tensor, and splits the work between threads
- How PyTorch computes gradients
- How PyTorch runs the same operations on a GPU