George Hotz | Programming | coding in UOps on AMD MI350X tickets.comma-con.com/events/comma/1859964
Pitting Tinygrad against Torch on a new AMD GPU • Diving deep into the GPU manual for tensor cores • The tensor core mystery: a floating point surprise
Video Chapters
- 2:20 Pitting Tinygrad against Torch on a new AMD GPU
- 3:50 Diving deep into the GPU manual for tensor cores
- 5:20 The tensor core mystery: a floating point surprise
- 7:10 Unlocking a free performance boost from AMD
- 8:40 Introducing Tinygrad's new custom kernel syntax
- 10:15 First test: a barebones matrix multiply from scratch
- 11:20 Live debugging the custom matrix multiply
- 13:20 Visualizing the GPU's execution with a custom debugger
- 15:50 Adding a ReLU activation in a single line
- 17:30 How does this new syntax stack up against TVM?