George Hotz | Programming | coding in UOps on AMD MI350X tickets.comma-con.com/events/comma/1859964
Benchmarking AMD's new MI350X GPU • Hitting the manual to unlock tensor cores • The simple mistake holding back all the performance
Video Chapters
- 3:03 Benchmarking AMD's new MI350X GPU
- 4:21 Hitting the manual to unlock tensor cores
- 5:38 The simple mistake holding back all the performance
- 7:43 Finding the magic instruction for 2x performance
- 8:36 Writing our first GPU kernel in tinygrad
- 10:18 Building a matrix multiply from absolute scratch
- 11:28 Debugging and fixing our custom matmul
- 12:47 The ultimate GPU programming environment?
- 14:52 tinygrad vs. TVM: Kernel syntax comparison
- 16:09 Deep dive: How the 'after' keyword works