How to learn Triton?

[netw0rkf10w]

Hello,

Thank you for your great work!

I would like to learn Triton, but I don't have any CUDA programming experience. Do I need to learn CUDA first? More generally what would be the best way to learn Triton?

Thanks in advance for your responses.

[yenchenlin]

Triton's tutorial is pretty informative! Reading them in order helps me a lot. That being said, as someone who just learned the basics of Triton, I highly recommend you learn CUDA first. For this, I found Programming Massively Parallel Processors: A Hands-on Approach 4th Edition to be a good resource.

[yushinliu]

If you are not familiar with LLVM or MLIR, I think learning about CUTLASS could be a good start, the system design of them are similiar.