update to rocm 6.3 wheels

[johnnynunez]

• Pytorch supports cuda 12.6 and rocm 6.2.4, 6.3
  Better performance rocm6.3 https://community.amd.com/t5/ai/unlocking-new-horizons-in-ai-and-hpc-with-the-release-of-amd/ba-p/726434

pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cu126
pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/rocm6.2.4
pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/rocm6.3

@tenpercent now synchronized with last develop commit

[johnnynunez]

rocm6.3 is good, I can train with W7900 because it has hipblast activated etc. Also it has flash attention experimental by triton support.
Rocm6.4 is coming also for pytorch

[tenpercent]

Looks reasonable, thanks!

[tenpercent]

@johnnynunez could you also open a PR with the same changes to https://github.com/facebookresearch/xformers? The wheels upload is handled on pytorch oss infrastructure, so wouldn't happen until this change lands in the original repository (and a minor release is cut iirc)

[johnnynunez]

@johnnynunez could you also open a PR with the same changes to https://github.com/facebookresearch/xformers? The wheels upload is handled on pytorch oss infrastructure, so wouldn't happen until this change lands in the original repository (and a minor release is cut iirc)

facebookresearch#1192

[johnnynunez]

I updated to torch 2.6.0. Is out in this end of the month.
https://dev-discuss.pytorch.org/t/pytorch-2-6-release-branch-cut-for-pytorch-core-is-completed/2656