how to use multiGPU?

[Zuozhuo]

I didn’t see this option in the official Jupyter notebook provided.

[shimmyshimmer]

Hi there it is still in the works so stay tuned!

[Zuozhuo]

Thank you for your reply, i have known that. However, if I have multiple GPUs on my device, how can I manually specify the GPU device ID? (Currently, the first GPU is used by default.) 左卓 ***@***.***  

…

------------------ 原始邮件 ------------------ 发件人: "unslothai/unsloth" ***@***.***>; 发送时间: 2024年11月25日(星期一) 下午3:01 ***@***.***>; ***@***.******@***.***>; 主题: Re: [unslothai/unsloth] how to use multiGPU? (Issue #1332) Hi there! Thank you for asking about multiGPU support. Let me clarify the current situation: Currently, Unsloth officially supports only single GPU operations. While multiGPU support is a highly requested feature, it's not yet available in the public release. Here's what you need to know: Current Status: Unsloth is optimized for single GPU usage The library will raise a RuntimeError if it detects multiple GPU setups Future Plans: MultiGPU support is actively being developed It's planned for release later this year A beta version exists but is not publicly available yet Available Options: For now, if you need to train with multiple GPUs, you have a few alternatives: Use single GPU with Unsloth's optimized implementation Consider other frameworks that currently support multiGPU training Wait for the upcoming official multiGPU release The development team is prioritizing making Unsloth the best single GPU finetuning library before expanding to multiGPU support, as this serves the majority of users' needs. You can follow issue #543 for updates on the multiGPU feature development. Please let me know if you have any other questions about the current capabilities or would like recommendations for your specific use case! — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>