Skip to content
This repository has been archived by the owner on Oct 16, 2023. It is now read-only.

How to inference BLOOM-176B by multi-node multi-card？ #189

Open
vicwer opened this issue Feb 16, 2023 · 2 comments
Open

How to inference BLOOM-176B by multi-node multi-card？ #189

vicwer opened this issue Feb 16, 2023 · 2 comments
Assignees
@ht-zhou

Comments

@vicwer
Copy link

vicwer commented Feb 16, 2023

HI，Thank you very much for your work, I can now do bloom-560m inference on single node 4 cards by example, how to use multi-node multi-card (like 4x4x32GB v100GPU) inference bloom-176b？
@sharlec
Copy link

sharlec commented Apr 26, 2023

same asking here

@chenbo90
Copy link

me too! how to use multi-node multi-card inference? Does Energonai support ?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@ht-zhou ht-zhou

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@vicwer @sharlec @chenbo90 @ht-zhou