Skip to content
This repository has been archived by the owner on Jun 24, 2024. It is now read-only.

AMD ROCm support with HIPBLAS #415

Open
xangelix opened this issue Aug 27, 2023 · 2 comments
Open

AMD ROCm support with HIPBLAS #415

xangelix opened this issue Aug 27, 2023 · 2 comments

Comments

@xangelix
Copy link

ggerganov/llama.cpp#1087 was merged recently and should make its way into GGML shortly. I think (hopefully) it should require only minimal changes on this side.

@xangelix
Copy link
Author

related to ggerganov/ggml#472

@LLukas22
Copy link
Contributor

rustformers uses llama.cpp as it's ggml source, feel free to create an PR including this change, seams like you only need to adjust the build.rs of the ggml-sys create. I wont be able to test this as i don't own a amd gpu.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants