Skip to content

Commit 84b3a16

Browse files
youkaichaoabmfy
authored andcommitted
[ci] fix gh200 tests (vllm-project#11919)
Signed-off-by: youkaichao <[email protected]>
1 parent 1b718d6 commit 84b3a16

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

vllm/model_executor/model_loader/weight_utils.py

+3-1
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,9 @@
2929

3030
try:
3131
from runai_model_streamer import SafetensorsStreamer
32-
except ImportError:
32+
except (ImportError, OSError):
33+
# see https://github.com/run-ai/runai-model-streamer/issues/26
34+
# OSError will be raised on arm64 platform
3335
runai_model_streamer = PlaceholderModule(
3436
"runai_model_streamer") # type: ignore[assignment]
3537
SafetensorsStreamer = runai_model_streamer.placeholder_attr(

0 commit comments

Comments
 (0)