You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It works in 512x512 but fails with 512x768 with this error in the vae_encoder step:
***** Compiling vae_encoder *****
...........
[GCA035] Instruction: I-5715-0 with opcode: TensorTensor couldn't be allocated in SB
Memory Location Accessed:
add.1_reload_7077_i0: 196608 Bytes per Partition and total of: 25165824 Bytes in SB
_add.1104-t7919_i0: 4 Bytes per Partition and total of: 512 Bytes in SB
add.6_i0: 2048 Bytes per Partition and total of: 262144 Bytes in SB
Total Accessed Bytes per partition by instruction: 198660
Total SB Partition Size: 196608
- Please open a support ticket at https://github.com/aws-neuron/aws-neuron-sdk/issues/new. You may also be able to obtain more information using the 'XLA_IR_DEBUG' and 'XLA_HLO_DEBUG' environment variables.
An error occured when trying to trace vae_encoder with the error message: neuronx-cc failed with 70.
The export is failed and vae_encoder neuron model won't be stored.
Do I need any other parameters or is it a bug that needs fixing? I'm running it on AWS inf2.2xlarge instance.
The text was updated successfully, but these errors were encountered:
mludvig
changed the title
Compiling SD1.5 for Neuron with resolution other than 512x768 fails
Compiling SD1.5 for Neuron with resolution 512x768 fails
Sep 11, 2024
I'm trying to export SD 1.5 into a portrait mode resolution 512x768 for use with Neuron / Inferentia 2. This is my export command:
It works in 512x512 but fails with 512x768 with this error in the
vae_encoder
step:Do I need any other parameters or is it a bug that needs fixing? I'm running it on AWS inf2.2xlarge instance.
The text was updated successfully, but these errors were encountered: