Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Fixes # (issue)
Before submitting
Bug found when test with num_batches = throughput_warmup_steps.
test cmd:
python text_to_image_generation.py --model_name_or_path /host/mnt/ctrl/disk1/personal/cg/models/stable-diffusion-xl-base-1.0 --prompts "Sailing ship painting by Van Gogh" --num_imag es_per_prompt 10 --batch_size 4 --image_save_dir /tmp/stable_diffusion_xl_images --scheduler euler_discrete --use_habana --use_hpu_graphs --num_inference_steps 30 --height 1024 --width 1024 --gaudi_config Habana/stable-diffusion --bf16 --optimize
Speed metrics: {'generation_runtime': 247.3958, 'generation_samples_per_second': 0.049, 'generation_steps_per_second': 1.31}
python text_to_image_generation.py --model_name_or_path /host/mnt/ctrl/disk1/personal/cg/models/stable-diffusion-xl-base-1.0 --prompts "Sailing ship painting by Van Gogh" --num_imag es_per_prompt 16 --batch_size 4 --image_save_dir /tmp/stable_diffusion_xl_images --scheduler euler_discrete --use_habana --use_hpu_graphs --num_inference_steps 30 --height 1024 --width 1024 --gaudi_config Habana/stable-diffusion --bf16 --optimize
Speed metrics: {'generation_runtime': 261.2659, 'generation_samples_per_second': 0.258, 'generation_steps_per_second': 7.751}
G2D:
<style> </style>