🐛 [Bug] SDv1.5 generate black image with torch_tensorrt compile

[xduzhangjiayu]

Bug Description

SDv1.5 generate black image with torch_tensorrt compile

log on cmd:
Lib\site-packages\diffusers\image_processor.py:97: RuntimeWarning: invalid value encountered in cast
images = (images * 255).round().astype("uint8")
Potential NSFW content was detected in one or more images. A black image will be returned instead. Try again with a different prompt and/or seed.

To Reproduce

Follow the official example:
`import torch
import torch_tensorrt
from diffusers import DiffusionPipeline
model_id = "stable-diffusion-v1-5"
device = "cuda:0"
pipe = DiffusionPipeline.from_pretrained(
model_id, revision="fp16", torch_dtype=torch.float16
)
pipe = pipe.to(device)

backend = "torch_tensorrt"
pipe.unet = torch.compile(
pipe.unet,
backend=backend,
options={
"truncate_long_and_double": True,
"enabled_precisions": {torch.float32, torch.float16},
},
dynamic=False,
)`

Expected behavior

SDv1.5 generate a normal image

Environment

tensorrt 10.1.0
tensorrt-cu12 10.2.0.post1
tensorrt-cu12_bindings 10.1.0
tensorrt-cu12_libs 10.1.0
torch 2.4.0+cu124
torch_tensorrt 2.4.0
torchaudio 2.4.0+cu124
torchvision 0.19.0+cu124

Additional context

[narendasan]

Seems like this is coming from diffusers: Potential NSFW content was detected in one or more images. A black image will be returned instead. Try again with a different prompt and/or seed. Dont think this involves Torch-TRT

[xduzhangjiayu]

Seems like this is coming from diffusers: Potential NSFW content was detected in one or more images. A black image will be returned instead. Try again with a different prompt and/or seed. Dont think this involves Torch-TRT

Hi,
The strange thing is that when I remove the torch_tensorrt compiled code, using the same prompt and seed, it could generate the correct image.

The GPU i used is RTX4060 Laptop (8GB)
Driver Version: 560.70 CUDA Version: 12.6

[pangyoki]

Has this issue been resolved? I encountered the same issue. And there were no problem when using torch-tensorrt version 2.3.0.