TypeError: ModelRunnerCpp.from_dir() got an unexpected keyword argument 'gather_generation_logits'

[InCogNiTo124]

System Info

When running an example for qwen2.5

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

Step 1: https://github.com/NVIDIA/TensorRT-LLM/tree/ci_test/examples/qwen#build-tensorrt-engines
Step 2: https://github.com/NVIDIA/TensorRT-LLM/tree/ci_test/examples/qwen#summarization-using-the-qwen-model

Expected behavior

Does not break

actual behavior

Breaks

additional notes

Everything works with previous version of summarize.py scrip, ie https://github.com/NVIDIA/TensorRT-LLM/blob/be1788106245496872d18e702978e59b6bfd50e0/examples/summarize.py