Cannot reproduce the results for COQA

[SebGGruber]

Hi,
I ran your script with your requirements and cannot reproduce the results for COQA (haven't tried TriviaQA).
I had to set the num_generations to 20 as this was not default in the code and kept the rest but the results still do not match the paper.
Is there anything missing in the code (like seed) or do I have to change some further hyperparameters from the ones provided in your code?
I appreciate any kind of help.
(If it helps, I can provide my results for comparison)