Generate not working

[fblgit]

Trying to train any of the Vision models that you have around, but im not being lucky on finding one that is workable both in terms of training and prediction.

File /data/conda/envs/eqbench/lib/python3.10/site-packages/zeta/structs/auto_regressive_wrapper.py:186, in AutoregressiveWrapper.generate(self, start_tokens, seq_len, eos_token, strategy, temperature, filter_logits_fn, filter_thres, min_p_pow, min_p_ratio, gamma, **kwargs)
    182 b, t = start_tokens.shape
    184 out = start_tokens
--> 186 if self.speculative:
    187     for _ in range(seq_len):
    188         x = out[:, -self.max_seq_len]

File /data/conda/envs/eqbench/lib/python3.10/site-packages/torch/nn/modules/module.py:1695, in Module.__getattr__(self, name)
   1693     if name in modules:
   1694         return modules[name]
-> 1695 raise AttributeError(f"'{type(self).__name__}' object has no attribute '{name}'")

AttributeError: 'AutoregressiveWrapper' object has no attribute 'speculative'

Im keen on pretraining a model, which one u think will give good performance and that the code is reproducible at your repo? i tried kosmos-x also, having as well some issue to run it.

Upvote & Fund

• We're using Polar.sh so you can upvote and help fund this issue.
• We receive the funding once the issue is completed & confirmed by you.
• Thank you in advance for helping prioritize & fund our backlog.