Put ancestors on same device as next_token_logits (#651)
#212
| Job | Run time |
|---|---|
| 33s | |
| 33s |
ancestors on same device as next_token_logits (#651)
#212
| Job | Run time |
|---|---|
| 33s | |
| 33s |