Skip to content

Commit

Permalink
Ev instead of E.
Browse files Browse the repository at this point in the history
  • Loading branch information
wujingyue authored and Borda committed Mar 21, 2024
1 parent 84fb458 commit dbd70f7
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion thunder/tests/test_cudnn_executor.py
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@ def grad_scaled_dot_product_attention_reference_generator(op, device, dtype, req
# Non-contiguous input tensor case
nq = make(N, n_head, E, L).permute(0, 1, 3, 2)
nk = make(N, n_head, E, S).permute(0, 1, 3, 2)
nv = make(N, n_head, E, S).permute(0, 1, 3, 2)
nv = make(N, n_head, Ev, S).permute(0, 1, 3, 2)
yield SampleInput(nq, nk, nv, None, dropout_p=0.0, is_causal=False)

# Test the scale factor which was added in torch 2.1
Expand Down

0 comments on commit dbd70f7

Please sign in to comment.