Skip to content

Commit

Permalink
Debugging
Browse files Browse the repository at this point in the history
  • Loading branch information
jacobbieker committed Dec 5, 2023
1 parent 5c8d590 commit 31d3f1b
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions pvnet/models/multimodal/site_encoders/encoders.py
Original file line number Diff line number Diff line change
Expand Up @@ -378,6 +378,9 @@ def _attention_forward(self, x, average_attn_weights=True):
query = self._encode_query(x)
key = self._encode_key(x)
value = self._encode_value(x)
print(f"{query.shape=}")
print(f"{key.shape=}")
print(f"{value.shape=}")

attn_output, attn_weights = self.multihead_attn(
query, key, value, average_attn_weights=average_attn_weights
Expand Down

0 comments on commit 31d3f1b

Please sign in to comment.