Skip to content

Commit

Permalink
Fix (example/llm): Removed unnecessary intantiation kwarg
Browse files Browse the repository at this point in the history
  • Loading branch information
nickfraser committed Nov 28, 2024
1 parent 32c94b9 commit 01ef9e3
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions src/brevitas_examples/llm/main.py
Original file line number Diff line number Diff line change
Expand Up @@ -187,8 +187,6 @@ def main(args):
kwargs = {"torch_dtype": dtype}
if quant_sdpa_fx:
kwargs["attn_implementation"] = "sdpa"
elif args.replace_mha:
kwargs["attn_implementation"] = "eager"

if args.export_target == 'torch_qcdq':
kwargs['torchscript'] = True
Expand Down

0 comments on commit 01ef9e3

Please sign in to comment.