Skip to content

Commit

Permalink
Update quantize.py
Browse files Browse the repository at this point in the history
  • Loading branch information
Giuseppe5 authored Jan 21, 2025
1 parent a0e9f03 commit 0714261
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/brevitas_examples/common/generative/quantize.py
Original file line number Diff line number Diff line change
Expand Up @@ -396,7 +396,7 @@ def generate_quantizers(
k_transposed_quant = sym_input_quant.let(
**{
'group_dim': -2, 'group_size': input_group_size})
v_quant = q_scaled_quant
v_quant = k_transposed_quant
attn_output_weights_quant = q_scaled_quant
else:
q_scaled_quant = v_quant = k_transposed_quant = attn_output_weights_quant = sym_input_quant
Expand Down

0 comments on commit 0714261

Please sign in to comment.