Skip to content

Commit

Permalink
restore ppl
Browse files Browse the repository at this point in the history
  • Loading branch information
Giuseppe5 committed Nov 27, 2024
1 parent 35c7096 commit cf55c12
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tests/brevitas_examples/test_llm.py
Original file line number Diff line number Diff line change
Expand Up @@ -220,7 +220,7 @@ def test_small_models_toggle_run_args_pt_ge_2_4(
"act_equalization": "layerwise",
"gptq": True,
"float_ppl": 31056.0 if transformers_version_ge('4.46.0') else 31274.05078125,
"quant_ppl": 33056.0 if transformers_version_ge('4.46.0') else 31278.166015625},])
"quant_ppl": 33056.0 if transformers_version_ge('4.46.0') else 33139.23046875},])
def acc_args_and_acc(default_run_args, request):
args = default_run_args
run_dict = request.param
Expand Down

0 comments on commit cf55c12

Please sign in to comment.