Skip to content

Commit

Permalink
Fix helper
Browse files Browse the repository at this point in the history
  • Loading branch information
Giuseppe5 committed Jan 29, 2025
1 parent 60f1f0b commit d9e4dcf
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion src/brevitas_examples/llm/main.py
Original file line number Diff line number Diff line change
Expand Up @@ -783,7 +783,9 @@ def parse_args(args, override_defaults={}):
type=str,
default=None,
choices=['per_tensor', 'per_row', 'per_group'],
help='Granularity for scales/zero-point of inputs. Default: per_tensor.')
help=
'Granularity for scales/zero-point of KV cache. If not set, it will use input-quant-granularity. Default: %(default)s'
)
parser.add_argument(
'--input-group-size',
type=int,
Expand Down

0 comments on commit d9e4dcf

Please sign in to comment.