We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Currently AcceleratorMetadata (a typed dict) has the following fields:
AcceleratorMetadata
class AcceleratorMetadata(TypedDict): slot_name: str description: str human_readable_name: str display_unit: str number_format: AcceleratorNumberFormat display_icon: str
Let’s expand the metadata to provide additional information like:
cuda_compute_capability
host_cuda_driver_version
This information could be used to choose the appropriate models and their runtimes in future model player implementations.
E4M3
E5M2
The text was updated successfully, but these errors were encountered:
achimnol
No branches or pull requests
Currently
AcceleratorMetadata
(a typed dict) has the following fields:Let’s expand the metadata to provide additional information like:
cuda_compute_capability
,host_cuda_driver_version
This information could be used to choose the appropriate models and their runtimes in future model player implementations.
Reference
Pytorch
E4M3
orE5M2
) (Hopper architecture)The text was updated successfully, but these errors were encountered: