You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi,
Thank you for reporting this issue. We previously tested GPTQModel with the Marlin kernel. However, since the repository is under frequent development, its API may change. Additionally, it typically requires the latest version of Transformers, which can introduce compatibility issues for some models.
We will continue monitoring updates to the repository and consider switching to it when it's more stable.
Thanks
I noticed auto-round[gpu] requires AutoGPTQ. However, AutoGPTQ has been deprecated.
AutoGPTQ readme:
The text was updated successfully, but these errors were encountered: