Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AutoGPTQ is deprecated #428

Open
Almenon opened this issue Feb 6, 2025 · 2 comments
Open

AutoGPTQ is deprecated #428

Almenon opened this issue Feb 6, 2025 · 2 comments

Comments

@Almenon
Copy link

Almenon commented Feb 6, 2025

I noticed auto-round[gpu] requires AutoGPTQ. However, AutoGPTQ has been deprecated.

AutoGPTQ readme:

🚨 AutoGPTQ development has stopped. Please switch to GPTQModel as drop-in replacement. 🚨

@Almenon
Copy link
Author

Almenon commented Feb 6, 2025

@wenhuach21
Copy link
Contributor

wenhuach21 commented Feb 6, 2025

Hi,
Thank you for reporting this issue. We previously tested GPTQModel with the Marlin kernel. However, since the repository is under frequent development, its API may change. Additionally, it typically requires the latest version of Transformers, which can introduce compatibility issues for some models.
We will continue monitoring updates to the repository and consider switching to it when it's more stable.
Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants