-
Notifications
You must be signed in to change notification settings - Fork 124
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
README: add example for using local model wtth docker container #528
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
PR Summary
Added a new section to the README.md demonstrating how to use local models with Docker containers, providing clear instructions for mounting and utilizing locally stored models in the Infinity framework.
- Added example in
README.md
showing how to clone and mount HuggingFace models into Docker containers - Included command-line example for mounting local model directory using Docker volumes
- Added explanation for using local models with the
--model-id
parameter
1 file(s) reviewed, no comment(s)
Edit PR Review Bot Settings | Greptile
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Requires ‘git install git-lfs’ otherwise git clone won’t clone large files.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good point. git lfs install
? https://git-lfs.com/
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ah, you added it already!
Codecov ReportAll modified and coverable lines are covered by tests ✅
❗ Your organization needs to install the Codecov GitHub app to enable full functionality. Additional details and impacted files@@ Coverage Diff @@
## main #528 +/- ##
==========================================
- Coverage 79.86% 79.80% -0.06%
==========================================
Files 43 43
Lines 3486 3486
==========================================
- Hits 2784 2782 -2
- Misses 702 704 +2 ☔ View full report in Codecov by Sentry. |
This question came up a few times already.
#527
Checklist