Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add spaCy en-core-web-lg #29

Closed
wants to merge 1 commit into from

Conversation

tomaz-suller
Copy link

spaCy models are distributed as wheels on GitHub releases, and so they are not made available in either Conda or PyPI, which is why this addition references wheel file in the release directly.

We use the model to pre-process narrative text before modelling.

@klwetstone
Copy link
Collaborator

@tomaz-suller There are a few releases of spacy-model-en-core-web-lg on conda, eg. here and here. It looks like version 3.7.x is not available, but versions 3.8 and 3.5 are. Would that work for your solution? Installing via conda is preferable if at all possible.

@tomaz-suller
Copy link
Author

Thanks for the pointers. I was bit afraid of those conda packages since I didn't know their precedence, and since they are not an official form of distribution. You could say I'm a bit afraid of supply-chain attacks, even if for no reason.

Anyway, I've found a way around this by packing the model along with the submission, which doesn't require modifying the runtime, and I was able to submit that way, so I'm closing this PR.

For reference, instructions on how to do that are here.

@klwetstone
Copy link
Collaborator

Excellent! I'm glad it worked out.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants