Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automatically split large subdirectories #2

Open
mhucka opened this issue Dec 12, 2018 · 0 comments
Open

Automatically split large subdirectories #2

mhucka opened this issue Dec 12, 2018 · 0 comments
Labels
Coding: enhancement ✨ New feature or request

Comments

@mhucka
Copy link
Collaborator

mhucka commented Dec 12, 2018

Currently, eprints2bags refuses to run if the number of records exceeds 31,998, because some file systems can't create more than 32k subdirectories. THe way the user currently has to work around that is to manually split up big jobs into separate runs and manually create separate subdirectories as needed. Eprints2bags could automatically create 2 levels of subdirectories when a run includes more than 32k entries.

@mhucka mhucka added the Coding: enhancement ✨ New feature or request label Dec 12, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Coding: enhancement ✨ New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant