Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speed up file uploading for large files #17

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

veritem
Copy link
Contributor

@veritem veritem commented Jul 10, 2021

Should fix #15 and make API faster for writing and reading!

@veritem veritem marked this pull request as draft July 10, 2021 11:39
@veritem
Copy link
Contributor Author

veritem commented Jul 10, 2021

The current implementation of just writing to an s3 bucket i just realized that it didn't scale, I found a new way of handling large content which is basically doing multipart

@veritem veritem marked this pull request as ready for review October 29, 2021 15:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

When attempting to edit dataset, told 'file does not exist'
1 participant