Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix signed url versioning #755

Merged
merged 1 commit into from
Dec 29, 2024
Merged

Fix signed url versioning #755

merged 1 commit into from
Dec 29, 2024

Conversation

shcheklein
Copy link
Member

@shcheklein shcheklein commented Dec 28, 2024

Fixes signed URL for versioned objects (download button is broken atm in Studio for versioned buckets, video previews are probably broken since we are also generating singed URLs for them).

https://github.com/iterative/studio/pull/11128 - Studio part

TODO

Followup

Public S3 and Azure client.url() code. Similar to GS that already has a check for anon in it - we need to generate and return direct URL to the cloud storage.

Make sure along the way:

  • endpoint URLs are supported, especially for AWS
  • on the Studio side pass ms header to signed URL to get a public URL that actually works (see some SO discussions)
  • add tests

@shcheklein shcheklein changed the base branch from main to fix-versioning December 28, 2024 01:36
Copy link

codecov bot commented Dec 28, 2024

Codecov Report

Attention: Patch coverage is 93.54839% with 2 lines in your changes missing coverage. Please review.

Project coverage is 87.35%. Comparing base (1bd7f8b) to head (f404d75).
Report is 2 commits behind head on main.

Files with missing lines Patch % Lines
src/datachain/client/azure.py 85.71% 1 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #755      +/-   ##
==========================================
+ Coverage   87.29%   87.35%   +0.05%     
==========================================
  Files         116      116              
  Lines       11084    11092       +8     
  Branches     1521     1522       +1     
==========================================
+ Hits         9676     9689      +13     
+ Misses       1028     1024       -4     
+ Partials      380      379       -1     
Flag Coverage Δ
datachain 87.28% <93.54%> (+0.05%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@shcheklein shcheklein self-assigned this Dec 28, 2024
@shcheklein shcheklein added the enhancement New feature or request label Dec 28, 2024
Base automatically changed from fix-versioning to main December 28, 2024 17:33
@shcheklein shcheklein force-pushed the fix-signed-url-versioning branch from 7a4f9cd to 4333400 Compare December 28, 2024 17:49
Copy link

cloudflare-workers-and-pages bot commented Dec 28, 2024

Deploying datachain-documentation with  Cloudflare Pages  Cloudflare Pages

Latest commit: f404d75
Status: ✅  Deploy successful!
Preview URL: https://a69670fc.datachain-documentation.pages.dev
Branch Preview URL: https://fix-signed-url-versioning.datachain-documentation.pages.dev

View logs

Copy link
Contributor

@dreadatour dreadatour left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch about version! 👍
Code looks good to me, even if it is still draft 👀

@shcheklein shcheklein force-pushed the fix-signed-url-versioning branch from e9a95a9 to cbf92d1 Compare December 28, 2024 18:54
@shcheklein shcheklein force-pushed the fix-signed-url-versioning branch from cbf92d1 to 1402c6a Compare December 28, 2024 20:23
@shcheklein shcheklein force-pushed the fix-signed-url-versioning branch from 1402c6a to 4bf83b8 Compare December 28, 2024 21:32
@shcheklein shcheklein force-pushed the fix-signed-url-versioning branch from 4bf83b8 to df4e2d4 Compare December 28, 2024 21:52
@shcheklein shcheklein force-pushed the fix-signed-url-versioning branch from df4e2d4 to 6de95f0 Compare December 29, 2024 02:23
@shcheklein shcheklein force-pushed the fix-signed-url-versioning branch from 6de95f0 to 3e8e810 Compare December 29, 2024 02:25
@shcheklein shcheklein force-pushed the fix-signed-url-versioning branch from 3e8e810 to d243fdf Compare December 29, 2024 03:14
@shcheklein shcheklein force-pushed the fix-signed-url-versioning branch from d243fdf to 6179267 Compare December 29, 2024 03:22
@shcheklein shcheklein marked this pull request as ready for review December 29, 2024 03:25
@shcheklein shcheklein force-pushed the fix-signed-url-versioning branch from 84885bc to f404d75 Compare December 29, 2024 04:37
@shcheklein shcheklein merged commit e098618 into main Dec 29, 2024
34 checks passed
@shcheklein shcheklein deleted the fix-signed-url-versioning branch December 29, 2024 16:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants