Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🏗️ Refactor: data folder #1509

Draft
wants to merge 20 commits into
base: main
Choose a base branch
from
Draft

🏗️ Refactor: data folder #1509

wants to merge 20 commits into from

Conversation

Tansito
Copy link
Member

@Tansito Tansito commented Oct 7, 2024

Summary

TODO

Details and comments

TODO

@Tansito Tansito mentioned this pull request Oct 14, 2024
* First refactorization for files

* Completed use cases for list end-point

* Renamed storage to file_storage

* Migrated files to file_storage

* Migrated get files to the new service

* Check if function exists first

* Separated end-points to the new provider

* Improved tests

* Restore original fixtures

* Solved the problem with the external if

* Added Literal type in the FileStorage service

* functions methods refactorization

* use self.username instead of the variable

* run path sanitization only one time

* function title is mandatory for file storage

* fix black

* Updated 403 by 404

* Updated swagger for list

* Makes use of enum with integers

* use is instead of equals

* unify path build

* get_function refactor
@Tansito
Copy link
Member Author

Tansito commented Nov 21, 2024

Failing tests at this point of the development are expected. API changes will require client migrations.

@Tansito Tansito changed the title 🏗️ Data folder refactorization 🏗️ Data folder refactor Nov 27, 2024
@Tansito Tansito changed the title 🏗️ Data folder refactor 🏗️ Refactor: data folder Dec 10, 2024
korgan00 and others added 8 commits December 10, 2024 14:32
* new list files for the gateway refactor

* unify files url

* remove enum and linter

* remove provider parameter

* Check provider
* refactor of download end-points

* additional test to check non existing file

* renamed files test to v1_files

* added additional checks for the query

* included the checks in the list end-point

* include swagger documentation updated

* remove unneeded try except

* make use of regex instead of a manual parsing

* check not all instead of None

* rename file_extension_is_valid

* Update gateway/api/utils.py

Co-authored-by: Goyo <[email protected]>

---------

Co-authored-by: Goyo <[email protected]>
* add support to new delete files endpoints

* fix get parameter

* fix tests

* delete programDelete fixture

* update file_storage/remove_file description
* Update upload end-point

* removed unused imports

* updated comment in upload end-point
Tansito and others added 6 commits December 18, 2024 10:21
* add support to new upload file endpoints

* replace data with params
* add support to new delete files endpoints

* fix get parameter

* fix tests

* adapt files delete to the refactor

* replace data with params

* remove not used fixture
* add support to new delete files endpoints

* fix get parameter

* fix tests

* adapt files delete to the refactor

* replace data with params

* remove not used fixture

* tests fixed

* fix client integration

* fix context manager in files when download

* added a new test for provider end-points

* fix black

* migrated old tests

* Update gateway/api/services/file_storage.py

Co-authored-by: Goyo <[email protected]>

* remove additional line

---------

Co-authored-by: David <[email protected]>
* create a trace decorator

* fix decorator

* change documentation

---------

Co-authored-by: David <[email protected]>
* remove unneeded provider methods

* create access policies file

* refactor get_functions repository method

* refactor groups and repositories

* repository refactor from files

* fix some linter problems

* fixed a bug when the user retrieves a function

* fix lint

* refactor of get_function method

* remove artifact test file

* remove programs access policies

* refactor programs references to functions

* group repository refactor

* rename groups repository into user repository

* simplified get_function methods

* fix query

* adapt get_functions methods

* updated comments

* create path if doesn't exist

* remove some unused code

* fix files client

* fix typos

* fixed the creation of the directory

* added a test for the provider end-points

* fix some typos from the provider end-points

* fix black on tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants