Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for PANDERA_VALIDATION_ENABLED for pandas and Configuration docs #1354

Merged
merged 4 commits into from
Dec 4, 2023

Conversation

noklam
Copy link
Contributor

@noklam noklam commented Sep 27, 2023

fixing #1345 (ready for review)

@noklam noklam changed the title Add support for PANDERA_VALIDATION_ENABLED for pandas and Configuration docs Add support for PANDERA_VALIDATION_ENABLED for pandas and Configuration docs Sep 27, 2023
@codecov
Copy link

codecov bot commented Sep 27, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (d46b3b9) 93.91% compared to head (e28d2a2) 94.24%.
Report is 22 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1354      +/-   ##
==========================================
+ Coverage   93.91%   94.24%   +0.32%     
==========================================
  Files          91       91              
  Lines        6772     6982     +210     
==========================================
+ Hits         6360     6580     +220     
+ Misses        412      402      -10     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@cosmicBboy
Copy link
Collaborator

Thanks for the PR @noklam! Let me know when you need a review

Signed-off-by: Nok Lam Chan <[email protected]>
Signed-off-by: Nok <[email protected]>
@noklam noklam closed this Oct 29, 2023
@noklam noklam reopened this Oct 29, 2023
@noklam noklam marked this pull request as ready for review October 29, 2023 01:12
@noklam
Copy link
Contributor Author

noklam commented Oct 29, 2023

@cosmicBboy It's ready for review now

@@ -345,6 +346,9 @@ def validate(
4 0.80 dog
5 0.76 dog
"""
if not CONFIG.validation_enabled:
return
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this should return the original dataframe, as a call to schema.validate must still return a dataframe.

@@ -426,6 +426,9 @@ def validate( # type: ignore [override]
dtype: float64

"""
if not CONFIG.validation_enabled:
return
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should return the original dataframe

@cosmicBboy
Copy link
Collaborator

just left a comment @noklam, those should actually handle the mypy linting error.

@ldnicolasmay
Copy link

We were just talking about this feature yesterday! Thanks for working on this @noklam, @derinwalters, @filipeo2-mck, @mjgp2 & @cosmicBboy 👍

@noklam noklam requested a review from cosmicBboy November 3, 2023 16:59
@noklam
Copy link
Contributor Author

noklam commented Nov 3, 2023

need approval to start the CI.

@cosmicBboy
Copy link
Collaborator

still some CI errors. be sure to set up pre-commit to make sure those pass

@noklam
Copy link
Contributor Author

noklam commented Nov 13, 2023

pre-commit run --all-files. I run this to confirm no more linting issue. Hope this should pass CI now.

@noklam
Copy link
Contributor Author

noklam commented Nov 22, 2023

pinging @cosmicBboy

@cosmicBboy
Copy link
Collaborator

thanks @noklam and congrats on your first PR to pandera! 🚀

@cosmicBboy cosmicBboy merged commit fbdc6a0 into unionai-oss:main Dec 4, 2023
55 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants