-
Notifications
You must be signed in to change notification settings - Fork 112
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow MapieRegressor
to use any split strategy
#386
Conversation
This PR also tidies things up a bit: the tests specific to CQR have been moved to the dedicated file (from |
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #386 +/- ##
==========================================
Coverage 100.00% 100.00%
==========================================
Files 39 39
Lines 4616 4633 +17
Branches 487 762 +275
==========================================
+ Hits 4616 4633 +17 ☔ View full report in Codecov by Sentry. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good PR! Thank you @thibaultcordier 😀
I am a little worried about adding another fit_attributes
for custom algorithms. What do you think?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Everything is fine, let's merge !
Description
Split-CP is only available with
"split"
keyword orShuffleSplit
class of scikit-learn.This PR proposes to use more compatible split
BaseCrossValidator
/BaseShuffleSplit
.In practice, we need to use the predictions aggregation for cross-CPs and not for split-CPs. All you need to do is find out the number of splits using the
get_n_splits
method to know whether it's a split or a cross.Fixes #385
Type of change
How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration
check_no_agg_cv
MapieRegressor
Checklist
make lint
make type-check
make tests
make coverage
make doc