Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ENH] Calibration plot (add performance curves) and a new Calibrated Learner widget #3881

Merged
merged 21 commits into from
Jul 12, 2019
Merged

[ENH] Calibration plot (add performance curves) and a new Calibrated Learner widget #3881

Changes from 1 commit
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
35a6f4b
Calibration plot: Add plots of ca, sens/spec, prec/recall, ppv/npv
janezd Jun 13, 2019
2fa1750
Calibration plot: Add threshold line
janezd Jun 13, 2019
d47b68b
Calibration plot: Refactor computation of metrics
janezd Jun 13, 2019
585feb2
Testing: Keep 2d array of models when splitting Results by models
janezd Jun 13, 2019
7b876e6
Test Learners: Store models when there is just one; properly stack them
janezd Jun 13, 2019
93b7a72
classification: Add ModelWithThreshold
janezd Jun 13, 2019
ff67b49
Calibration plot: Output selected model
janezd Jun 13, 2019
a4424fb
Orange.evaluation.performance_curves: Add module for computation of p…
janezd Jun 16, 2019
6024897
Calibration plot: Use Orange.evaluation.testing.performance_curves to…
janezd Jun 16, 2019
1cfbeec
Calibration plot: Fix selected model output
janezd Jun 17, 2019
f742ff9
OWLearnerWidget: Let default name appear as placeholder. This allows …
janezd Jun 17, 2019
c5d070d
evaluations.testing: Minor fixes in unit tests
janezd Jun 17, 2019
557fa2e
OWTestLearners: Skip inactive signals (e.g. learner widget outputs None)
janezd Jun 17, 2019
1a8b013
Calibrated Learner: Add widget
janezd Jun 17, 2019
6ac1db1
Calibration plot: Add context settings
janezd Jun 17, 2019
2edcb39
OWCalibration Plot: Unit tests and some fixes
janezd Jun 18, 2019
2049afa
Calibration plot: Test missing probabilities and single classes
janezd Jun 19, 2019
04d05f4
Calibration plot: Minor fixes
janezd Jun 24, 2019
6695ee9
Calibrated Learner: Fix report
janezd Jun 28, 2019
65c69e2
Calibrated Learner: Add icon
janezd Jun 28, 2019
864d7b5
Calibration plot: Nicer report
janezd Jun 28, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion Orange/evaluation/testing.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -317,7 +317,7 @@ def split_by_model(self):
res.probabilities = self.probabilities[(i,), :, :]

if self.models is not None:
res.models = self.models[:, i]
res.models = self.models[:, i:i+1]
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe this was a bug because it changed self.models from 2d to 1d array. Apparently nobody needed this so far.


res.failed = [self.failed[i]]
yield res
Expand Down