Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Simple reloo wrapper #34

Open
ParadaCarleton opened this issue Sep 4, 2021 · 2 comments
Open

Simple reloo wrapper #34

ParadaCarleton opened this issue Sep 4, 2021 · 2 comments

Comments

@ParadaCarleton
Copy link
Member

Would be nice to have a way to easily refit folds with high Pareto k values. Mentioning @sethaxen because I know ArviZ.jl has this set up; do you know how/if we could get something similar into ParetoSmooth?

@sethaxen
Copy link
Member

sethaxen commented Sep 6, 2021

On the Python side, ArviZ does indeed have reloo for some PPLs. It's implementation is PPL-specific, one approach per supported PPL. ArviZ.jl hasn't added anything like this for Julia PPLs yet. The closest I've gotten is arviz-devs/ArviZ.jl#133, and resampling wasn't on my mind then.

I think the Julian way to handle this would be to use a PPL-agnostic interface, and I'm wondering if AbstractPPL can become that interface. I think what we need are more examples of partial implementations of PPL-agnostic diagnostic/statistic/plotting functions in order to find patterns of what the interface needs. I previously did so for simulation-based calibration, and I wonder if it might be helpful to do the same for reloo.

@ParadaCarleton
Copy link
Member Author

Mmm, I see. Probably something like going through AbstractPPL would be better, yeah.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants