Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Report posterior probability of each proposed axiom in a solution #335

Open
cmungall opened this issue Feb 3, 2023 · 0 comments
Open

Report posterior probability of each proposed axiom in a solution #335

cmungall opened this issue Feb 3, 2023 · 0 comments

Comments

@cmungall
Copy link
Contributor

cmungall commented Feb 3, 2023

currently we report the posterior probability of the solution, and the prior probability of each axiom

we should report the posterior of each axiom. We do this by taking the sum of all solutions that include that axiom, and dividing that by the sum of probabilities of solutions that have a different interpretation.

If not all solutions are explored this will be an estimate. The estimate will be biased in favor of those with higher probabilities, as lower priorities may never be explored. We can account for this with a prior probability that the solution is biased

Pr(Axiom) = IsBiasedPrior * AxiomPrior + (1-IsBiasedPrior) * AxiomEstimatedPosterior

We can estimate IsBiasedPrior based on how many times the axiom or its alternatives were explored in the overall search tree.

We can also have strategies to minimize bias. E.g for each potential axiom we start at least one search with that as our initial choice.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant