Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v2024-06-26: Typo in 3.8.3.2 "Harmonic Mean Estimator" (p. 121/122) #339

Open
BlackHC opened this issue Sep 1, 2024 · 0 comments
Open

Comments

@BlackHC
Copy link

BlackHC commented Sep 1, 2024

The text currently says that the samples are from the prior. However, the samples need to be from the posterior as the derivation in eq (3.284) ff shows.

So, the required changes are:

  1. $\theta_s \sim p(\theta \mid \mathcal{D})$ are samples from the posterior.
  2. Strike "(We have assumed the prior is proper, so it integrates to 1.)"
  3. Rewrite the following sentence by citing Radford Neal's blog post more directly maybe:

    It’s easy to see why this estimator can’t possibly work well in practice. As is well-known, the posterior distribution for a Bayesian model is often much narrower than the prior, and it is often not very sensitive to what the prior is, as long as the prior is broad enough to encompass the region with high likelihood. [...] Since the prior affects the harmonic mean estimate of the marginal likelihood only through its effect on the posterior distribution, it follows that the harmonic mean estimate is very likely to be virtually the same for the two priors, for any reasonable size sample from the posterior. [...] The harmonic mean method is clearly hopelessly inaccurate.

Here is the relevant excerpt from the current book draft/PDF:

image
@BlackHC BlackHC changed the title Typo in 3.8.3.2 "Harmonic Mean Estimator" v2024-06-26: Typo in 3.8.3.2 "Harmonic Mean Estimator" (p. 121/122) Sep 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant