# Hyper-g priors

**Xi'an's Og » R**, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here)

Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.

**E**arlier this month, Daniel Sabanés Bové and Leo Held posted a paper about *g*-priors on arXiv. While I glanced at it for a few minutes, I did not have the chance to get a proper look at it till last Sunday. The *g*-prior was first introduced by the *late* Arnold Zellner for (standard) linear models, but they can be extended to generalised linear models (formalised by the *late* John Nelder) at little cost. In * Bayesian Core*, Jean-Michel Marin and I do centre the prior modelling in both linear and generalised linear models around

*g*-priors, using the naïve extension for generalised linear models,

as in the linear case. Indeed, the reasonable alternative would be to include the true information matrix but since it depends on the parameter outside the normal case this is not truly an alternative. Bové and Held propose a slightly different version

where ** W** is a diagonal weight matrix and

*c*is a family dependent scale factor evaluated at the mode

*. As in Liang et al. (2008, JASA) and most of the current literature, they also separate the intercept from the other regression coefficients. They also burn their “improperness joker” by choosing a flat prior on , which means they need to use a proper prior on*

**0***g*, again as Liang et al. (2008, JASA), for the corresponding Bayesian model comparison to be valid. In

*, we do not separate from the other regression coefficients and hence are left with one degree of freedom that we spend in choosing an improper prior on*

**Bayesian Core***g*instead. (Hence I do not get the remark of Bové and Held that our choice “prohibits Bayes factor comparisons with the null model“. As argued in

*, the factor g being an hyperparameter shared by all models, we can use the same improper prior on*

**Bayesian Core***g*in all models and hence use standard Bayes factors.) In order to achieve closed form expressions, the authors use Cui and George ‘s (2008) prior

which requires the two hyper-hyper-parameters *a* and *b* to be specified.

**T**he second part of the paper considers computational issues. It compares the ILA solution of Rue, Martino and Chopin (2009, Series B) with an MCMC solution based on an independent proposal on g resulting from linear interpolations (?). The marginal likelihoods are approximated by Chib and Jeliazkov (2001, JASA) for the MCMC part. Unsurprisingly, ILA does much better, even with a 97% acceptance rate in the MCMC algorithm.

**T**he paper is very well-written and quite informative about the existing literature. It also uses the Pima Indian dataset (The authors even dug out a 1991 paper of mine I had completely forgotten!) I am actually thinking of using the review in our revision of * Bayesian Core*, even though I think we should stick to our choice of including within the set of parameters…

Filed under: Books, R, Statistics Tagged: Arnold Zellner, Bayesian Core, Bayesian model choice, g-prior, GLMs, ILA, MCMC

**leave a comment**for the author, please follow the link and comment on their blog:

**Xi'an's Og » R**.

R-bloggers.com offers

**daily e-mail updates**about R news and tutorials about learning R and many other topics. Click here if you're looking to post or find an R/data-science job.

Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.