**M**atti Vihola has posted a new paper on arXiv about adaptive (random walk) Metropolis-Hastings algorithms. The update in the (lower diagonal) scale matrix is

where

- is the current acceptance probability and the target acceptance rate;
- is the current random noise for the proposal, ;
- is a step size sequence decaying to zero.

The spirit of the adaptation is therefore a Robbins-Monro type adaptation of the covariance matrix in the random walk, with a target acceptance rate. It follows the lines Christophe Andrieu and I had drafted in our [most famous!] unpublished paper, Controlled MCMC for optimal sampling. The current paper shows that the fixed point for is proportional to the scale of the target if the latter is elliptically symmetric (but does not establish a sufficient condition for convergence). It concludes with a Law of Large Numbers for the empirical average of the under rather strong assumptions (on *f*, the target, and the matrices ). The simulations run on formalised examples show a clear improvement over the existing adaptive algorithms (see above) and the method is implemented within Matti Vihola’s Grapham software. I presume Matti will present this latest work during his invited talk at Adap’skiii.

**Ps-**Took me at least 15 minutes to spot the error in the above La_{T}eX formula, ending up with *S^text{T}_{n−1}*: Copy-pasting from the pdf file had produced an unconventional minus sign in *n−1 *that was impossible to spot!

Filed under: R, Statistics Tagged: acceptance rate, Adapski, adaptive MCMC methods, controlled MCMC, Grapham, LaTeX, Metropolis-Hastings

*Related*

To

**leave a comment** for the author, please follow the link and comment on their blog:

** Xi'an's Og » R**.

R-bloggers.com offers

**daily e-mail updates** about

R news and

tutorials on topics such as: visualization (

ggplot2,

Boxplots,

maps,

animation), programming (

RStudio,

Sweave,

LaTeX,

SQL,

Eclipse,

git,

hadoop,

Web Scraping) statistics (

regression,

PCA,

time series,

trading) and more...

If you got this far, why not

__subscribe for updates__ from the site? Choose your flavor:

e-mail,

twitter,

RSS, or

facebook...

**Tags:** acceptance rate, Adapski, adaptive MCMC methods, controlled MCMC, Grapham, LaTex, Metropolis-Hastings, R, statistics