Stochastic approximation in mixtures

February 22, 2011

(This article was first published on Xi'an's Og » R, and kindly contributed to R-bloggers)

On Friday, a 2008 paper on Stochastic Approximation and Newton’s Estimate of a Mixing Distribution by Ryan Martin and J.K. Ghosh was posted on arXiv. (I do not really see why it took so long to post on arXiv a 2008 Statistical Science paper but given that it is not available on project Euclid, it may be that not all papers in Statistical Science are published immediately. Anyway, this is irrelevant to my point here!).

The paper provides a very nice introduction to stochastic approximation methods, making the link to recent works by Christophe Andrieu, Heikki Haario, Faming Liang, Eric Moulines, Enro Saksman, and co-authors. Martin and Ghosh also reinterpret Newton-Raphson as a special case of stochastic approximation. The whole paper is very pleasant to read, quite in tune with Statistical Science. I will most certainly use this material in my graduate courses and also include part of it in the revision of Monte Carlo Statistical Methods.

Filed under: R, Statistics Tagged: J.K. Ghosh, mixtures, Newton-Raphson, Robbins-Monro, Statistical Science, stochastic approximation

To leave a comment for the author, please follow the link and comment on their blog: Xi'an's Og » R. offers daily e-mail updates about R news and tutorials on topics such as: Data science, Big Data, R jobs, visualization (ggplot2, Boxplots, maps, animation), programming (RStudio, Sweave, LaTeX, SQL, Eclipse, git, hadoop, Web Scraping) statistics (regression, PCA, time series, trading) and more...

If you got this far, why not subscribe for updates from the site? Choose your flavor: e-mail, twitter, RSS, or facebook...

Tags: , , , , , , ,

Comments are closed.


Mango solutions

RStudio homepage

Zero Inflated Models and Generalized Linear Mixed Models with R

Quantide: statistical consulting and training


CRC R books series

Contact us if you wish to help support R-bloggers, and place your banner here.

Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)

Click here to close (This popup will not appear again)