Setting up AWS Cluster to use snow in R

November 8, 2011

(This article was first published on indiacrunchin » R, and kindly contributed to R-bloggers)

Setting up AWS Cluster

I wanted to setup an AWS cluster to take a shot at a Kaggle contest – DunnHumby Challenge

For this, I found StarCluster to be of great help. It allows you to set-up AWS nodes in a few lines of code and does much more (choosing AMIs and cluster configurations)

Make sure you use the Bioconductor AMI which comes bundled with R and a host of installed packages.

I used the package “snowfall” for parallel processing.

Relevant SO questions I had asked

To leave a comment for the author, please follow the link and comment on their blog: indiacrunchin » R. offers daily e-mail updates about R news and tutorials on topics such as: Data science, Big Data, R jobs, visualization (ggplot2, Boxplots, maps, animation), programming (RStudio, Sweave, LaTeX, SQL, Eclipse, git, hadoop, Web Scraping) statistics (regression, PCA, time series, trading) and more...

If you got this far, why not subscribe for updates from the site? Choose your flavor: e-mail, twitter, RSS, or facebook...

Comments are closed.


Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)

Click here to close (This popup will not appear again)