Setting up a parallel computing cluster for R with OpenSSH and doSNOW

February 25, 2011
By

(This article was first published on Revolutions, and kindly contributed to R-bloggers)

Responding to yesterday's post which included an aside on using parallel processing for by-group computations in R, reader Christian Gunning mused about the possibility of using doSNOW on his network, with OpenSSH to manage the authentication:

I sit on a fast campus network and have at least 10 remote cores available that I could farm out for big jobs. the SSHcluster method would require minimal invasion on those machines -- just ability to execute ssh and Rscript on the remote machines -- not even login privileges are required!

Well, Christian developed that idea into a step-by-step guide for setting up a multi-node cluster for parallel programming using foreach and doSNOW. Check out the full guide (including both R and shell configuration code) at the link below.

Life In Code: snow and ssh -- secure inter-machine parallelism with R

 

To leave a comment for the author, please follow the link and comment on his blog: Revolutions.

R-bloggers.com offers daily e-mail updates about R news and tutorials on topics such as: visualization (ggplot2, Boxplots, maps, animation), programming (RStudio, Sweave, LaTeX, SQL, Eclipse, git, hadoop, Web Scraping) statistics (regression, PCA, time series, trading) and more...



If you got this far, why not subscribe for updates from the site? Choose your flavor: e-mail, twitter, RSS, or facebook...

Tags: ,

Comments are closed.