Map-reduce in R with Amazon EMR

May 27, 2010

(This article was first published on Revolutions, and kindly contributed to R-bloggers)

There’s new video at the Video Rchive[*] of a JD Long presentation: Amazon Elastic Map-Reduce (So Easy an Economist Can Do It). I’m on a plane right now and the in-flight wi-fi isn’t quite up to playing the 30-minute video, but judging from the slides it looks like a nice, practical demonstration of getting a map-reduce computation programmed in R running on the Amazon cloud system. The code also appears quite complete: in a clever innovation, the commands to launch the Amazon instances run directly from the R code, which should eliminate a lot of the tedious command-line monkeying that typically accompanies an Amazon EC2 session. I look forward to trying it out when I’m landside.

[* Revolution Analytics sponsors the Video Rchive, which is provided as a service for the community by Drew Conway. Thanks, Drew! You can donate to the Video Rchive too, see the link in the right column of Drew’s blog.]

VCASMO/JD Long: Map-reduce in R with Amazon EMR

To leave a comment for the author, please follow the link and comment on their blog: Revolutions. offers daily e-mail updates about R news and tutorials on topics such as: Data science, Big Data, R jobs, visualization (ggplot2, Boxplots, maps, animation), programming (RStudio, Sweave, LaTeX, SQL, Eclipse, git, hadoop, Web Scraping) statistics (regression, PCA, time series, trading) and more...

If you got this far, why not subscribe for updates from the site? Choose your flavor: e-mail, twitter, RSS, or facebook...

Tags: ,

Comments are closed.


Mango solutions

RStudio homepage

Zero Inflated Models and Generalized Linear Mixed Models with R

Dommino data lab

Quantide: statistical consulting and training



CRC R books series

Six Sigma Online Training

Contact us if you wish to help support R-bloggers, and place your banner here.

Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)

Click here to close (This popup will not appear again)