Comparing standard R with Revoutions for performance

June 17, 2010

(This article was first published on CYBAEA Data and Analysis, and kindly contributed to R-bloggers)

Following on from my previous post about improving performance of R by linking with optimized linear algebra libraries, I thought it would be useful to try out the five benchmarks Revolutions Analytics have on their Revolutionary Performance pages.

For convenience I collected their tests into a single script revolution_benchmark.R that I can simply run with Rscript --vanilla revolution_benchmark.R.

The results, compared with the speed-up factors Revolution claims for their version:

Revolutions benchmarks compared with R on x86_64 system
RR + ATLASSpeed-upRevolution’s
claimed speed-up
Matrix Multiply360.969.3037.841.0
Cholesky Factorization27.285.653.821.0
Singular Value Decomposition98.7323.573.212.6
Principal Components Analysis454.5540.9210.115.2
Linear Discriminant Analysis271.4479.612.44.4

In all instances Revolution’s claimed speed-up is greater, though probably not significantly so for the Matrix Multiply test and hardly so for the Principal Components Analysis. (Of course, I do not have a copy of Revolution Analytics’ product, so I can’t verify their claims or make a comparable test.)

Whether saving 48 seconds on a linear discriminant analysis is enough to justify buying the product is a decision I leave to you: you know what analysis you do. For me, there are (many) orders of magnitudes to be gained by better algorithms and better variable selections so I am not too worried about factors of 2 or even 10. For extra raw power, I run R on a cloud service like AWS which scales well for many problems and is easy to do with stock R while I guess there are some sort of license implications if you wanted to do the same with Revolution’s product. (But I like Revolution and am still trying to find an excuse to use their product.)

Your mileage may vary.

Jump to comments.

You may also like these posts:

  1. [0.49] Faster R through better BLAS

    Can we make our analysis using the R statistical computing and analysis platform run faster? Usually the answer is yes, and the best way is to improve your algorithm and variable selection. But recently David Smith was suggesting that a big benefit of their (commercial) version of R was that it was linked to a to a better linear algebra library. So I decided to investigate. The quick summary is that it only really makes a difference for fairly artificial benchmark tests. For “normal” work you are unlikely to see a difference most of the time.

  2. [0.41] R tips: Eliminating the “save workspace image” prompt on exit

    When using R , the statistical analysis and computing platform, I find it really annoying that it always prompts to save the workspace when I exit. This is how I turn it off.

  3. [0.34] R tips: Keep your packages up-to-date

To leave a comment for the author, please follow the link and comment on his blog: CYBAEA Data and Analysis. offers daily e-mail updates about R news and tutorials on topics such as: visualization (ggplot2, Boxplots, maps, animation), programming (RStudio, Sweave, LaTeX, SQL, Eclipse, git, hadoop, Web Scraping) statistics (regression, PCA, time series, trading) and more...

If you got this far, why not subscribe for updates from the site? Choose your flavor: e-mail, twitter, RSS, or facebook...

2 Responses to Comparing standard R with Revoutions for performance

  1. spatialanalysis (James Cheshire) on June 17, 2010 at 3:39 am

    Twitter Comment

    RT @Rbloggers: Comparing standard R with Revoutions for performance: Following on from my previous… [link to post] #rstats

    Posted using Chat Catcher

  2. Rbloggers (R bloggers website) on June 17, 2010 at 4:00 am

    Twitter Comment

    Comparing standard R with Revoutions for performance: Following on from my previous… [link to post] #rstats

    Posted using Chat Catcher