774 search results for "parallel"

Introducing RcppParallel: Getting R and C++ to work (some more) in parallel

July 16, 2014
By

A common theme over the last few decades was that we could afford to simply sit back and let computer (hardware) engineers take care of increases in computing speed thanks to Moore's law. That same line of thought now frequently points out that we ar...

Read more »

Implementing mclapply() on Windows: a primer on embarrassingly parallel computation on multicore systems with R

July 14, 2014
By

An easy way to run R code in parallel on a multicore system is with the mclapply() function. Unfortunately, mclapply() does not work on Windows machines because the mclapply() implementation relies on forking and Windows does not support forking. For me, this is somewhat of a headache because I am used to using mclapply(), and

Read more »

Parallel computing in R

July 1, 2014
By
Parallel computing in R

Roughly a year ago I published an article about parallel computing in R here, in which I compared computation performance among 4 packages that provide R with parallel features once R is essentially a single-thread task package. Parallel computing is incredibly useful, but not every thing worths distribute across as many cores as possible. Actually,

Read more »

sugar in parallel

June 18, 2014
By
sugar in parallel

I've been playing with parallelising Rcpp11 implementation of sugar. For example, we have a NumericVector variable x and we want to compute e.g. sqrt(exp(x)) + 2.0. With sugar, we can do: NumericVector y = sqrt(exp(x)) + 2.0 ; and this does not...

Read more »

Rth: a Flexible Parallel Computation Package for R

June 17, 2014
By
Rth:  a Flexible Parallel Computation Package for R

I’ve been mentioning here that I’ll be discussing a new package, Rth, developed by me and Drew Schmidt, the latter of pbdR fame.  It’s now ready for use!  In this post, I’ll explain what goals Rth has, and how to use it. Platform Flexibility The key feature of Rth is in the word flexible in

Read more »

Rth: a Flexible Parallel Computation Package for R

June 17, 2014
By
Rth:  a Flexible Parallel Computation Package for R

I’ve been mentioning here that I’ll be discussing a new package, Rth, developed by me and Drew Schmidt, the latter of pbdR fame.  It’s now ready for use!  In this post, I’ll explain what goals Rth has, and how to use it. Platform Flexibility The key feature of Rth is in the word flexible in

Read more »

Hyperthreading FTW? Testing parallelization performance in R.

March 7, 2014
By
Hyperthreading FTW? Testing parallelization performance in R.

Alright, let's test some parallelization functionalities in R.The machine:MacBook Air (mid-2013) with 8 GB of RAM and the i7 CPU (Intel i7 Haswell 4650U). This CPU is hyper-threaded, meaning (at least that's my understanding of it) that it has two...

Read more »

Mumbai, Feb 2014 – HPC and Parallel R

February 17, 2014
By

(This article was first published on Rmetrics blogs, and kindly contributed to R-bloggers) To leave a comment for the author, please follow the link and comment on his blog: Rmetrics blogs. R-bloggers.com offers daily e-mail updates about R news and tutorials on topics such as: visualization (ggplot2, Boxplots, maps, animation), programming (RStudio, Sweave, LaTeX, SQL, Eclipse, git, hadoop, Web...

Read more »

Parallelizing #RStats using #make

January 30, 2014
By

In the current post, I'll show how to use R as the main SHELL of GNU-Make instead of using a classical linux shell like 'bash'. Why would you do this ? awesomeness Make-based workflow management Make-based execution with --jobs. GNU make knows how to ...

Read more »

A brief foray into parallel processing with R

January 21, 2014
By
A brief foray into parallel processing with R

I’ve recently been dabbling with parallel processing in R and have found the foreach package to be a useful approach to increasing efficiency of loops. To date, I haven’t had much of a need for these tools but I’ve started working with large datasets that can be cumbersome to manage. My first introduction to parallel

Read more »