Survey: R used by more data miners than any other tool

March 11, 2011
By

According to respondents of the 2010 Rexer Analytics Data Miner Survey, open source R is the most commonly-used analysis tool amongst data miners: After a steady rise across the past few years, the open source data mining software R overtook other tools to become the tool used by more data miners (43%) than any other. STATISTICA, which has also...

Read more »

Plotting Indifference Curves with R Contour Function

March 11, 2011
By
Plotting Indifference Curves with R Contour Function

The following post at Constructing Difference Curves - Part 3 from economics.about.com provides a discussion on indifference curves (but actually I think they are isoquants) and how to construct them. I think I have a grasp on how to do this in R if yo...

Read more »

Script for Geostatistics with R

March 11, 2011
By

I received requests for the script used during the tutorial.All the material is available in the main page of the course.However, in order to facilitate the availability of the scripts to all the viewers of this blog I've put the link to donwnload them...

Read more »

Script for Geostatistics with R

March 11, 2011
By

I received requests for the script used during the tutorial.All the material is available in the main page of the course.However, in order to facilitate the availability of the scripts to all the viewers of this blog I've put the link to donwnload them...

Read more »

ggheat : a ggplot2 style heatmap function

March 11, 2011
By
ggheat  :  a ggplot2 style heatmap function

I hope the code here is fairly self-explanatory with the inset annotations. I feel this is just a bit 'prettier' than heatmap.2 and has for me the right balance of options and extensibility. I have also found it difficult to produce high quality plots...

Read more »

Programming Outside the Box: A Recursive Function in R

March 11, 2011
By
Programming Outside the Box: A Recursive Function in R

I heard a talk given by Ruby creator Yukihiro Matsumoto where he was rambling about how he came about becoming a programming language developer. He mentioned an important milestone as being his grasp of the idea behind recursion. I've kept that in mind...

Read more »

Review: R Graphs Cookbook by Hrishi Mittal

March 11, 2011
By
Review: R Graphs Cookbook by Hrishi Mittal

Summary: Very useful for reference while producing graphs, and very comprehensive (including heat-maps, 3D graphs and maps). Reference: Mittal, H. V., 2011, R Graph Cookbook, Packt Publishing, Birmingham, UK, 272 pages,  Publisher’s Website As a scientist I often need to plot graphs of my data, so I am keen to learn more about how to

Read more »

Copula Functions, R, and the Financial Crisis

March 10, 2011
By
Copula Functions, R, and the Financial Crisis

From: In defense of the Gaussian copula, The Economist"The Gaussian copula provided a convenient way to describe a relationship that held under particular conditions. But it was fed data that reflected a period when housing prices were not correlated to the extent that they turned out to be when the housing bubble popped."Decisions about...

Read more »

Analyzing big data with Revolution R Enterprise

March 10, 2011
By

This post from Sherry LaMonica is the first in a series from members of the Revolution Analytics Engineering team — ed. Do you know about the big data capabilities in the RevoScaleR package, included with every Revolution R Enterprise installation? RevoScaleR provides a framework for fast and efficient multi-core processing of large data sets. You can visualize and model...

Read more »

Comparison of GISS LOTAs During 5 El Nino – La Nina Cycles

March 10, 2011
By
Comparison of GISS LOTAs During 5 El Nino – La Nina Cycles

In this post I compare GISS LOTAs during 5 El Nino – La Nina cycles (2010, 1998, 19883, 1973 and 1970). El Nino – La Nina Cycles In a previous post I showed the Nino 34 SSTA cycles for 2010, … Continue reading →

Read more »

An easier to use IV regression command in R

March 10, 2011
By
An easier to use IV regression command in R

Update: I have added some functionality to my ivregress() command. Check out my newer post here.After I posted my last video tutorial on how to use my IV regression function, I received a comment asking why I didn't write the command a different way t...

Read more »

Comparing two-dimensional data sets in R; take II

March 10, 2011
By
Comparing two-dimensional data sets in R; take II

David commented on yesterday's post and suggested to put the continuous fitted distribution in the background and the discrete, empirical distribution in the foreground. This looks quite nice, although there's a slight optical illusion that makes the c...

Read more »

Comparing two-dimensional data sets in R; take II

March 10, 2011
By
Comparing two-dimensional data sets in R; take II

David commented on yesterday's post and suggested to put the continuous fitted distribution in the background and the discrete, empirical distribution in the foreground. This looks quite nice, although there's a slight optical illusion that makes the c...

Read more »

Beeswarm Boxplot (and plotting it with R)

March 10, 2011
By
Beeswarm Boxplot (and plotting it with R)

(The image above is called a “Beeswarm Boxplot” , the code for producing this image is provided at the end of this post) The above plot is implemented under different names in different softwares. This “Scatter Dot Beeswarm Box Violin – plot” (in the lack of an agreed upon term) is a one-dimensional scatter plot

Read more »

R: Drop factor levels in a dataset

March 9, 2011
By

R has factors, which are very cool (and somewhat analogous to labeled levels in Stata). Unfortunately, the factor list sticks around even if you remove some data such that no examples of a particular level still exist# Create some fake datax levels(x)x levels(x) # still the same levelstable(x) # even though one level has 0 entries!The solution is...

Read more »

Howling Winds and Stochastic Tones

March 9, 2011
By
Howling Winds and Stochastic Tones

My greatest pleasures in mathematics come from observing--and here, listening to--the interplay of simple and complex. With a few axioms and definitions you can create surprising worlds, and in what seems like a mess you can find beautiful regularities. It's damn sexy, frankly. Here, I use a simple recursive equation to directly generate my sounds

Read more »

The R-Files: Call for Nominations

March 9, 2011
By

We run an occasional series here on Revolutions called The R-Files, in which we profile members of the R community. Our intention with this series is to call out noteworthy work being done for open-source R and popular CRAN packages, and shine a light on some of the noteworthy individuals that make up what is now a broad community...

Read more »

Special issue of TOMACS

March 9, 2011
By
Special issue of TOMACS

TOMACS (ACM Transactions on Modeling and Computer Simulation) is launching a call for paper submission. The special topic is Monte Carlo Methods in Statistics and Arnaud Doucet and myself are the special issue editors. Here are the details.: Over the last two decades Monte Carlo methods have attracted much attention from statisticians as they provide

Read more »

Tips on installing R extension for Rapidminer on Mac OS X

March 9, 2011
By
Tips on installing R extension for Rapidminer on Mac OS X

Rapidminer is a cool toy to play with machine-learning/data-mining algorithms and it can interface with R. However, it was a bit problematic for me to get the R extension working properly on Mac OS X Leopard for R 2.11. Here is what works for me at the...

Read more »

Tips on installing R extension for Rapidminer on Mac OS X

March 9, 2011
By
Tips on installing R extension for Rapidminer on Mac OS X

Rapidminer is a cool toy to play with machine-learning/data-mining algorithms and it can interface with R. However, it was a bit problematic for me to get the R extension working properly on Mac OS X Leopard for R 2.11. Here is what works for me at the...

Read more »

In case you missed it: February Roundup

March 9, 2011
By

In case you missed them, here are some articles from February of particular interest to R users. Revolution R Enterprise 4.2 is now available to subscribers, and for free download to academics. A brief report from the Strata: Working with Data conference, and a comprehensive review from Ted Leung. A profile of prolific R contributor, Dirk Eddelbuettel. A list...

Read more »

Comparing two-dimensional data sets in R

March 9, 2011
By
Comparing two-dimensional data sets in R

I wanted to fit a continuous function to a discrete 2D distribution in R. I managed to do this by using nls, and wanted to display the data. I discovered a nice way to compare the actual data and the fit using ggplot2, where the background is the real ...

Read more »

Comparing two-dimensional data sets in R

March 9, 2011
By
Comparing two-dimensional data sets in R

I wanted to fit a continuous function to a discrete 2D distribution in R. I managed to do this by using nls, and wanted to display the data. I discovered a nice way to compare the actual data and the fit using ggplot2, where the background is the real ...

Read more »

Forest plots using R and ggplot2

March 9, 2011
By
Forest plots using R and ggplot2

Abhijit over at Stat Bandit posted some nice code for making forest plots using ggplot2 in R. You see these lots of times in meta-analyses, or as seen in the BioVU demonstration paper. The idea is simple - on the x-axis you have the odds ratio (or what...

Read more »

Forest plots using R and ggplot2

March 9, 2011
By

Abhijit over at Stat Bandit posted some nice code for making forest plots using ggplot2 in R. You see these lots of times in meta-analyses, or as seen in the BioVU demonstration paper. The idea is simple - on the x-axis you have the odds ratio (or what...

Read more »

My First Few Days with RStudio

March 9, 2011
By
My First Few Days with RStudio

As most readers are probably aware, the free IDE for R, called RStudio, was recently released for general use and it immediately made huge waves within the R community. IDE stands for Integrated Development Environment. IDEs typically provides a rich set tools developing in some target language. For standard programming languages like C++ (VisualStudio) and Java (Eclipse or NetBeans),...

Read more »

Playing with quantiles, part 2

March 8, 2011
By
Playing with quantiles, part 2

It is common to look at best time at the Marathon. Or perhaps the distribution of the top100, as done by John Myles White on his blog here (data can be found there), as the graph below, with the density of the time for the first 100 men (in blue) a...

Read more »

Playing with quantiles, part 1

March 8, 2011
By
Playing with quantiles, part 1

A standard idea in extreme value theory (see e.g. here, in French unfortunately) is that to estimate the 99.5% quantile (say), we just need to estimate a quantile of level 95% for observations exceeding the 90% quantile. In extreme value theory,...

Read more »

Ascii code table in R

March 8, 2011
By

A quick method to enumerate the printable ascii characters with their hex & decimal values.The following code relies on taking the "raw" value of a base 10 int (this gives a hex value), and then using the builtin function rawToChar, which gives a character. You can of course change the range (up to 255). Not sure and haven't tested,...

Read more »