## Comparison of GISS LOTAs During 5 El Nino – La Nina Cycles

March 10, 2011
By

In this post I compare GISS LOTAs during 5 El Nino – La Nina cycles (2010, 1998, 19883, 1973 and 1970). El Nino – La Nina Cycles In a previous post I showed the Nino 34 SSTA cycles for 2010, … Continue reading →

## An easier to use IV regression command in R

March 10, 2011
By

Update: I have added some functionality to my ivregress() command. Check out my newer post here.After I posted my last video tutorial on how to use my IV regression function, I received a comment asking why I didn't write the command a different way t...

## Comparing two-dimensional data sets in R; take II

March 10, 2011
By

David commented on yesterday's post and suggested to put the continuous fitted distribution in the background and the discrete, empirical distribution in the foreground. This looks quite nice, although there's a slight optical illusion that makes the c...

## Comparing two-dimensional data sets in R; take II

March 10, 2011
By

David commented on yesterday's post and suggested to put the continuous fitted distribution in the background and the discrete, empirical distribution in the foreground. This looks quite nice, although there's a slight optical illusion that makes the c...

## Beeswarm Boxplot (and plotting it with R)

March 10, 2011
By

(The image above is called a “Beeswarm Boxplot” , the code for producing this image is provided at the end of this post) The above plot is implemented under different names in different softwares. This “Scatter Dot Beeswarm Box Violin – plot” (in the lack of an agreed upon term) is a one-dimensional scatter plot

## R: Drop factor levels in a dataset

March 9, 2011
By

R has factors, which are very cool (and somewhat analogous to labeled levels in Stata). Unfortunately, the factor list sticks around even if you remove some data such that no examples of a particular level still exist# Create some fake datax levels(x)x levels(x) # still the same levelstable(x) # even though one level has 0 entries!The solution is...

## Howling Winds and Stochastic Tones

March 9, 2011
By

My greatest pleasures in mathematics come from observing--and here, listening to--the interplay of simple and complex. With a few axioms and definitions you can create surprising worlds, and in what seems like a mess you can find beautiful regularities. It's damn sexy, frankly. Here, I use a simple recursive equation to directly generate my sounds

## The R-Files: Call for Nominations

March 9, 2011
By

We run an occasional series here on Revolutions called The R-Files, in which we profile members of the R community. Our intention with this series is to call out noteworthy work being done for open-source R and popular CRAN packages, and shine a light on some of the noteworthy individuals that make up what is now a broad community...

## Special issue of TOMACS

March 9, 2011
By

TOMACS (ACM Transactions on Modeling and Computer Simulation) is launching a call for paper submission. The special topic is Monte Carlo Methods in Statistics and Arnaud Doucet and myself are the special issue editors. Here are the details.: Over the last two decades Monte Carlo methods have attracted much attention from statisticians as they provide

## Tips on installing R extension for Rapidminer on Mac OS X

March 9, 2011
By

Rapidminer is a cool toy to play with machine-learning/data-mining algorithms and it can interface with R. However, it was a bit problematic for me to get the R extension working properly on Mac OS X Leopard for R 2.11. Here is what works for me at the...

## Tips on installing R extension for Rapidminer on Mac OS X

March 9, 2011
By

Rapidminer is a cool toy to play with machine-learning/data-mining algorithms and it can interface with R. However, it was a bit problematic for me to get the R extension working properly on Mac OS X Leopard for R 2.11. Here is what works for me at the...

## In case you missed it: February Roundup

March 9, 2011
By

In case you missed them, here are some articles from February of particular interest to R users. Revolution R Enterprise 4.2 is now available to subscribers, and for free download to academics. A brief report from the Strata: Working with Data conference, and a comprehensive review from Ted Leung. A profile of prolific R contributor, Dirk Eddelbuettel. A list...

## Comparing two-dimensional data sets in R

March 9, 2011
By

I wanted to fit a continuous function to a discrete 2D distribution in R. I managed to do this by using nls, and wanted to display the data. I discovered a nice way to compare the actual data and the fit using ggplot2, where the background is the real ...

## Comparing two-dimensional data sets in R

March 9, 2011
By

I wanted to fit a continuous function to a discrete 2D distribution in R. I managed to do this by using nls, and wanted to display the data. I discovered a nice way to compare the actual data and the fit using ggplot2, where the background is the real ...

## Forest plots using R and ggplot2

March 9, 2011
By

Abhijit over at Stat Bandit posted some nice code for making forest plots using ggplot2 in R. You see these lots of times in meta-analyses, or as seen in the BioVU demonstration paper. The idea is simple - on the x-axis you have the odds ratio (or what...

## Forest plots using R and ggplot2

March 9, 2011
By

Abhijit over at Stat Bandit posted some nice code for making forest plots using ggplot2 in R. You see these lots of times in meta-analyses, or as seen in the BioVU demonstration paper. The idea is simple - on the x-axis you have the odds ratio (or what...

## My First Few Days with RStudio

March 9, 2011
By

As most readers are probably aware, the free IDE for R, called RStudio, was recently released for general use and it immediately made huge waves within the R community. IDE stands for Integrated Development Environment. IDEs typically provides a rich set tools developing in some target language. For standard programming languages like C++ (VisualStudio) and Java (Eclipse or NetBeans),...

## Playing with quantiles, part 2

March 8, 2011
By

It is common to look at best time at the Marathon. Or perhaps the distribution of the top100, as done by John Myles White on his blog here (data can be found there), as the graph below, with the density of the time for the first 100 men (in blue) a...

## Playing with quantiles, part 1

March 8, 2011
By

A standard idea in extreme value theory (see e.g. here, in French unfortunately) is that to estimate the 99.5% quantile (say), we just need to estimate a quantile of level 95% for observations exceeding the 90% quantile. In extreme value theory,...

## Ascii code table in R

March 8, 2011
By

A quick method to enumerate the printable ascii characters with their hex & decimal values.The following code relies on taking the "raw" value of a base 10 int (this gives a hex value), and then using the builtin function rawToChar, which gives a character. You can of course change the range (up to 255). Not sure and haven't tested,...

## Can one beat a Random Walk– IMPOSSIBLE (you say?)

March 8, 2011
By

Firstly, apologies for the long absence as I've been busy with a few things.  Secondly, apologies for the horrific use of caps in the title (for the grammar monitors).  Certainly, you'll gain something useful from today's musing, as it's a pr...

## Challenge: Visualizing the US Federal Budget

March 8, 2011
By

Google today announced a Data Visualization Challenge that is well suited to the graphical capabilities of R. The goal is to visualize the US Federal budget from the point of view of the taxes an individual pays. The data are available from whatwepayfor.com -- their FAQ gives details about the source of the data and the philosophy of making...

## New R IDE

March 8, 2011
By

I'm always looking for ways to improve my workflow and overall academic efficiency. I've tried a variety of text editors, GUIs, and integrated development environments (IDEs) for R. I have some preferences but I haven't found anything that I'm complete...

## A Short Return to the Age-Earnings Profile

March 8, 2011
By
$A Short Return to the Age-Earnings Profile$

Two posts ago I mentioned the age-earnings profile but did not provide a regression of log earnings on wage. I also offered, without evidence, that fitting a simple linear regression would be inappropriate. How do I know that? How could … Continue reading →

## Splitting a Dataset Revisited: Keeping Covariates Balanced Between Splits

March 8, 2011
By

In my previous post I showed you how to randomly split up a dataset into training and testing datasets. (Thanks to all those who emailed me or left comments letting me know that this could be done using other means. As things go with R, it's sometimes ...

## Splitting a Dataset Revisited: Keeping Covariates Balanced Between Splits

March 8, 2011
By

In my previous post I showed you how to randomly split up a dataset into training and testing datasets. (Thanks to all those who emailed me or left comments letting me know that this could be done using other means. As things go with R, it's sometimes ...

## Blackbox trading Strategy using Rapidminer and R II

March 8, 2011
By

Long time without updating the blog for lack of time (again) due to new professional and personal challenges. Continuing with the strategy of Black Box, thanks to recommendations made by several readers and the lack of time to make a good tutorial of the model, I’m going to make available the file with...

## Blackbox trading Strategy using Rapidminer and R II

March 8, 2011
By

Long time without updating the blog for lack of time (again) due to new professional and personal challenges. Continuing with the strategy of Black Box, thanks to recommendations made by several readers and the lack of time to make a good tutorial of the model, I’m going to make available the file with...