2010 ggplot2 Case Study Competition Winners

October 16, 2010
By

The 2010 ggplot2 Case Study Competition Winners have been announced!  Congratulations to the winners!Grand Prize: David Kahle, Rice UniversityFinalist: Michael Lavine, UMass Amherst Finalist: Claudia Beleites, TU Dresden & Uni....

Read more »

2010 ggplot2 Case Study Competition Winners

October 16, 2010
By

The 2010 ggplot2 Case Study Competition Winners have been announced!  Congratulations to the winners!Grand Prize: David Kahle, Rice UniversityFinalist: Michael Lavine, UMass Amherst Finalist: Claudia Beleites, TU Dresden & Uni....

Read more »

Accuracy in Inventories and Nightlights Part II

October 16, 2010
By
Accuracy in Inventories and Nightlights Part II

In part 1 we discussed UHI in a general way and introduced NASA’s use of nightlights to identify Rural, periurban and Urban stations. Very simply, the latitude and longitude data in the station inventory is used to look up at radiance value in the nightlights file. If that value is  10 or less, the site

Read more »

Benoît B Mandelbrot, 1924-2010

October 16, 2010
By

Benoît Mandelbrot, the father of fractals, died Thursday at the age of 85. His obituary in the New York Times covers his life and work, and is also a well-written introduction to fractals. Mandelbrot's famous book, The Fractal Geometry of Nature, was an inspiration to me in high school: that a simple question like "How Long Is The Coast...

Read more »

Cramer’s Stock Pick Recommendations Analyzed

October 16, 2010
By
Cramer’s Stock Pick Recommendations Analyzed

Bill Alpert of Barron’s has demonstrated the use of R in financial journalism as he criticized the performance of Jim Cramer’s stock picks.  Patrick Burns was an advisor for the analysis done in the article.  R was an important tool that allowed them to do their research as indicated by Burns in his...

Read more »

Cramer’s Stock Pick Recommendations Analyzed

October 16, 2010
By
Cramer’s Stock Pick Recommendations Analyzed

Bill Alpert of Barron’s has demonstrated the use of R in financial journalism as he criticized the performance of Jim Cramer’s stock picks.  Patrick Burns was an advisor for the analysis done in the article.  R was an important tool that allowed them to do their research as indicated by Burns in his...

Read more »

RcppArmadillo 0.2.8

October 16, 2010
By

Version 0.2.8 of RcppArmadillo is now on CRAN. This updates the included Armadillo template library to version 0.9.90 which Conrad released two few days ago. RcppArmadillo makes it easy to write highly efficient and highly readable C++ code for line...

Read more »

Mandelbrot and Akaike: from taxonomy to smooth runways (pioneering work in fractals and self-similarity)

October 16, 2010
By

Mandelbrot on taxonomy (from 1955; the first publication about fractals that I know of): Searching for Mandelbrot on the blog led me to Akaike, who also recently passed away and also did interesting early work on self-similar stochastic proces...

Read more »

Benoit Mandelbrot (the Father of Fractals) dead at 85

October 16, 2010
By
Benoit Mandelbrot (the Father of Fractals) dead at 85

Nicholas Taleb and Recent tweets indicate that Benoit Mandelbrot has died at age 85.  Mandelbrot was a French and American mathematician, best known as the father of fractal geometry.  His official biography at Yale does n...

Read more »

Benoit Mandelbrot (the Father of Fractals) dead at 85

October 16, 2010
By
Benoit Mandelbrot (the Father of Fractals) dead at 85

Nicholas Taleb and Recent tweets indicate that Benoit Mandelbrot has died at age 85.  Mandelbrot was a French and American mathematician, best known as the father of fractal geometry.  His official biography at Yale does n...

Read more »

Busting gay stereotypes with data

October 15, 2010
By
Busting gay stereotypes with data

As a gay guy, you sometimes have to put up with some pretty offensive stereotypes that get thrown your way by extremists in the community and the media. These stereotypes are usually deployed in the form of anecdotes about how gay people are "promiscuous" or "corrupting". These misrepresentative anecdotes have serious consequences, not just in the continued denial of...

Read more »

R 2.12.0 released

October 15, 2010
By

As announced today, The new R 2.12.0 is now available in source form, and you'll soon be able to download R as an installable binary for Windows, Mac and Linux from your local CRAN mirror. In the meantime, if you're not building R yourself you can check out the list of new features in the NEWS file. As usual,...

Read more »

Are class representatives twice as satisfied?

October 15, 2010
By
Are class representatives twice as satisfied?

So Agnes asked (via Facebook), looking at my previous post, http://stevepowell99.posterous.com/which-parents-are-satisfied-with-their-childs, if class representatives are more satisfied than other parents? This picture shows that they are: the parents with Rep=TRUE, i.e. the representatives, are also more satisfied, especially in schools where parents are generally less satisfied. So perhaps this explains away the effect in the

Read more »

Are class representatives twice as satisfied?

October 15, 2010
By
Are class representatives twice as satisfied?

So Agnes asked (via Facebook), looking at my previous post, http://stevepowell99.posterous.com/which-parents-are-satisfied-with-their-childs, if class representatives are more satisfied than other parents? This picture shows that they are: ...

Read more »

Margin of error, and comparing proportions in the same sample

October 15, 2010
By
Margin of error, and comparing proportions in the same sample

I recently tried to answer a simple question, asked by @adelaigue. Actually, I thought that the answer would be obvious... but it is a little bit more compexe than what I thought. In a recent pool about elections in Brazil, it was mentionned in a ...

Read more »

Prediction with Multilevel Regression Models, and Pizza

October 15, 2010
By

The Meetup phenomenon, which is now substantial and longstanding enough to be more of a cultural change than a flash in the pan, continues to impress me. Even more so than tools like LinkedIn, Meetups have changed the nature of professional networking, making it more informal, diverse, and decentralized. Last night, statistics consultant (and cheap

Read more »

Shravan Vasishth’s Slog (Statistics blog) 2010-10-15 06:47:00

October 15, 2010
By

I foolishly tried to convert a matrix M to a vector using vector:vector(M)But this is done column wise, so that adjacent row items end up non-adjacent.The right way to do this seems to be:library(data)unmatrix(M, byrow=TRUE)

Read more »

Shravan Vasishth’s Slog (Statistics blog) 2010-10-15 06:47:00

October 15, 2010
By

I foolishly tried to convert a matrix M to a vector using vector:vector(M)But this is done column wise, so that adjacent row items end up non-adjacent.The right way to do this seems to be:library(data)unmatrix(M, byrow=TRUE)

Read more »

R 2.12.0 is released!

October 15, 2010
By
R 2.12.0 is released!

The new R 2.12.0 is out! Get the source code from here. Take a look at these posts for some miscellaneous advices to make the upgrade easier. Also this thread on stackoverflow can be of some value. Feel free to contribute with suggestions about how to ...

Read more »

R 2.12.0 is released!

October 15, 2010
By
R 2.12.0 is released!

The new R 2.12.0 is out! Get the source code from here. Take a look at these posts for some miscellaneous advices to make the upgrade easier. Also this thread on stackoverflow can be of some value. Feel free to contribute with suggestions about how to ...

Read more »

Rcpp 0.8.7

October 15, 2010
By

With the scheduled R release of version 2.12.0 this morning, we have just uploaded version 0.8.7 of Rcpp to CRAN; Debian will follow shortly once the autobuilders have processed R 2.12.0 This Rcpp release depends on R 2.12.0 as two things have cha...

Read more »

Nightlights: First Principles

October 15, 2010
By
Nightlights: First Principles

With the publication of Hansen2010 forthcoming it is critical to examine the subject afresh. The global temperature index product from NASA is known as GISSTEMP .GISSTEMP, like the temperature index from Hadley/CRU and NCDC attempts to estimate the average temperature of the globe using historical data archived in the GHCN ( Global Climate Historical Network)

Read more »

The S3 OOP system

October 15, 2010
By

R currently supports two internal OOP systems (S3 and S4), and several others as add-on packages, such as R.oo, and OOP. S3 is easy to use but not reliable enough for large software projects. The emphasis of the S3 system was on generic functions and polymorphism. It’s a function centric system which is different to class centric system like JAVA.

Read more »

The S3 OOP system

October 15, 2010
By

R currently supports two internal OOP systems (S3 and S4), and several others as add-on packages, such as R.oo, and OOP. S3 is easy to use but not reliable enough for large software projects. The emphasis of the S3 system was on generic functions and polymorphism. It’s a function centric system which is different to class centric system like...

Read more »

Nightlights: cool data, bad geocoding

October 14, 2010
By
Nightlights: cool data, bad geocoding

A global source of population density has been on my low-priority wish list for some time, so I was very excited when I found Steve Mosher’s work with the Nighlights data set. “Nightlights” refers to the artificial lights seen from space at night. Astronomers call it “light pollution” which is pretty accurate since it’s decidedly

Read more »

Which parents are satisfied with their child’s education? Those who know their class representative well. Especially in poor schools.

October 14, 2010
By
Which parents are satisfied with their child’s education? Those who know their class representative well. Especially in poor schools.

Another result from our OSI / ESP survey of nearly 11000 parents in ten countries. Dots are individual parents. The y-axis is individual parents’ overall satisfaction with their children’s education. Red dots are parents who know their parent representatives well, blue dots are parents who do not; i.e. colour is mapped to the variable par.rep.1

Read more »

Which parents are satisfied with their child’s education? Those who know their class representative well. Especially in poor schools.

October 14, 2010
By
Which parents are satisfied with their child’s education? Those who know their class representative well. Especially in poor schools.

Another result from our OSI / ESP survey of nearly 11000 parents in ten countries. Dots are individual parents.The y-axis is individual parents' overall satisfaction with their children's education. Red dots are parents who know the...

Read more »

Liquidity Premium vs Liquidity of Corporate Bonds

Liquidity Premium vs Liquidity of Corporate Bonds

All else equal, investors should require higher returns on assets whose liquidity is lower, in other words, investors demand a higher expected return, and hence larger liquidity premium, by holding a less liquidity asset. Risk & return co-exist.Is this really true for corporate bonds? I run a simple regression using R to test my data, where US corporate bonds...

Read more »

How to build a world-beating predictive model using R

How to build a world-beating predictive model using R

Many modern data analysis problems in both industry and academia involve building a model that can predict the future based on historical variables. The 2009 KDD Cup was an international data mining competition devoted to this type of problem, where … Continue reading →

Read more »