Monthly Archives: August 2011

CHCN: Canadian Historical Climate Network

August 4, 2011
By
CHCN: Canadian Historical Climate Network

A reader asked a question about data from   environment canada.  He wanted to know if that data could somehow be integrated into the RGhcnV3 package.  That turned out to be a bit more challenging that I expected.  In short order I’d found a couple other people who had done something similar.  DrJ of course was

Read more »

Statisticians at JSM consider themselves "Data Scientists"

August 4, 2011
By
Statisticians at JSM consider themselves "Data Scientists"

At the JSM 2011 conference in Miami earlier this week, we conducted an informal poll of attendees on their attitudes to respect to Big Data, statistical software, and data science. JSM is the largest gathering of statisticians in North America, and attendees were invited to complete a survey after logging into the Wi-Fi network. Of the 190 respondents to...

Read more »

Lattice-xyplot without Border/Box, with Axes at Bottom & Left Side Only, with Custom Ablines/Grid & Axis-Labelling

August 4, 2011
By
Lattice-xyplot without Border/Box, with Axes at Bottom & Left Side Only, with Custom Ablines/Grid & Axis-Labelling

Here's how you do a lattice-xyplot without border/box, with axes at bottom & left side only, with custom ablines/grid & axis-labelling Read more »

Read more »

Does Jon Skeet have mental powers that make us upvote his answers? (The effect of reputation on upvotes)

August 4, 2011
By
Does Jon Skeet have mental powers that make us upvote his answers? (The effect of reputation on upvotes)

Of course since we all know Jon Skeet does have various powers, I will move onto unanswered questions, whether a users reputation makes them receive more upvotes for answers. I’ve seen this theory mentioned in multiple places (see any of the comments to Jon Skeet’s answer that are along the lines of “If this was

Read more »

Q-Q Plots for Multi-modal Performance Data

August 3, 2011
By
Q-Q Plots for Multi-modal Performance Data

I'm in the process of putting together some slides on how to apply Quantile-Quantile plots to performance data. Q-Q plots are a handy tool for visually inspecting how well your data matches a known probability distribution (prob dsn). If the match is g...

Read more »

Hotness

August 3, 2011
By
Hotness

We have an internal image that floated around work several years ago that details network utilization of TCP over a wide variety of configurations. It is a heatmap created in matlab that is just sweet, sweet eye candy. We actually hung it on the outside of a cube for a short while and people couldn't help but stop and...

Read more »

How Google uses R to make online advertising more effective

August 3, 2011
By

At JSM 2011 today, three Google employees (amongst the more than 20 Google delegates there) gave a little insight into how statistical analysis with R yields better results for companies using Google's various advertising products. Bill Heavlin from Google kicked off the session with a talk about conditional regression models, a statistical technique at Google used to evaluate the...

Read more »

A Bayesian Guessing Game

August 3, 2011
By
A Bayesian Guessing Game

You, the player, must think of some set, eg "odd numbers" or "perfect squares," and that'll be your little secret. Now think of some numbers that live in the intersection of your set and the integers {1, 2, ... , 100} -- for example, if you've chosen ...

Read more »

Faster files in R

August 3, 2011
By

R is fairly slow in reading files. read.table() is slow, scan() a bit faster, and readLines() fastest.But all these are nowhere as fast as other tools that scan through files. Let us look at an example. I have in front of me a 283M file.(Small update: the timings where off before. First because R hashes strings, one has to...

Read more »

Tomboy Notes: Personal R Help File

August 3, 2011
By
Tomboy Notes: Personal R Help File

When learning R it is helpful to have your own personal help file. One you create for yourself, with the notes, links, and language you understand (sometimes the help files are not very helpful). Let me introduce you to Tomboy Notes.Tomboy Notes is a l...

Read more »