Monthly Archives: January 2014

Lies, Damn Lies, “Data Journalism” and Charts That Don’t Start at 0

January 28, 2014
By
Lies, Damn Lies, “Data Journalism” and Charts That Don’t Start at 0

This tweet by @moorehn (who usually is a superb economic journalist) really bugged me: Alarming chart of employment for people between 25 and 54. It's like a ski jump. #SOTUecon pic.twitter.com/KNGYmwI88C— Heidi N. Moore (@moorehn) January 29, 2014 I grabbed the raw data from EPI: (http://www.epi.org/files/2012/data-swa/jobs-data/Employment%20to%20population%20ratio%20(EPOPs).xls) and properly started the graph at 0 for the

Read more »

cut, baby, cut!

January 28, 2014
By
cut, baby, cut!

At MCMSki IV, I attended (and chaired) a session where Martyn Plummer presented some developments on cut models. As I was not sure I had gotten the idea [although this happened to be one of those few sessions where

Read more »

Time series data in R

January 28, 2014
By

There is no shortage of time series data available on the web for use in student projects, or self-learning, or to test out new forecasting algorithms. It is now relatively easy to access these data sets directly in R. M Competition data The 1001 series from the M-competition and the 3003 series from the M3-competition are available as part...

Read more »

Binomial testing with buttered toast

January 28, 2014
By

Rasmus' post of last week on binomial testing made me think about p-values and testing again. In my head I was tossing coins, thinking about gender diversity and toast. The toast and tossing a buttered toast in particular was the most helpful thought experiment, as I didn't have a fixed opinion on the probabilities for a toast to...

Read more »

Ryan Peek on Creating Shiny Apps

January 28, 2014
By

Yesterday at the Davis R User’s Group1, Ryan Peek gave a talk about using the shiny package to create interactive web apps with R. Here are his slides. Ryan includes a bunch of links to examples and tutorials, as well as his own thermohydrographs app: Thanks to Revolution Analytics for another year of...

Read more »

Context Matters When Modeling Human Judgment and Choice

January 28, 2014
By
Context Matters When Modeling Human Judgment and Choice

Herbert Simon was succinct when he argued that judgment and choice "is shaped by a scissor whose two blades are the structure of the task environment and the computational capabilities of the actor" (Simon, 1990, p.7). As a marketing researcher, I take...

Read more »

Finding out repeated variables in multiple datasets

January 28, 2014
By
Finding out repeated variables in multiple datasets

Few days ago I posted on doing a smart job on importing several data files alike from a directory. Today, I want to return to this topic, but stretching it a bit further by adding some complexity. I want to have a snapshot of the datasets even before starting work with them. That is, I

Read more »

Bias of Hill Estimators

January 28, 2014
By
Bias of Hill Estimators

In the MAT8595 course, we’ve seen yesterday Hill estimator of the tail index. To be more specific, we did see see that if , with , then Hill estimators for are given by for . Then we did say that satisfies some consistency in the sense that if , but not too fast, i.e. (under additional assumptions on the...

Read more »

Quantitative Finance Applications in R – 3: Plotting xts Time Series

January 28, 2014
By
Quantitative Finance Applications in R – 3: Plotting xts Time Series

by Daniel Hanson, QA Data Scientist, Revolution Analytics Introduction and Data Setup Last time, we included a couple of examples of plotting a single xts time series using the plot(.) function (ie, said function included in the xts package). Today, we’ll look at some quick and easy methods for plotting overlays of multiple xts time series in a single...

Read more »

Using Last.fm to data mine my music listening history

Using Last.fm to data mine my music listening history

I've (passively) been keeping meticulous records of almost every song I've listened to since January of 2008. Since I opened my last.fm account 6 years ago, they've accumulated a massive detailed dataset of the 107,222 songs I've listened to since then. The best thing is that they're willing to share this data with me! I »more

Read more »