Did the sun just explode? The last Dutch Book you’ll ever make

November 9, 2012
By
$Did the sun just explode? The last Dutch Book you’ll ever make$

In today’s XKCD, a pair of (presumably) physicists are told by their neutrino detector that the sun has gone nova. Problem is, the machine rolls two dice and if they both come up six it lies, otherwise it tells the truth. The Frequentist reasons that the probability of obtaining this result if the sun had

Exploring GAMs with Rosemary Hartman

November 9, 2012
By

Today at Davis R Users’ Group, Rosemary Hartman took us through her work in progress fitting general additive models to organism presence/absence data. Below is her presentation and script. You can get the original script and data here Also, check the comments below for some discussion of other options for this type of analysis, such as...

Video: How John Deere uses R

November 9, 2012
By

Farming equipment manufacturer John Deere uses R, and in yesterday's webinar their manager of forecast analytics, Derek Hoffman, explained what they use it for: In the presentation, Derek gave a spirited argument of why R is critical for John Deere's operations: from forecasting demand for equipment, to forecasting crop yields (they produce forecasts for more than half the world's...

Consuming R from SAP Mobile Platform

November 9, 2012
By

Early this year, in March, I was visiting my team mates in SAP Labs Palo Alto, and my good friend a team mate Rui Nogueira asked to participate in his most excellent Technology Innovation Podcast show where we spoke about R and SAP HANA. By the end of ...

Terrain effects on SUHI estimates

November 9, 2012
By

Introduction Zhang and Imhoff (2010)  pdf here utilized NLCD impervious surface area (ISA), Olson biomes, and MODIS Land Surface temperature (LST) to estimate the magnitude of UHI in large cities across the US.  Peng  employed a   similar approach in studying 419 large cities ( population greater than 1m ) around world. Peng’s work suggests a limit or

Video: Overlay Histogram in R (normal, density, another series)

November 9, 2012
By

This video explains how to overlay histogram plots in R for 3 common cases: overlaying a histogram with a normal curve, overlaying a histogram with a density curve, and overlaying a histogram with a second data series plotted on a … Continue reading →Video: Overlay Histogram in R (normal, density, another series) is an article from

Unbelievable and Amazing R Shiny–Web Parameter Test in 1.5 Hours

November 9, 2012
By

Life keeps getting better and better.  Yesterday, I discovered the absolutely unbelievable and amazing work RStudio has done with Shiny employing one of my favorite R packages websockets.  As proof of the ease and quality, within a couple of ...

How Microsoft Can Use Windows 8 to Dominate the Tech Industry

November 9, 2012
By

Windows 95 transformed the PC software market and established Microsoft as the dominant player.  Can Microsoft do it again?  Can it use the release of Windows 8 to elevate its entire brand image?  More importantly to some of us, can Microsoft use statistical modeling to help it achieve its goal?Of course, the answer depends on what you mean by...

Interview with Tom Louis – New Chief Scientist at the Census Bureau

November 9, 2012
By

Tom Louis Tom Louis is a professor of Biostatistics at Johns Hopkins and will be joining the Census Bureau through an interagency personnel agreement as the new associate director for research and methodology and chief scientist. Tom has an impressive history of … Continue reading →

Interactive color picker, using locator()

November 9, 2012
By

I mostly wrote this just to see how locator() works, and ended up making an HCL color picker, so you can make your own visually offensive rainbow color palettes! Or, you can make your own nice color palettes. It is up to you. Essentially, this script...

R midterms

November 9, 2012
By

Here are my R midterm exams, version A and version B in English (as students are sitting next to one another in the computer rooms), on simulation methods for my undergrad exploratory statistics course. Nothing particularly exciting or innovative! Dedicated ‘Og‘s readers may spot a few Le Monde puzzles in the lot… Two rather entertaining

Project Euler — problem 23

November 9, 2012
By

Officially, it’s weekend. I’m solving this 23rd Euler problem just before my supper. A perfect number is a number for which the sum of its proper divisors is exactly equal to the number. For example, the sum of the proper divisors … Continue reading →

Another crosshairs

November 8, 2012
By

C. DeSante over at is.R() has PEBOS as well, but turned it into a great explanation of the way predictions like Nate Silver's work.For a while the 538 team had PEBOS as well: "The FiveThirtyEight team is still recuperating, but the election provided a fresh supply...

R user group

November 8, 2012
By

The first R user group in Russia has brings together R users in Perm city. First R UseR meetup was 4 october. Arbuzov Vyacheslav presented an overview of the packages for data downloading. peRm R group. Review of packages for … Continue reading →

November 8, 2012
By

Last week I talked about objects including scalars, vectors, matrices, dataframes, and lists.  This post will show you how to use the objects (and their corresponding classes) you create in R to your advantage.First off, it's important to remember...

R Code for A Justification and Application of Eigenvector Centrality

November 8, 2012
By

Leo Spizzirri  does an excellent job of providing mathematical intuition behind eigenvector centrality. As I was reading through it, I found it easier to just work through the matrix operations he proposes using R.  You can find his paper her...

Some academic thoughts on the poll aggregators

November 8, 2012
By

The night of the presidential elections I wrote a post celebrating the victory of data over punditry. I was motivated by the personal attacks made against Nate Silver by pundits that do not understand Statistics. The post generated a little … Continue reading →

PEBOS (Post Election Burn Out Syndrome)

November 8, 2012
By

I guess that all those that tried to follow the presidential election as closely as possible are more than just a little bit exhausted mentally. I call this PEBOS - Post Election Burn Out Syndrome.Among us some concentrated on the horserace aspect of t...

What’s new in Revolution R Enterprise 6.1

November 8, 2012
By

We're pleased to announce that the latest update to Revolution R Enterprise is available today! Existing subscribers will soon receive an email with update instructions, and the free academic distribution will be updated later today. Version 6.1 adds a frequently-requested big-data statistical modeling algorithm, adds new connectivity option for Hadoop, improves performance, and provides new security and installation options...

Automated OSD Lookup and Display via SoilWeb and AQP

November 8, 2012
By

UPDATED 2013-04-08 This functionality it now available in the soilDB and sharpshootR packages. All code on this page is now superseded by the fetchOSD() and SoilTaxonomyDendrogram()functions. UPDATED 2012-11-07 I have been thinking about a URL-ba...

Possible error in Bayesian bootstrap

November 8, 2012
By

After my last post on Bayesian bootstrap I got a question why the sample from Dirichlet distribution is taken as weights for calculating mean in the procedure and not as weights used for sampling from the original data set. Actually this mistake i...

finding meaningful clusters in phylogenetic trees or other hierarchical clusterings

November 8, 2012
By

Phylogenetic trees are a specialization of hierarchical clustering which elegantly capture relatedness between observations, grouping like with like. Yet hierarchical clusterings have one common complaint, as compared to density/distribution based clustering, the ability to classify the data into different types. … Continue reading →

Five Thirty-Hate?

November 8, 2012
By

The last few days have been trying, mostly because folks keep asking me the same questions: have you voted? Who do you think will win the election? Do you think Nate Silver (http://fivethirtyeight.blogs.nytimes.com/)  is right? How confident are you ...

Introducing Shiny: Easy web applications in R

November 8, 2012
By

Say hello to Shiny, a new R package that we’re releasing for public beta testing today. Shiny makes it super simple for R users to turn analyses into interactive web applications that anyone can use. These applications let you specify input parameters using friendly controls like sliders, drop-downs, and text fields; and they can easily

Indexing with factors

November 8, 2012
By

This is a silly problem that bit me again recently. It’s an elementary mistake that I’ve somehow repeatedly failed to learn to avoid in eight years of R coding. Here’s an example to demonstrate. Suppose we create a data frame with a categorical column, in this case the heights of ten adults along with their

The [95%] Confidence of Nate Silver

November 7, 2012
By

The headlines have been buzzing with the “triumph” of statistics and math in this election.  But before I jump into how well statistics served us, let’s do a little primer on the margin of error. Whenever we measure less than the whole population we’ll have some variability in the sample.  Chances are good that the

Revisiting the GOP Race with the Huff Post API and pollstR

November 7, 2012
By

Well, one election is over but it is never too soon to start another – or in this case revisit the past four years One day after the 2008 US Presidential election, there was a Rasmussen poll taken of 1000 likely voters asking for their choice for the 2012 Republican Presedential Candidate. The overwhelming favourite

Granger Causality Testing in R

November 7, 2012
By

Today just gets better and better!I had an email this morning from Christoph Pfeiffer, who follows this blog. Christoph has put together some nice R code that implements the Toda-Yamamoto method for testing for Granger causality in the context of non-stationary time-series data.Given the ongoing interest in the various posts I have had (

RBelgium meeting on November, 16

Next week on Friday, November 16, the RBelgium R user group is holding its next Regular meeting in Brussels. This is the schedule of the upcoming RBelgium Regular meeting:* Graphical User Interface developments around R, including tcltk2 and SciViews - Philippe Grosjean (UMons)* Using R via the Amazon Cloud - Jean-Baptiste Poullet (stat'Rgy)* Literature review: R books - Brecht Devleesschauwer (UGent, UCL)The meeting will take place...