[Read more...]

A new release of the tint package just arrived on CRAN. Its name expands from tint is not tufte as the package offers a fresher take on the Tufte-style for html and pdf presentations. This version adds support for the tufte-book latex style. The pack... [Read more...]

It's a Deeply Trivial first - I made my first video! In it, I talk through conducting and interpreting the output of the analyses from the F is for (Confirmatory) Factor Analysis post.Also referenced in the video:Goodness of Fit post - a reminder of ho... [Read more...]

Amateur demography week continues around here. Today we are looking at the population of England and Wales since 1961, courtesy of some data from the UK Office of National Statistics. We have data on population counts by age (in nice, detailed, yearly increments) broken down by sex. We’re going to ... [Read more...]

[Read more...]

[Read more...]

[Read more...]

We recently had an awesome opportunity to work with a great client that asked Business Science to build an open source anomaly detection algorithm that suited their needs. The business goal was to accurately detect anomalies for various marketing data consisting of website actions and marketing feedback spanning thousands of ... [Read more...]

Some time ago we discussed how you can access data that are stored in Amazon Redshift and PostgreSQL with Python and R. Let’s say you did find an easy way to store a pile of data in your BigQuery data warehouse and keep them in sync. Now you want ... [Read more...]

Yesterday I came across Aaron Penne’s collection of very nice data visualizations, one of which was of monthly births in the United States since 1933. He made a tiled heatmap of the data, taking care when calculating the average rate to correct for the varying number of days in different ... [Read more...]

In the Beta post, I used linear regression and demonstrated how to request standardized regression coefficients (betas). You may remember that I mentioned in that post that there are other types of regression. Linear regression is used with a continouous outcome. But sometimes you want to predict outcomes that aren't ... [Read more...]

A bit more tinkering with F1 data from the ergast db, this time trying to generating trivia / facts around races. The facts are identified using SQL queries: Some of the queries also embed query fragments, which I intend to develop further… I'm using knitr to generate Github flavoured markdown (gfm) ... [Read more...]

[Read more...]

[Read more...]

Contents Introduction How to use this article Basic wide to long reshape Basic long to wide reshape Advanced reshape Alternatives to base R TL;DR - Just want the code Exercises References Exercise answers Discuss the article Introduction This is the first post in the R:case4base series. The ... [Read more...]

Contents Introduction How to use this article Basic wide to long reshape Basic long to wide reshape Advanced reshape Alternatives to base R TL;DR - Just want the code Exercises References Exercise answers Discuss the article Introduction This is the first post in the R:case4base series. The ... [Read more...]

[Read more...]

[Thanks to Scott Glover for correcting me.] Someone recently said to me that the lower the p-value, the higher the likelihood ratio under the alternative vs the null. The arXiv paper by Michael Lew makes analogous points (thanks to Titus von der Malsb... [Read more...]

Let’s consider piping in R both using the magrittr package and using the wrapr package. magrittr pipelines The magittr pipe glyph “%__%” is the most popular piping symbol in R. magrittr documentation describes %__% as follow. Basic piping: x %__% f is equivalent to f(x) x %__% f(y) is equivalent to ... [Read more...]

On Twitter the other day, Philip Cohen put up some data on changes in Bachelor’s degrees awarded between 1995 and 2015. The data come from the National Center for Education Statistics. It seemed like a good candidate for drawing as a figure, so I had a go at it: Changes in ... [Read more...]