Abstract ProjectTemplate is a system for organizing and automating data analysis in R. Here is a recipe for creating a new ProjectTemplate project in RStudio and initializing version control with Git. Order of Operations I find that the following sequence is most efficient and error-proof: Create ProjectTemplate project Create RStudio ... [Read more...]

I love GitHub for version control and collaboration, though I'm no master of it. And the tools for integrating git and GitHub with RStudio are just amazing boons to productivity. Unfortunately, my University-supplied computer does not play well with GitHub. Various directories are locked down, and I can't push or ... [Read more...]

[Read more...]

It's a pain to design statistics exercises each semester, and because students from previous share old exercises with the new incoming students, it's hard to design simple exercises that students haven't already seen the answers to. On top of that, som... [Read more...]

Nina Zumel and I are honored to have been invited to be part of Strata + Hadoop World in San Jose 2016 R Day organized by RStudio and O’Reilly. We have written a lot on the topic of model validation in R and we are very excited to distill it down ... [Read more...]

I was browsing Davies Design and Analysis of Industrial Experiments (second edition, 1967). Published by for ICI in times when industry did that kind of thing. It is quite an applied book. On page 107 there is an example where the variance of a process is estimated.DataData is from nine batches ... [Read more...]

I was browsing Davies Design and Analysis of Industrial Experiments (second edition, 1967). Published by for ICI in times when industry did that kind of thing. It is quite an applied book. On page 107 there is an example where the variance of a process is estimated.DataData is from nine batches ... [Read more...]

By the beginning of 2016 it was announced that our economy is shrinking after the influence of external factors. Media has reported that commodities prices are falling, but there is more than just that. Based on Chilean Copper Commission and Chile Cust... [Read more...]

[Read more...]

Lately I have been doing calendar analysis of various markets (future contracts). Not an overly complicated task, but has a few interesting angles and since I haven’t seen anything similar on the Net – here we go. The world of futures is not friendly – pretty much every contract has its ... [Read more...]

Recently ggplot2 received a severe makeover by releasing version 2.0, and in the spirit of improvement, I thought ggtern should also get an overhaul, so after a few-hundred hours of code review, here is what has changed: Theme elements: Previously, the nomenclature scheme for the new theme elements was a bit ... [Read more...]

A few days ago, Matt Yglesias shared this tweet from Liz Ann Sonders, Chief Investment Strategist with Charles Schwab, Inc: DailyShot: Here is a comparison of the monetary base with the S&P500 ... Coincidence? pic.twitter.com/QsdNhJdbRP— Liz... [Read more...]

In a previous post, I expressed the feeling that artificial intelligence, data science and big data are currently “hot” in the news. One of my favorite news outlet (“Die Zeit”) has an open data policy in a sense that they have a public API. I thought it would be worth ... [Read more...]

IntroductionShiny app is a new way to present data interactively. Unlike methods like D3, shiny performs complex calculation in real time. As a result, shiny app is more powerful and versatile. However, this also means one cannot simply embed an interactive shiny app in an html document. It needs to ... [Read more...]

Figure 1: Synthetic data and fitted curves. S-shaped distributed data can be found in many applications. Such data can be approximated with logistic distribution function [1].  Cumulative distribution function of logistic distribution function is a logistic function, i.e., logit.To demonstrate this, in this short example, after generating a synthetic data, ... [Read more...]

Figure 1: Synthetic data and fitted curves.S-shaped distributed data can be found in many applications. Such data can be approximated with logistic distribution function [1].  Cumulative distribution function of logistic distribution function is a... [Read more...]

Below are 10 charts made in R or Python by Plotly users on weather, maps and geography. 1. Doctor Who? – Timelords weather forecast for different cities Chart Link: https://plot.ly/~wthrmn/30/timelords-weather-forecast-1152016/Chart Author: @ wthrmnTouched up in: Plotly online editorCode: Python code R Code 2. Its raining ! – US Precipitation (June 2015) Chart Link: ... [Read more...]

[Read more...]

Labor crowdsourcing is the system by which large crowds or workers contribute to a project allowing for complex and tedious tasks to be rapidly and efficiently completed. The largest labor crowdsourcing platform in the world, Amazon Mechancial TURK (Mt... [Read more...]

We’re not even halfway through with January, but the new year’s already rung in a new book with lots of Stan content: Richard McElreath (2016) Statistical Rethinking: A Bayesian Course with Examples in R and Stan. Chapman & Hall/CRC Press. This one got a thumbs up from the Stan ... [Read more...]