A new major release 0.11.0 of Rcpp is now on the CRAN network for GNU R and binaries for Debian have been uploaded as well. Before you read on, please note that this release will most likely require a reinstallation of all your packages using Rcpp... [Read more...]

Self-Organising Maps (SOMs) are an unsupervised data visualisation technique that can be used to visualise high-dimensional data sets in lower (typically 2) dimensional representations. In this post, we examine the use of R to create a SOM for customer segmentation. The figures shown here used use the 2011 Irish Census information for ... [Read more...]

After going through the overview of tools & technologies needed to become a Data scientist in my previous blog post, in this post, we shall understand how to tackle a data analysis problem.Any data analysis project starts with identifying a business problem where historical data exists. A business problem can ... [Read more...]

Introduction An interesting paper (Smith and Wessel, 1990) points out a weakness in using splines in cases with data gaps. Their illustration of the problem with isobaths was particularly compelling. I cannot reproduce their Fig 1b here, owing to copyright problems, but I digitized the data so I could test two ... [Read more...]

Recently I decided to switch statistical programs used introductory statistics course for masters students that I teach at the University of Arkansas. Historically this course has been taught with SPSS, but I am attempting the switch to R this semeste... [Read more...]

I was chatting about public speaking with my brother, who is a Lecturer in the Faculty of Pharmacy at UofT, when he offered me the opportunity to come to his class and teach about R.  Always eager to spread the … Continue reading → [Read more...]

I've recently heard the idea of "offline first" via especially Hood.ie. We of course don't do web development, but primarily build R interfaces to data on the web. Internet availablility is increasinghly ubiqutous, but there still are times and places where you don't have internet, but need to get ... [Read more...]

R CODE R OUTPUT SAS CODE & OUTPUT FOR COMPARISON [Read more...]

I recently co-authored a chapter on “Prospective Life Tables” for this book, edited by Arthur Charpentier. R code to reproduce the figures and to complete the exercises for our chapter is now available on github. Code for the other chapters should also be available soon. The book can be pre-ordered ... [Read more...]

A similar article was posted at the sub-personal blog before and I paste it here in case someone is interested.At the moment there are 84 firms listed at both A (Shanghai and Shenzhen) and H (Hongkong) stock markets, according to the law of one price,... [Read more...]

I"ll be doing a webinar with the Orange County R User Group on the caret package on Tue, Feb 25, 2014 1:00 PM - 2:00 PM EST.Here is the url in case you are interested: https://www3.gotomeeting.com/register/673845982Thanks to Ray DiGiacom... [Read more...]

On a rare, brief holiday (here and here, if you’re interested; both highly-recommended), I make the mistake of checking my Twitter feed: paging @neilfws . . . RT @psudmant: Ground breaking new methods from @naturemethods – boxplots – no rly nature.com/nmeth/journal/…— Chris Miller (@chrisamiller) January 30, 2014 This points me to BoxPlotR. It ... [Read more...]

Since I started using Tableau I’m quite fascinated about the capabilities of this piece of software. Before Christmas I was looking how I could build an interactive visualization that helps me to explore the relationships between different objects in a form that shows which objects are very close to ... [Read more...]

The microbenchmark package is a popular way of comparing the time it takes to evaluate different R expressions — perhaps more popular than the alternative of just using system.time to see how long it takes to execute a loop that evaluates an expression many times. Unfortunately, when used in the ... [Read more...]

[Read more...]

Here is a new visualization created in the same manner as my Cohen’s d vizualisation. This new visualization is an interactive display of classical null hypothesis significance testing and statistical power. The visualization should work on mobile phones and tablets, but it requires a modern browser that supports SVG. ... [Read more...]

When you create a boxplot in R, it automatically computes median, first and third quartile ("hinges") and 95% confidence interval of median ("notches").But we would like to change the default values of boxplot graphics with the mean, the mean + st... [Read more...]

I looked at Bayesian analysis of sensory profiling data in May and June 2012. I do remember not being totally happy with the result and computations taking a bit more time than I wanted. But now it is 2014, I can use STAN and I have been thinking about... [Read more...]

The day before yesterday is spring festival which is one of the most famous Chinese festivals, and setting off firecrackers outside on New Year Eve is a traditional custom. However, firecrackers will pollute circumstance severely and cause the hazy weather. Of course the pollution of different province is not the ... [Read more...]

[Read more...]