Speed up your R code with C++

February 3, 2011
By
Speed up your R code with C++

Hi again, Recently, Julyan blogged about allocating memory first before modifying R objects. That’s a very useful trick that applies to most programming languages. Tonight I want to blog about something a bit more complicated and more specific to R, but which can lead to massive speed-ups: interfacing C/C++ within R codes. The rationale behind

Read more »

Japan Intentional or Accidental Pursuit of Deflation

February 3, 2011
By
Japan Intentional or Accidental Pursuit of Deflation

Japan’s intentional or accidental pursuit of deflation has caused an imbalance far greater than Bernanke’s pursuit of inflation.  Japanese policymakers have allowed Yen appreciation versus all other currencies.  It appears that they recog...

Read more »

Regular expressions, an example

February 3, 2011
By

Why regular expressions are your friend. This is written in Stata but applies to any language where regular expressions exist.Original version if length("`qx'")==3 { /*ex: 5q0*/ ...

Read more »

Mixed Models – Part 1

February 3, 2011
By
Mixed Models – Part 1

Very brief. Have been exploring mixed models in R using nlme::lme. Am looking forward to understanding them more, they’re going to be used more and more in years to come I’ve no doubt of that. Here are some scripts, very rough, for diagnostics when running simple 2 levels, or models with 1 grouping variable. CLICK

Read more »

R in production systems

February 2, 2011
By
R in production systems

R is great for prototyping models.  Not so great if those models have to run a business.  Here’s some tips to help with that: Validate, alert, and monitor Sink Use 64-bit Linux Write your own functions tryCatch Validate, alert, and monitor:  Sooner or later something is going to go wrong with your model.  Maybe some

Read more »

Fixing Up smoothScatter Heat Maps

February 2, 2011
By
Fixing Up smoothScatter Heat Maps

A while back, I posted an article using the smoothScatter function in R that builds a color representation of density for scatter plots. When I first found the function, I was extremely excited because it's a very easy and automated way to make a heat...

Read more »

Fixing Up smoothScatter Heat Maps

February 2, 2011
By
Fixing Up smoothScatter Heat Maps

A while back, I posted an article using the smoothScatter function in R that builds a color representation of density for scatter plots. When I first found the function, I was extremely excited because it's a very easy and automated way to make a heat...

Read more »

Statistical Analysis with R Book Reviews

February 2, 2011
By
Statistical Analysis with R Book Reviews

Reviews of my Statistical Analysis with R book have started to emerge online and I am writing today to share them with potential readers and recommenders. Reviews The following is a list of online reviews for Statistical Analysis with R. If you have w...

Read more »

Statistical Analysis with R Book Reviews

February 2, 2011
By
Statistical Analysis with R Book Reviews

Reviews of my Statistical Analysis with R book have started to emerge online and I am writing today to share them with potential readers and recommenders. Reviews The following is a list of online reviews for Statistical Analysis with R. If you have w...

Read more »

(more on) Pattern Matching for Transcription Factor Binding Sites

February 2, 2011
By

I have published some initial script scribblings on this task about a week ago. After another week I'm posting some better formed and annotated code. The Biostrings and BSGenomes packages are new to me and I've gone through many many iterations and ex...

Read more »

A legitimate use for the stupidest variable name ever

February 2, 2011
By
A legitimate use for the stupidest variable name ever

The help page to make.names describes how to make a valid variable name in R: A syntactically valid name consists of letters, numbers and the dot or underline characters and starts with a letter or the dot not followed by a number. Names such as ‘”.2way”’ are not valid, and neither are the reserved words.

Read more »

Plotting images on a grid using R or Python

February 2, 2011
By
Plotting images on a grid using R or Python

A thread depicting how to insert a png image in a plot, thanks to Stackoverflow: plotting-images-on-a-grid. A very basic tip, still useful to someone.

Read more »

Plotting images on a grid using R or Python

February 2, 2011
By
Plotting images on a grid using R or Python

A thread depicting how to insert a png image in a plot, thanks to Stackoverflow: plotting-images-on-a-grid. A very basic tip, still useful to someone.

Read more »

Charting For Fun

February 2, 2011
By
Charting For Fun

Interesting Charts Making Lemonade If you are working on the FREE eMetrics pass, and you really should if you need a free pass, I created some charts based on the sample data. These data are limited in terms of the … Continue reading →Charting For Fun is a post from: MichaelDHealy.com

Read more »

Annotated source code

February 1, 2011
By
Annotated source code

We programmers are told that reading code is a good idea. It may be good for you, but it's hard work. Jeremy Ashkenas has come up with a simple tool that makes it easier: docco. Ashkenas is also behind underscore.js and coffeescript, a dialect of ja...

Read more »

Annotated source code

February 1, 2011
By
Annotated source code

We programmers are told that reading code is a good idea. It may be good for you, but it's hard work. Jeremy Ashkenas has come up with a simple tool that makes it easier: docco. Ashkenas is also behind underscore.js and coffeescript, a dialect of ja...

Read more »

Teach Yourself How to Create Functions in R

February 1, 2011
By
Teach Yourself How to Create Functions in R

As you can tell from my previous posts, I am diving in head first into learning how to program (and simplify) my analytical life using R.  I have always learned by example and have never really prospered from the “learn from scratch” school of thought.  As I follow along with some other fellow R programmers,

Read more »

Atmospheric Temperature Structure : 2 – Stratospheric Cooling

February 1, 2011
By
Atmospheric Temperature Structure : 2 – Stratospheric Cooling

In this  post I review the temperature structure of the atmosphere and lower stratosphere temperature (TLS) anomaly trends. Temperature Structure in the Atmosphere In post 1 of this series, I developed this RClimate chart of temperature soundings which I update … Continue reading →

Read more »

Revolution R Enterprise 4.2 now available

February 1, 2011
By

Today we're pleased to announce the availability of the latest update to the Revolution R family, Revolution R Enterprise 4.2. This release includes all of the capabilities of the most powerful statistical software available, open-source R (version 2.11.1), plus additional components for big data analysis, integration, user experience and more. Version 4.2 includes a number of new features, including:...

Read more »

Introductory R Books

January 31, 2011
By
Introductory R Books

Here's a link to another blog compiling information and recommendations are introductory books on R (not statistics books that use R).  I thought this might be useful for people.http://csgillespie.wordpress.com/2011/01/28/r-programming-books-updated/

Read more »

Tricks to manage memory in an R session

January 31, 2011
By

Unless you're using an out-of-memory solution to manage large data objects (such as the RevoScaleR package in Revolution R Enterprise), then R always allocates memory for every object in your working session. If you're working with many objects (or even just a few large objects) then you'll need to take care to manage R's memory usage to avoid the...

Read more »

sab-R-metrics: Some Extra Visualization Customization

January 31, 2011
By
sab-R-metrics: Some Extra Visualization Customization

Last post, I described a number of ways to show your data on a scatter plot. Ricky Zanker at THT has a similar post today for those looking to get some extra exposure and another take on R programming. Today, I plan to extend on this with a little more customization. First, if you've missed...

Read more »

sab-R-metrics: Some Extra Visualization Customization

January 31, 2011
By
sab-R-metrics: Some Extra Visualization Customization

Last post, I described a number of ways to show your data on a scatter plot. Ricky Zanker at THT has a similar post today for those looking to get some extra exposure and another take on R programming. Today, I plan to extend on this with a little more customization. First, if you've missed...

Read more »

Tick data retrieval

January 31, 2011
By

I just published Java based code to pull tick data from Interactive Brokers. There are thousands tools to get tick data from IB, but I had one feature in mind. You can get maximum 50 quotes per second from Interactive Brokers (its IB limitation for TWS API) . Imagine a situation, when there is a

Read more »

DataMarket

January 31, 2011
By

I have just discovered yet another public data site www.datamarket.com. Most of the data are time-series. It collects together things like World bank, Eurostat, Gapminder into the one place. It also allows you to download data as csv files or to creat...

Read more »

R Tutorial Series: Two-Way ANOVA with Pairwise Comparisons

January 31, 2011
By
R Tutorial Series: Two-Way ANOVA with Pairwise Comparisons

By extending our one-way ANOVA procedure, we can test the pairwise comparisons between the levels of several independent variables. This tutorial will demonstrate how to conduct pairwise comparisons in a two-way ANOVA. Tutorial FilesBefore we begin, yo...

Read more »

Example 8.23: Expanding latent class model results

January 31, 2011
By
Example 8.23: Expanding latent class model results

In Example 8.21 we described how to fit a latent class model to data from the HELP dataset using SAS and R (using poLCA(), and then followed up in example 8.22 using randomLCA(). In both entries, we classified subjects based on their observed (manifes...

Read more »

R Tutorial Series: Two-Way ANOVA with Pairwise Comparisons

January 31, 2011
By
R Tutorial Series: Two-Way ANOVA with Pairwise Comparisons

By extending our one-way ANOVA procedure, we can test the pairwise comparisons between the levels of several independent variables. This tutorial will demonstrate how to conduct pairwise comparisons in a two-way ANOVA. Tutorial FilesBefore we begin, yo...

Read more »

A gentle introduction to R

January 31, 2011
By
A gentle introduction to R

Whenever a post on this blog requires some data analysis and perhaps a chart or two, my tool of choice is the versatile statistical programming package R. Developed as an open-source implementation of an engine for the S programming language, R is therefore free. Since commercial mathematical packages can costs thousands of dollars, this alone

Read more »