Working on big data requires a clean and robust approach on storing and accessing the data. SQLite is an all inclusive server-less database system in a single file. This is very convenient for data exchange between colleagues. Here is a workflow of SQLite data accessing and data storing in R. ... [Read more...]

Last week, I covered the boilerplate code in quantstrat. This post will cover parameters and adding indicators to strategies in … Continue reading → [Read more...]

this post and accompanying syntax would not have been possible without dan oberski.  read more, find out why.  thanks dan.dear survey administrator: someone sent you this link because you work for an organization or a government agency that c... [Read more...]

At the useR! 2014 conference, without a doubt one of the overriding themes was R’s... [Read more...]

On the weekend, randomly after watching Catching Fire, I remember the problem of the typing monkeys (Infinite monkey theorem) in which basically could be defined as (Thanks to Wiki):# *******************#  INTRODUCTION# *******************The infi... [Read more...]

Graduate student Clay McLeod decided to find out what makes a post on the social-sharing site Reddit popular. These are the questions he seeks to answer: What’s in a post? Reddit pulls in around 115 million unique visitors each month, amassing a staggering 5 billion page views per month. For a ... [Read more...]

I joined the Geekli.st climate Hackathon this weekend at the Hub Westminster (my favorite venue for Hackathons). While the organizers had lots of enthusiasm they had very little in the way of data for us to work on. No problem, ever since the Flood-relief hackathon I have wanted to ... [Read more...]

During July I was working with a commercial data source that provides extra data around IP addresses and it dawned on me: rather than pinging billions of IP addresses and creating map, I could create a map from all the geolocation data I had at my finger tips. At a ... [Read more...]

Not all Principal Component Analysis (PCA) (also called Empirical Orthogonal Function analysis, EOF) approaches are equal when it comes to dealing with a data field that contain missing values (i.e. "gappy"). The following post compares several methods by assessing the accuracy of the derived PCs to reconstruct the "true" ... [Read more...]

Well, not that you really probably want to know how to say such an absurdly large number. However for those of you who are interested (allowing for rounding) it is:one quintillion, three hundred forty quadrillion, one hundred sixty-four trillion, one h... [Read more...]

√(x²−1)(x²−k²), k∈ℂ x²√(x²−1)(x²−k²).      x,k∈ℂ (actually just going over the unit circle, not all of ℂ) edit: hey, are these showing up as moving gif’s for you? code: require(animation) source(wegert.R) #where I define "plat" and "Z", standard for all Wegert plots i = ... [Read more...]

This was generated using R and ggplot2. The code and details are coming soon. Departure of 2014 US Open Tennis Players was originally published by Vivek Patil at Adventures in Analytics and Visualization on September 15, 2014. [Read more...]

Over the years of my graduate studies I made a lot of plots. I mean tonnes. To get an extremely conservative estimate I grep’ed for every instance of “plot(” in all of the many R scripts I wrote over the past five years. The actual number is very likely ... [Read more...]

Preference mapping is a key technique in sensory and consumer research. It links the sensory perception on products to the liking of products and hence provides clues to the development of new, well tasting, products. Even though it is a key technique,... [Read more...]

by Yanchang Zhao, RDataMining.com I have made a series of slides on R and data mining, based on my book titled R and Data Mining — Examples and Case Studies. The slides will be used at my presentations at seminars … Continue reading → [Read more...]

"...a metaphor is an affair between a predicate with a past and an object that yields while protesting." Nelson Goodman (1976)It is, as if, data matrices were alive. The rows are species, and the columns are habitats. At least that seems to be the... [Read more...]

Welcome to Mood Stochastic. This blog explores the development of performance-oriented software, as applied to the areas of statistics, predictive analytics and machine learning. [Read more...]

Google has just released a new package for R: CausalImpact. Amongst many other things, this package allows Google to resolve the classical conundrum: how can we asses the impact of an intervention (for example, the effect of an advertising campaign on website clicks) when we can't know what would have ... [Read more...]

Enough with the theory we recently published, let's take a break and have fun on the application of Statistics used in Data Mining and Machine Learning, the k-Means Clustering.k-means clustering is a method of vector quantization, originally from signa... [Read more...]

Mario Morales –a Colombian-American, Statistician-Bioinformatician, Member of the R community and a regular attendant of the UseR conference since 2007 has launched a [Read more...]