You can find the complete code on github: https://github.com/JulianHill/R-Tutorials/blob/master/spam_class_r.r   Introduction: The topic Machine Learning gets more and more important. The number of data sources grows everyday and it makes it hard to get... The post Build a SPAM filter with ... [Read more...]

Last week, version 1.4 of RSiteCatalyst was released, and now it’s possible to get site pathing information directly within R. Now, it’s easy to create impressive looking network graphs from your Adobe Analytics data using RSiteCatalyst and d3Network. In this blog post, I will cover simple and force-directed ... [Read more...]

From today’s email: I have just finished reading a copy of ‘Forecasting:Principles and Practice’ and I have found the book really interesting. I have particularly enjoyed the case studies and focus on practical applications. After finishing the book I have joined a forecasting competition to put what I’... [Read more...]

In my previous post I wrote about the importance of age and why it is a good idea to try avoiding modeling it as a linear variable. In this post I will go through multiple options for (1) modeling non-linear effects in a linear regression setting, (2) benchmark the methods on a ... [Read more...]

I have read about people doing a Bayesian PCA at some points and always wondered how that would work. Then, at some point I thought of a way to do so. As ideas evolved my interest became not PCA as such, but rather in a prefmap. As a first step ... [Read more...]

Slides of 12 tutorials taught by data science experts and thought leaders at ACM SIGKDD 2014 are provided at http://www.kdd.org/kdd2014/tutorials.html. Below is a list of them. 1.Scaling Up Deep Learning Yoshua Bengio 2. Constructing and mining web-scale knowledge graphs Antoine … Continue reading → [Read more...]

This week I got my certificate of completion from the course "Doing Journalism with Data: First Steps, Skills and Tools"(if you like to know more about data journalism check out my post "3 Great Examples of Data Journalism Stories"). I enjoyed the course a lot, and I am proud of ... [Read more...]

In my last post, I agreed with Prof. Xiao-Li Meng that Advanced Placement (AP) Statistics courses turn off many students to the statistics field, by being structured in a manner that makes for a boring class.  I cited as one of the problems the fact that the course officially requires ... [Read more...]

The World Health Organization, Samaratins Purse, Doctors Without Borders, and other international medical emergency relief programs are desperately calling for additional resources in the international fight against Ebola that has already killed thousa... [Read more...]

[Read more...]

Bayesian Lasso $$begin{align*} p(Y_{o}|beta,phi)&=N(Y_{o}|1alpha+X_{o}beta,phi^{-1} I_{n{o}})\ pi(beta_{i}|phi,tau_{i}^{2})&=N(beta_{i}|0, phi^{-1}tau_{i}^{2})\ pi(tau_{i}^{2})&=Exp left( frac{lambda}{2} right)\ pi(phi)&propto phi^{-1}\ pi(alpha)&propto 1\ ... [Read more...]

In case you missed them, here are some articles from August of particular interest to R users: R is the most popular software in the KDNuggets poll for the 4th year running. The frequency of R user group meetings continues to rise, and there are now 147 R user groups worldwide. ... [Read more...]

Currently, I am taking Statistics for Image Analysis on my masteral, and have been exploring this topic in R. One package that has the capability in this field is the EBImage from Bioconductor, which will be showcased in this post.InstallationFor those... [Read more...]

Karl Broman did a spiffy job summarizing a good number of the options available to R folk if they want to get notifications from R. You can also generate OS X notifications as well. If you’re using Slack for team coordination and communications, you’ve got a new option ... [Read more...]

Over the past years, I’ve been living in different cities, all of them being completely different, compared with the others. I have been living in Paris, which is a big city in Europe, with a large neighborhood, too (la banlieue). Then, I’ve been living in Hong Kong, which ... [Read more...]

I saw a post recently about the likelihood of a baseball team winning based on how many runs, hits, and other baseball statistics. I liked the idea and thought of applying that to college football. Particularly, I'm interested in knowing whether scorin... [Read more...]

I’m enthusiastic about having R notify me when my script is done. But among my early uses of this, my script threw an error, and I never got a text or pushbullet about that. And really, I’m even more interested in being notified about such errors than anything ... [Read more...]

We’re happy to announce the release of our latest R package, shinyTree. shinyTree is an integration of the jsTree library with the Shiny interactive web framework for R, which makes it simple for R developers to create web applications without knowing anything about HTML or JavaScript. You can view ... [Read more...]

I often have had requests for a spell checker for R character vectors. The utils::aspell function can be used to check spelling but many Windows users have reported difficulty with the function. I came across an article on spelling in … Continue reading → [Read more...]

As the normal distribution is sort of the default choice when modeling continuous data (but not necessarily the best choice), the Poisson distribution is the default when modeling counts of events. Indeed, when all you know is the number of events during a certain period it is hard to think ... [Read more...]