At the Strata conference in New York today, Steve Yun (Principal Predictive Modeler at Allstate's Research and Planning Center) described the various ways he tackled the problem of fitting a generalized linear model to 150M records of insurance data. He evaluated several approaches: Proc GENMOD in SAS Installing a Hadoop cluster Using open-source R (both on the full data...
205 search results for "hadoop"
Quick notes from Strata NYC 2012
The O'Reilly Strata conferences are always great fun to attend, and this latest installment in New York City is no exception. This one is super-busy though; the conference has been sold out for weeks -- and not just marketing-sold-out, it's fire-department-sold out. It's non-stop conversations and presentations, and it's tough to move through the hallways in between. Nonetheless, I...
Two Talks on Data Science, Big Data and R
On Thursday next week (November 1), I'll be giving a new webinar on the topic of Big Data, Data Science and R. Titled "The Rise of Data Science in the Age of Big Data Analytics: Why Data Distillation and Machine Learning Aren’t Enough", this is a provocative look at why data scientists cannot be replaced by technology, and why...
Predict User’s Return Visit within a day part-3
Welcome to the last part of the series on predicting user’s revisit to the website. In the first part of series, I generated the logistic regression model for prediction problem whether a user will come back on website in next 24 hours. In the second part, I discussed about model improvement and seen the model accuracy.
Predict User’s Return Visit within a day part-2
Welcome to the second part of the series on predicting user’s revisit to the website. In my earlier blog Logistic Regression with R, I discussed what is logistic regression. In the first part of the series, we applied logistic regression to available data set. The problem statement there was whether a user will return in
Predict User’s Return Visit within a day part-1
In my earlier blog, I have discussed about what is logistic regression? And how logistic model is generated in R? Now we will apply that learning on a specific problem of prediction. In this post, I will create a basic model to predict whether a user will return on website in next 24 hours. This
Logistic Regression with R
Logistic Regression In my first blog post, I have explained about the what is regression? And how linear regression model is generated in R? In this post, I will explain what is logistic regression? And how the logistic regression model is generated in R? Let’s first understand logistic regression. Logistic regression is one of the
Vendor news: TIBCO’s proprietary R runtime; Teradata’s appliance integrates R
In a webinar today previewing Spotfire 5 (scheduled for release this November), TIBCO announced that it will include TERR: The Tibco Enterprise Runtime for R. TERR is a closed-source reimplementation of the R language engine, and not based on the GPL-licensed R project from the R Foundation. Here's the relevant slide from the webinar: By making the TERR engine...
Nine lightning talks on R
At Tuesday's Bay Area R User Group meetup, nine speakers gave five-minute talks on various aspects of R. Revolution Analytics' Luba Gloukhov was one of the presenters, and also provides the summary of the talks below. Links to the slides are included where available for you to check out. Ariel Faigon: Chrestomathy with R Ariel walked us through his...
Revolution Newsletter: September/October 2012
The most recent edition of the Revolution Newsletter is out. The news section is below, and you can read the full September/October edition (with highlights from this blog and community events) online. You can subscribe to the Revolution Newsletter to get it monthly via email. New R Courses Announced: Two new courses presented by Bob Muenchen (author of R...
Zero Inflated Models and Generalized Linear Mixed Models with R.
Zuur, Saveliev, Ieno (2012).
