150 search results for "web scraping"

50 years of Christmas at the Windsors

December 19, 2014
By
50 years of Christmas at the Windsors

It is that time of year again: Truckloads of lights are dumped into store windows, people scramble to get their Christmas shopping done, and it is becoming increasingly unbearable to listen to the radio. Of course, the most important element of the season is still ahead of us – all across the Commonwealth people are eagerly awating the Queen's...

Read more »

Power Outage Impact Choropleths In 5 Steps in R (featuring rvest & RStudio “Projects”)

November 27, 2014
By
Power Outage Impact Choropleths In 5 Steps in R (featuring rvest & RStudio “Projects”)

I and @awpiii were trading news about the power outages in Maine & New Hampshire last night and he tweeted the link to the @PSNH Outage Map. As if the Bing Maps tiles weren’t bad enough, the use of a categorical color scale instead of a sequential one caused sufficient angst that I whipped up

Read more »

Slightly Advanced rvest with Help from htmltools + XML + pipeR

November 26, 2014
By

Hadley Wickham’s post “rvest: easy web scraping with R” introduces the fine new package rvest very well.  For those now yearning a slightly more advanced example with a little help from pipeR + htmltools + XML, I thought this might fill your yea...

Read more »

What size will you be after you lose weight?

November 14, 2014
By
What size will you be after you lose weight?

REDDITORS’ BEFORE AND AFTER MEASUREMENTS ANALYZED Click to enlarge How many pounds do you need to lose in order to reduce your waistline by one inch? How many kilos do you need to lose to reduce your waistline by one centimeter? We wanted to find out. We were having trouble finding published data (though we The post

Read more »

UVA / Charlottesville R Meetup

September 11, 2014
By
UVA / Charlottesville R Meetup

TL;DR? We started an R Users group, awesome community, huge turnout at first meeting, lots of potential.---I've sat through many hours of meetings where faculty lament the fact that their trainees (and the faculty themselves!) are woefully ill-prepared...

Read more »

R User Group Roundup

August 28, 2014
By
R User Group Roundup

by Joseph Rickert In the first half of 2014, worldwide R user group activity continued to increase, showing impressive growth over the same periods for the past couple of years. For the last four months, the pace has been over 50 meetings per month. n There are now 147 user groups listed in Revolution Analytics' Local R User Group...

Read more »

Automatically Scrape Flight Ticket Data Using R and Phantomjs

April 30, 2014
By

I used to scrape static web pages with the R package RCurl. It’s a great package! When it comes to dynamic web pages, RCurl comes to be difficult to set up (actually, I never get it works). Then I met Phantomjs. PhantomJS is a headless WebKit scriptable with a JavaScript API. It has fast and native support for...

Read more »

Text Mining Gun Deaths Data

March 13, 2014
By
Text Mining Gun Deaths Data

In this post I will explore public data being collected by Slate.  I previously released code using a much early set of this data demonstrating how to turn this data into an animated map.This data began collection as a public response to the horri...

Read more »

Better handling of JSON data in R?

March 13, 2014
By

What is the best way to read data in JSON format into R? Though really common for almost all modern online applications, JSON is not every R user's best friend. After seeing the slides for my Web Scraping course, in which I somewhat arbitrarily veered between using the packages rjson and RJSONIO, the creator of a...

Read more »

Upcoming NYC R Programming Classes

March 10, 2014
By
Upcoming NYC R Programming Classes

It is our pleasure to once again offer the intensive R beginner level course for the third time! Beginning this Sunday, the 35 hour course will walk you through the basic operations and characteristics of R, all the way to having a firm understanding of data manipulation and visualization. Also launching this weekend are two... Read more »