143 search results for "web scraping"

Slightly Advanced rvest with Help from htmltools + XML + pipeR

November 26, 2014
By

Hadley Wickham’s post “rvest: easy web scraping with R” introduces the fine new package rvest very well.  For those now yearning a slightly more advanced example with a little help from pipeR + htmltools + XML, I thought this might fill your yea...

Read more »

What size will you be after you lose weight?

November 14, 2014
By
What size will you be after you lose weight?

REDDITORS’ BEFORE AND AFTER MEASUREMENTS ANALYZED Click to enlarge How many pounds do you need to lose in order to reduce your waistline by one inch? How many kilos do you need to lose to reduce your waistline by one centimeter? We wanted to find out. We were having trouble finding published data (though we The post

Read more »

UVA / Charlottesville R Meetup

September 11, 2014
By
UVA / Charlottesville R Meetup

TL;DR? We started an R Users group, awesome community, huge turnout at first meeting, lots of potential.---I've sat through many hours of meetings where faculty lament the fact that their trainees (and the faculty themselves!) are woefully ill-prepared...

Read more »

R User Group Roundup

August 28, 2014
By
R User Group Roundup

by Joseph Rickert In the first half of 2014, worldwide R user group activity continued to increase, showing impressive growth over the same periods for the past couple of years. For the last four months, the pace has been over 50 meetings per month. n There are now 147 user groups listed in Revolution Analytics' Local R User Group...

Read more »

Automatically Scrape Flight Ticket Data Using R and Phantomjs

April 30, 2014
By

I used to scrape static web pages with the R package RCurl. It’s a great package! When it comes to dynamic web pages, RCurl comes to be difficult to set up (actually, I never get it works). Then I met Phantomjs. PhantomJS is a headless WebKit scriptable with a JavaScript API. It has fast and native support for...

Read more »

Text Mining Gun Deaths Data

March 13, 2014
By
Text Mining Gun Deaths Data

In this post I will explore public data being collected by Slate.  I previously released code using a much early set of this data demonstrating how to turn this data into an animated map.This data began collection as a public response to the horri...

Read more »

Better handling of JSON data in R?

March 13, 2014
By

What is the best way to read data in JSON format into R? Though really common for almost all modern online applications, JSON is not every R user's best friend. After seeing the slides for my Web Scraping course, in which I somewhat arbitrarily veered between using the packages rjson and RJSONIO, the creator of a...

Read more »

Upcoming NYC R Programming Classes

March 10, 2014
By
Upcoming NYC R Programming Classes

It is our pleasure to once again offer the intensive R beginner level course for the third time! Beginning this Sunday, the 35 hour course will walk you through the basic operations and characteristics of R, all the way to having a firm understanding of data manipulation and visualization. Also launching this weekend are two... Read more »

Introduction

February 1, 2014
By

Through this blog I intend to work on some data analysis projects, publish the results here and get feedback from other data experts. I have exposure to R, Python, MATLAB and would be using suitable one of them based on needs. My interests range from W...

Read more »

Programming instrumental music from scratch

July 29, 2013
By
Programming instrumental music from scratch

I recently posted about automatically making music. The algorithm that I made pulled out interesting sequences of music from existing songs and remixed them. While this worked reasonably well, it also didn’t have full control over the basics of the music; it wasn’t actually specifying which instruments to use, or what notes to play. Maybe I’m being...

Read more »