161 search results for "web scraping"

R Screen Scraping: 105 Counties of Election Data

February 18, 2011
By

by Earl F. Glynn, Kansas Watchdog The goal of this article is to show how to visit 105 online web pages programmatically and “scrape” data from them to form a statewide summary of election data in Kansas. An earlier article gave details of ...

Read more »

Simple R Screen Scraping Example

February 18, 2011
By

by Earl F. Glynn, Kansas Watchdog The goal of this exercise is to show how to “screen scrape” data from an online web page using R. Additional articles will extend this example to scrape data from 105 Kansas county pages to form a statewide...

Read more »

Scrape Web data using R

August 13, 2010
By
Scrape Web data using R

Plenty of people have been scraping data from the web using R for a while now, but I just completed my first project and I wanted to share the code with you.  It was a little hard to work through some of the “issues”, but I had some great help from @DataJunkie on twitter. As

Read more »

Digital Data Collection course

March 20, 2015
By

Another year, another web scraping course. Taught through SSRMC at the University of Cambridge. Below are slides from all three sessions.In the course I tried to achieve the following:- Show how to connect R to resources online- Use loops and functions...

Read more »

Getting Data From An Online Source

March 6, 2015
By

Getting Data From One Online SourceRobert NorbergHello world. It’s been a long time since I posted anything here on my blog. I’ve been busy getting my Masters degree in statistical computing and I haven’t had much free time to blog. But I’ve writing R code as much as ever. Now, with graduation approaching, I’m job hunting and I thought it would...

Read more »

Playing around with #rstats twitter data

Playing around with #rstats twitter data

As a bit of weekend fun, I decided to briefly look into the #rstats twitter data that Stephen Turner collected and made available (thanks!). Essentially, this data set contains some basic information about over 100,000 tweets that contain the hashtag… Continue reading →

Read more »

50 years of Christmas at the Windsors

December 19, 2014
By
50 years of Christmas at the Windsors

It is that time of year again: Truckloads of lights are dumped into store windows, people scramble to get their Christmas shopping done, and it is becoming increasingly unbearable to listen to the radio. Of course, the most important element of the season is still ahead of us – all across the Commonwealth people are eagerly awating the Queen's...

Read more »

Power Outage Impact Choropleths In 5 Steps in R (featuring rvest & RStudio “Projects”)

November 27, 2014
By
Power Outage Impact Choropleths In 5 Steps in R (featuring rvest & RStudio “Projects”)

I and @awpiii were trading news about the power outages in Maine & New Hampshire last night and he tweeted the link to the @PSNH Outage Map. As if the Bing Maps tiles weren’t bad enough, the use of a categorical color scale instead of a sequential one caused sufficient angst that I whipped up

Read more »

Slightly Advanced rvest with Help from htmltools + XML + pipeR

November 26, 2014
By

Hadley Wickham’s post “rvest: easy web scraping with R” introduces the fine new package rvest very well.  For those now yearning a slightly more advanced example with a little help from pipeR + htmltools + XML, I thought this might fill your yea...

Read more »

What size will you be after you lose weight?

November 14, 2014
By
What size will you be after you lose weight?

REDDITORS’ BEFORE AND AFTER MEASUREMENTS ANALYZED Click to enlarge How many pounds do you need to lose in order to reduce your waistline by one inch? How many kilos do you need to lose to reduce your waistline by one centimeter? We wanted to find out. We were having trouble finding published data (though we The post

Read more »