Get Data – Safe, Easy, and Free

March 22, 2016

(This article was first published on data_steve, and kindly contributed to R-bloggers)

googleformr Genesis

googleformr came out of a persistent series of questions: How to
collect data remotely? And do it programmatically with R? And safely,
easily, and free?

Google seemed like an obvious choice. So gmail it? Save it as a
spreadsheet and then email it? Aggregation is really an issue here.

Or do the public Google Sheets? or private Google Sheets with
permissions set and authorizations required? A real hassle if you just
want to collect new data. And writing directly to Spreadsheets, you may
accidentally overwrite your own data.

Or maybe Dropbox? And public folder? But same problem as public Google
Spreadsheets, people can not only write to the resource, but also read
and edit it potentially.

The Ah-ha

And then, it hit me. All those class surveys I used to send out as a
research prof, trying to be a better instructor. The students saw the
pretty surveys, I saw the clean tabular data. They could write the data,
but only what I gave them as a choice and always to a new row.

So, I hit on the idea to POST data to a Google Form as a way to publicly
expose a data collection point, but with more control about what and how
it could be written into my tables. It’s like your very own POST API.

Not only is Google Forms a great little public data interface that R can
POST to, but can begin to imagine ways of leveraging that behavior in a
lot of interesting ways. More about that in later posts.


I wrote the
package with some wrapper functions around the httr and rvest packages
that helps facilitate POSTing information to your very own Google Forms.
You just send the data, Google Forms handles the organization.
Additionally, they email you each time you get a posting.

Once you create your Google Form as you like on your own account, my
package helps you get the info you need to build functions that write
directly to that form.

The 0.0.1 version of the package lets you get the POST data. More
functionality around data validation and reading from your private
spreadsheet is anticipated in future updates.


To leave a comment for the author, please follow the link and comment on their blog: data_steve. offers daily e-mail updates about R news and tutorials on topics such as: Data science, Big Data, R jobs, visualization (ggplot2, Boxplots, maps, animation), programming (RStudio, Sweave, LaTeX, SQL, Eclipse, git, hadoop, Web Scraping) statistics (regression, PCA, time series, trading) and more...

If you got this far, why not subscribe for updates from the site? Choose your flavor: e-mail, twitter, RSS, or facebook...

Comments are closed.


Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)

Click here to close (This popup will not appear again)