308 search results for "web scraping"

Simple R Screen Scraping Example

February 18, 2011
By

by Earl F. Glynn, Kansas Watchdog The goal of this exercise is to show how to “screen scrape” data from an online web page using R. Additional articles will extend this example to scrape data from 105 Kansas county pages to form a statewide...

Read more »

Scrape Web data using R

August 13, 2010
By
Scrape Web data using R

Plenty of people have been scraping data from the web using R for a while now, but I just completed my first project and I wanted to share the code with you.  It was a little hard to work through some of the “issues”, but I had some great help from @DataJunkie on twitter. As

Read more »

Using MCA and variable clustering in R for insights in customer attrition

April 21, 2017
By
Using MCA and variable clustering in R for insights in customer attrition

Analytical challenges in multivariate data analysis and predictive modeling include identifying redundant and irrelevant variables. A recommended analytics approach is to first address the redundancy; which can be achieved by identifying groups of variables that are as correlated as possible among themselves and as uncorrelated as possible with other variable groups in the same data Related Post

Read more »

Russell 2000 Quantitative Stock Analysis in R: Six Stocks with Amazing, Consistent Growth

November 29, 2016
By
Russell 2000 Quantitative Stock Analysis in R: Six Stocks with Amazing, Consistent Growth

The Russell 2000 Small-Cap Index, ticker symbol: ^RUT, is the hottest index of 2016 with YTD gains of over 18%. The index components are interesting not only because of recent performance, but because the top performers either grow to become mid-cap stocks or are bought by large-cap companies at premium prices. This means selecting the best components...

Read more »

Sentimental Analysis of the First Presidential Debate of 2016 Using Machine Learning

September 27, 2016
By
Sentimental Analysis of the First Presidential Debate of 2016 Using Machine Learning

This post analyzes sentiment of people towards the 2016 presidential candidates post the First Presidential Debate using Tweets. We focus on Tweets containing the names of Hillary Clinton and Donald Trump.Let’s load the required packageslibrary(twitteR)library(ROAuth)require(RCurl)library(stringr)library(tm)library(plyr)library(tm)library(wordcloud)Setting up Twitter Authenticationconsumer_key = "consumer_key"consumer_secret = "consumer_secret"token_secret = "token_secret"access_token = "access_token"authenticate <- OAuthFactory$new(consumerKey = consumer_key,consumerSecret = consumer_secret,requestURL="https://api.twitter.com/oauth/request_token",accessURL="https://api.twitter.com/oauth/access_token",authURL="https://api.twitter.com/oauth/authorize")setup_twitter_oauth(consumer_key, consumer_secret, access_token, token_secret)Web ScrapingLet’s search what has been tweeted...

Read more »

Mastering the art of Data Preparation II

September 15, 2016
By
Mastering the art of Data Preparation II

It is not the beauty of a building you should look at; it is the construction of the foundation that will stand the test of time. ~ David Allan CoeThis week we focus on getting data from MYSQL, HDF5, API and the WEB.Extracting Data from MYSQLMysql is one of the most widely used open source databases.The data is stored in tabular format...

Read more »

Mastering the Art of Data Preparation I

September 6, 2016
By
Mastering the Art of Data Preparation I

Without a solid foundation, you’ll have trouble creating anything of value. ~ Erika OppenheimerAlthough building models to predict the future outcome is the ultimate goal of any study, getting the data and preparing it for analysis is the foundation based on which the models are built. Although often neglected, this quintessential step is of paramount importance for the success...

Read more »

Exploring Fitness Data in R

September 5, 2016
By
Exploring Fitness Data in R

Back in late February, I purchased a Microsoft Band 2. While I don’t exercise every day, I thought it would be fun to track the few health activities I can record. After five months, I’ve got quite a bit of daily step data and a few miles of jogging under my belt. I thought I would begin...

Read more »

Day Drinking with R

July 14, 2016
By

My first R package on CRAN, ttbbeer - After attending the useR! 2016 R Conference, I felt supercharged and armed with new insights and ideas about how to further contribute to the R community. I met wonderful people in real life (IRL) from twitter and heard interesting case studies about using R for large data analysis....

Read more »

Introduction to R: For Beginners Who Want to be Intermediate

February 28, 2016
By
Introduction to R: For Beginners Who Want to be Intermediate

This semester, I am managing an undergraduate on our research team. She has a basic engineering statistics background with a little experience doing analysis in Excel and understands some basic programming concepts. For her project with our group, she will have to learn R. I tried to compile a list of high quality videos...

Read more »

Sponsors

Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)

Click here to close (This popup will not appear again)