Enter SadMan

February 2, 2018
By

(This article was first published on HighlandR, and kindly contributed to R-bloggers)

Yet more Metalliplots

I’m just going to tidy up some issues from my last post where I did some tidytext analysis on the legendary rockers – Metallica.

It was a fun way to pass some time and keep my hand in with text mining, something I still don’t seem to get around to doing in the day job.

I was pretty annoyed at not getting my faceted split of top terms by descending order to plot by actual descending order.

Attempt 1:

2018-01-28-Most-Common-Words-by-Album.png

Many failed efforts later, I arrive at this:

Attempt 2 -getting better, but still not right. Julia, in the unlikely event you read this, WHAT am I doing wrong?

2018-02-03-Most-Common-Words-by-Album.png

Enough of my failures (not enough time,folks) lets look at sentiment on a line by line basis, instead of just a net score by track. To do this, I used the sentimentr package, by Tyler Rinker.

Stolen from the the package homepage on GitHub:
“sentimentr is designed to quickly calculate text polarity sentiment at the sentence level and optionally aggregate by rows or grouping variable(s)”…“sentimentr attempts to take into account valence shifters (i.e., negators, amplifiers (intensifiers), de-amplifiers (downtoners), and adversative conjunctions) while maintaining speed.”

It was certainly fast, allowing me to take my original data frame of lyrics (grouped by album, track and line number) and calculate a sentiment score. I then set upper and lower bounds for each line so I could use geom_ribbon as follows:

line_sentiment <-  sentimentr::sentiment(data$text)

data2 <- data %>% 
  filter(title %notin% c("Am I Evil?", "(Anesthesia) - Pulling Teeth")) %>% 
  mutate(linenumber = row_number()) %>% 
  left_join(line_sentiment, by=c("linenumber"="element_id")) %>% 
  group_by(Album,title) %>% 
  mutate(linenumber= row_number()) %>% 
  ungroup() %>% 

mutate(max = ifelse(sentiment > 0, sentiment, 0),
       min = ifelse(sentiment < 0, sentiment,0)) 
  
ggthemr(KEA)#custom palette
filter(data2,Album =="Kill_Em_All") %>% 
ggplot(aes(linenumber,sentiment),fill =title,colour="grey50")+
  #geom_col(show.legend = FALSE)+
  geom_ribbon(aes(ymin= min, ymax = max))+
  ggtitle("Kill Em All - Lyric Sentiment Polarity Line by Line")+
  xlab("Song Line #") +
  ylab("Sentiment polarity")+
  facet_wrap( track_n ~ title, ncol=5)+
  theme_minimal(base_size = 8)

In chronological order, and album specific colours, natch:

2018-02-01-Sentiment-by-track-KEA.png

2018-02-01-Sentiment-by-track-RTL.png

2018-02-01-Sentiment-by-track-MOP.png

2018-02-01-Sentiment-by-track-AJFA.png

2018-02-01-Sentiment-by-track-Black.png

2018-02-01-Sentiment-by-track-Load.png

2018-02-01-Sentiment-by-track-Reload.png

2018-02-01-Sentiment-by-track-Anger.png

2018-02-01-Sentiment-by-track-Magnetic.png

2018-02-01-Sentiment-by-track-Hardwired.png

Those of you paying attention last time might remember this plot:

2018-01-28-album-word-correlations-original.png

I tried recreating it with different seeds and limits, and that link between album one and ten still holds:

2018-01-28-album-word-correlations.png

So I thought I should revisit the topic modelling, this time, instead of by album, grouping them into the 90’s releases (Metallica,Load & Reload) and the first, and latest 2 (Kill Em All, Death Magnetic and Hardwired to Self Destruct).

Here are the resulting plots. Alhough I can determine where most of the words are coming from, I’m still not getting much of a feel for a definite “topic” as such:

The 90’s :

2018-02-03-Topic_Models-Nineties.png

Hardwire ‘Em All :

2018-02-03-Topic_Models-Hardwire-Em-All.png

And to finish, you write posts and hope folk like them, and this one went down quite well. Not everyone liked it (hence the title – I am “sad”, apparently) but even so, who cares, because Julia Silge made 2018 an awesome year already :

2018-01-28-reaction-good.PNG

Stuff like this makes staying up late battling with code worthwhile.

And of course, I get to use cutting edge data science tools and techniques.

That’s got to be worth a “Yeah!”

To leave a comment for the author, please follow the link and comment on their blog: HighlandR.

R-bloggers.com offers daily e-mail updates about R news and tutorials on topics such as: Data science, Big Data, R jobs, visualization (ggplot2, Boxplots, maps, animation), programming (RStudio, Sweave, LaTeX, SQL, Eclipse, git, hadoop, Web Scraping) statistics (regression, PCA, time series, trading) and more...



If you got this far, why not subscribe for updates from the site? Choose your flavor: e-mail, twitter, RSS, or facebook...

Comments are closed.

Search R-bloggers

Sponsors

Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)

Click here to close (This popup will not appear again)