Help: stemming and stem completion with package tm in R

[This article was first published on RDataMining, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here)
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.

I came across a problem below when doing stemming and stem completion with package tm in R. Word “mining” was stemmed to “mine” with stemDocument(), and then completed to “miners”with stemCompletion(). However, I prefer to keep “mining” intact.

For stemCompletion(), the default type of completion is “prevalent”, which takes the most frequent match as completion. Although “mining” is much more frequent than “miners” in my text, it still completed “mine” to “miners”.

An example is shown below.

############################################
library(tm)
(a <- c("mining", "miners", "mining"))
(b <- stemDocument(a))
(d <- stemCompletion(b, dictionary=a))
############################################

Some possible solutions are:
1) to change the options or dictionary in stemDocument(), so that "mining" is not stemmed to "mine", which I think is the best way;
2) to change the options or dictionary in stemCompletion(), so that "mine" is completed to "mining";
3) to manually correct this after stem completion, which is the last option.

I am looking for a solution for above 1) or 2), but cannot find the way to do it with stemDocument() in package tm.

Any help will be appreciated.

Thanks,
Yanchang Zhao
Email: yanchangzhao(at)gmail.com

RDataMining: http://www.rdatamining.com
Twitter: http://twitter.com/RDataMining
Group on Linkedin: http://group2.rdatamining.com
Group on Google: http://group.rdatamining.com

To leave a comment for the author, please follow the link and comment on their blog: RDataMining.

R-bloggers.com offers daily e-mail updates about R news and tutorials about learning R and many other topics. Click here if you're looking to post or find an R/data-science job.
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.

Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)

Click here to close (This popup will not appear again)