These are the notes for the second lecture in the unit on text processing. Some useful ideas like exact string matching and the definitions of characters and strings are covered in the notes of Natural Language Processing in R: Strings and Regular Expressions Edit distance, also called Levenshtein distance, is ...

In this post, I go through a lesson in natural language processing (NLP), in R. Specifically, it covers how strings operate in R, how regular expressions work in the stringr package by Hadley Wickham, and some exercises. Included with the exercises are a list of expected hang-ups, as well as ...

A massive part of statistical software development is the documentation. Good documentation is more than just a help file, it serves as commentary on how the software works, includes use cases, and cites any relevant sources. One cool thing about R documentation is that it uses a system that allows ...

I'm toying with the idea of writing a book about statistical analyses of classic games. The target audience would be mathematically interested laypeople, much like Jeffrey Rosenthal's book Struck by Lightning ( https://www.amazon.ca/Struck-Lightning-Jeffrey-S-Rosenthal/dp/0006394957 ). The twist would be that chapter would contain step-by-step R code or Python ...

Section 1: Introduction – The Problem of Binned Data Hypothetically, say you’re given data like this in Table 1 below, and you’re asked to find the mean: Group Frequency 0 to 25 114 25 to 50 76 50 to 75 58 75 to 100 51 100 to 250 140 250 to 500 107 500 to 1000 77 1000 to 5000 124 5000 or more 42 Table 1: Example Binned Data.Border cases go to the lower bin. The ...

My previous Jeopardy analyzer was built using a base of about 30 daily Coryat scores. This one has more than 1600 scores that were either recorded directly, e-mailed to me, or scraped from the forum at jboard.tv . Here we look at the consistency of tou...