More on Bias Corrected Standard Deviation Estimates

[This article was first published on R – Win-Vector Blog, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here)
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.

This note is just a quick follow-up to our last note on correcting the bias in estimated standard deviations for binomial experiments.

For normal deviates there is, of course, a well know scaling correction that returns an unbiased estimate for observed standard deviations.

It (from the same source):

… provides an example where imposing the requirement for unbiased estimation might be seen as just adding inconvenience, with no real benefit.

Let’s make a quick plot comparing the naive estimate of standard deviation (“forgetting to use n-1 in the denominator”) and the Bessel corrected estimate (the square-root of the Bessel corrected variance). It is well known that the naive estimate is biased-down and under-estimates both the variance and standard deviation. The Bessel correction deliberately inflates the variance estimate to get the expected value right (i.e., to remove the bias). However, as we can see in the following graph: for the standard deviation the correction is too much. The square-root of the Bessel corrected variance is systematically an over-estimate of the standard deviation.

We can show this graphically as follows.

Unnamed chunk 1 1

The above graph is portraying, for different sample sizes (n), the ratio of the expected values of the various estimates to the true value of the standard deviation (for observations from an i.i.d. normal random source). So: an unbiased estimate would lie on the line y=1.

Notice the Bessel corrected is further away from the true value of the standard deviation than the naive estimate was (just biased in the opposite direction). So from the standard-deviation point of view the Bessel correction isn’t really better than the naive estimate.

All work is shared here.

To leave a comment for the author, please follow the link and comment on their blog: R – Win-Vector Blog.

R-bloggers.com offers daily e-mail updates about R news and tutorials about learning R and many other topics. Click here if you're looking to post or find an R/data-science job.
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.

Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)

Click here to close (This popup will not appear again)