Expand broom::tidy() output for categorical parameter estimates

[This article was first published on r-bloggers on Guy Abel, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here)
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.

Introduction

The tidycat package includes the tidy_categorical() function to expand broom::tidy() outputs for categorical parameter estimates.

Documentation

For full documentation, see the package vignette: The tidycat package: expand broom::tidy() output for categorical parameter estimates

Hello World

The tidy() function in the broom package takes the messy output of built-in functions in R, such as lm(), and turns them into tidy data frames.

library(dplyr)
library(broom)

m1 <- mtcars %>%
  mutate(transmission = recode_factor(am, `0` = "automatic", `1` = "manual")) %>%
  lm(mpg ~ as.factor(cyl) + transmission + wt *  as.factor(cyl), data = .)

tidy(m1)
## # A tibble: 7 x 5
##   term               estimate std.error statistic       p.value
##   <chr>                 <dbl>     <dbl>     <dbl>         <dbl>
## 1 (Intercept)          41.5        4.54     9.14  0.00000000190
## 2 as.factor(cyl)6      -8.66      10.4     -0.836 0.411        
## 3 as.factor(cyl)8     -16.9        5.27    -3.20  0.00374      
## 4 transmissionmanual   -0.902      1.51    -0.595 0.557        
## 5 wt                   -6.19       1.65    -3.75  0.000937     
## 6 as.factor(cyl)6:wt    2.12       3.40     0.625 0.538        
## 7 as.factor(cyl)8:wt    3.84       1.77     2.17  0.0399

The tidy_categorical() function adds

  • further columns (variable, level and effect) to the broom::tidy() output to help manage categorical variables
  • further rows for reference category terms and a column to indicate their location (reference) when setting include_reference = TRUE (default)

It requires two inputs

  • a data frame d of parameter estimates from a model from broom::tidy()
  • the corresponding model object m passed to broom::tidy()

For example:

library(tidycat)
d1 <- m1 %>%
  tidy(conf.int = TRUE) %>%
  tidy_categorical(m = m1)
d1 %>%
  select(-(3:5))
## # A tibble: 10 x 8
##    term      estimate conf.low conf.high variable    level  effect  reference   
##    <chr>        <dbl>    <dbl>     <dbl> <chr>       <fct>  <chr>   <chr>       
##  1 (Interce~   41.5     32.1       50.8  (Intercept) (Inte~ main    Non-Baselin~
##  2 <NA>         0        0          0    as.factor(~ 4      main    Baseline Ca~
##  3 as.facto~   -8.66   -30.0       12.7  as.factor(~ 6      main    Non-Baselin~
##  4 as.facto~  -16.9    -27.7       -6.00 as.factor(~ 8      main    Non-Baselin~
##  5 <NA>         0        0          0    transmissi~ autom~ main    Baseline Ca~
##  6 transmis~   -0.902   -4.02       2.22 transmissi~ manual main    Non-Baselin~
##  7 wt          -6.19    -9.59      -2.79 wt          wt     main    Non-Baselin~
##  8 <NA>         0        0          0    as.factor(~ 4      intera~ Baseline Ca~
##  9 as.facto~    2.12    -4.87       9.12 as.factor(~ 6      intera~ Non-Baselin~
## 10 as.facto~    3.84     0.192      7.50 as.factor(~ 8      intera~ Non-Baselin~

The expanded data frame from tidy_categorical() of parameter estimates can be particularly useful for creating coefficient plots, allowing:

  • grouping terms from the same categorical variable from the additional columns.
  • inclusion of reference categories in a coefficient plot from the additional rows, allowing the reader to better grasp the meaning of the parameter estimates in each categorical variable.

For example:

library(forcats)
library(ggplot2)
library(ggforce)

d1 %>%
  slice(-1) %>%
  mutate(variable = fct_inorder(variable)) %>%
  ggplot(mapping = aes(x = level, y = estimate, colour = reference,
                       ymin = conf.low, ymax = conf.high)) +
  facet_row(facets = "variable", scales = "free_x", space = "free") +
  geom_hline(yintercept = 0, linetype = "dashed") +
  geom_pointrange()

Installation

You can install the released version of tidycat from CRAN with:

install.packages("tidycat")

And the development version from GitHub with:

# install.packages("devtools")
devtools::install_github("guyabel/tidycat")

To leave a comment for the author, please follow the link and comment on their blog: r-bloggers on Guy Abel.

R-bloggers.com offers daily e-mail updates about R news and tutorials about learning R and many other topics. Click here if you're looking to post or find an R/data-science job.
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.

Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)

Click here to close (This popup will not appear again)