ANCOVA in R, Analysis of covariance is used to measure the main effect and interaction effects of categorical variables on a continuous dependent variable while controlling the effects of selected other continuous variables which is co-vary with the dependent.

ANCOVA in R

We can take one of the simple examples to conduct ANCOVA in R. Identify the studying technique has an impact on exam scores by using the following parameters.

Technique: Interested variable to analyze (independent variable) the effect of techniques affect the score or not.

Grade: The covariate that we want to take into account, current grade of the student.

Score: The response variable (dependent variable) interested in analyzing

Let’s create a data frame contains the information for 90 students that were randomly split into three groups of 30.

Here we mentioned three techniques that are coded as A, B, and C.

Let’s make use of set.seed for repeatability.

LSTM Network in R » Recurrent Neural network »

set.seed(123)

Create the data set in R

  technique    grade     exam
1         A 73.47893 85.08908
2         A 83.09936 85.09367
3         A 74.84477 76.24713
4         A 82.08737 70.51951
5         A 73.10378 79.11569
6         A 68.68576 73.62893

Explore the Data

Once we have the dataset for analysis, we need to examine the data set first, like extreme values NA values etc.

Let’s create a summary of the current dataset.

summary(data)
technique             grade            exam     
 Length:90          Min.   :65.02   Min.   :60.79 
 Class :character   1st Qu.:69.43   1st Qu.:75.46 
 Mode  :character   Median :74.21   Median :83.06 
                    Mean   :74.55   Mean   :82.03 
                    3rd Qu.:79.65   3rd Qu.:88.60 
                    Max.   :84.67   Max.   :94.91

Here we can see the minimum, maximum, mean and average values. No need to make any extra changes here because our dataset as good it is.

The standard deviation is one of the important factors, we need to get the dispersion of the current dataset.

Linear optimization using R » Optimal Solution »

library(dplyr)
   data %>%
            group_by(technique) %>%  
            summarise(mean_grade = mean(grade),
            sd_grade = sd(grade),
            mean_exam = mean(exam),
            sd_exam = sd(exam))
technique mean_grade sd_grade mean_exam  sd_exam
1         A   74.08737 5.829004  82.72918 8.682884
2         B   74.71526 5.274380  77.47258 9.658907
3         C   74.84389 6.580034  85.89504 3.567625

We can see that the mean and the standard deviations of the current grade is more or less the same.

We can make use of boxplots for the visualization

boxplot(exam ~ technique,
data = data,
main = "Score by Technique",
xlab = "Technique",ylab = "Score",
col = "red",border = "black")

Similarly, we can also use boxplots to visualize the distribution of current grades.

boxplot(grade ~ technique,data = data,
main = "Current Grade by Technique",
xlab = "Technique",ylab = "Current Grade",
col = "red",border = "black")

Model Assumptions

When we do ANCOVA, we need to check some basic assumptions.

1. The covariate and the treatment are independent

Need to verify that the covariate in this case grade and the technique are independent to each other.

2.Homogeneity of variance

Verify the variances among the groups is equal or not

For assumption 1 we can make use of the ANOVA model.

Exploratory Data Analysis (EDA) » Overview »

Let’s fit the model,

model <- aov(grade ~ technique, data = data)
summary(model)
Df Sum Sq Mean Sq F value Pr(>F)
technique    2    9.8    4.92    0.14  0.869
Residuals   87 3047.7   35.03

The p-value is 0.869 that is greater than 0.05, so the covariate grade and the treatment technique are independent to each other.

For assumption 2, we can make use of Levene’s Test,

library(car)
leveneTest(exam~technique, data = data)
      Df F value    Pr(>F)   
group  2  13.752 6.464e-06 ***
      87                     
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

The p-value of the test is 6.464e-06, which indicates that the variances among the groups are not equal. It indicates the need to transform the exam variable for the equal group variance.

However, for illustration purposes, we are continuing with the existing dataset and are not much interested in unequal variances.

Principal component analysis (PCA) in R »

Fit analysis of covariance model ANCOVA in R

library(car)
ancova_model <- aov(exam ~ technique + grade, data = data)
Anova(ancova_model, type="III")

Anova Table (Type III tests)

Response: exam

            Sum Sq Df F value    Pr(>F)   
(Intercept) 3492.4  1 57.1325 4.096e-11 ***
technique   1085.8  2  8.8814 0.0003116 ***
grade          4.0  1  0.0657 0.7982685   
Residuals   5257.0 86                     
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

From this result, we can easily conclude that while controlling grade variable still technique variable is statistically significant. It indicates that the technique variable has significantly contributed to the model.

Now we want to know which techniques are different from each other.

Make usage multi-comp package for pairwise comparison.

Cluster Meaning-Cluster or area sampling in a nutshell »

library(multcomp)
ancova_model <- aov(exam ~ technique + grade, data = data)
postHocs <- glht(ancova_model, linfct = mcp(technique = "Tukey"))
summary(postHocs)

Simultaneous Tests for General Linear Hypotheses

Multiple Comparisons of Means: Tukey Contrasts

Fit: aov(formula = exam ~ technique + grade, data = data)

Linear Hypotheses:

           Estimate Std. Error t value Pr(>|t|)   
B - A == 0   -5.279      2.021  -2.613   0.0284 * 
C - A == 0    3.138      2.022   1.552   0.2719   
C - B == 0    8.418      2.019   4.170   <0.001 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
(Adjusted p values reported -- single-step method)

Now it’s clear a significant difference was observed between the pairs B vs A  and C vs B.

Conclusion

From the above technique, A is significantly better than B, and technique C is significantly better than A.

Read:-Backwaters of Kerala-PSC GK Questions » PSC Mock Test

The post How to perform ANCOVA in R appeared first on finnstats.