1539 search results for "regression"

Twelve Days 2013: LASSO Regression

December 19, 2013
By

Day Eight: LASSO Regression TL/DR LASSO regression (least absolute shrinkage and selection operator) is a modified form of least squares regression that penalizes model complexity via a regularization parameter. It does so by including a term proportional to $||\beta||_{l_1}$ in the objective function which shrinks coefficients towards zero, and can even eliminate them entirely. In that light, LASSO is a...

Read more »

Logistic Regression with R: step by step implementation part-2

December 8, 2013
By
Logistic Regression with R: step by step implementation part-2

Welcome to the second part of series blog posts! In previous part, we discussed on the concept of the logistic regression and its mathematical formulation. Now, we will apply that learning here and try to implement step by step in R. (If you know concept of logistic regression then move ahead in this part, otherwise The post Logistic...

Read more »

Using R to replicate common SPSS multiple regression output

December 4, 2013
By

(This article was first published on Jeromy Anglim's Blog: Psychology and Statistics, and kindly contributed to R-bloggers) The following post replicates some of the standard output you might get from a multiple regression analysis in SPSS. A copy of the code in RMarkdown format is available on github. The post was motivated by this previous post that discussed using...

Read more »

Logistic Regression with R: step by step implementation part-1

November 30, 2013
By
Logistic Regression with R: step by step implementation part-1

Very warm welcome to first part of my series blog posts. In previous blog post, we discussed about concept of the linear regression and its mathematical model representation.  We also tried to implement linear regression in R step by step. In this post I will discuss about the logistic regression  and how to implement the The post Logistic...

Read more »

Bayesian Linear Regression Analysis (with non-informative priors but without Monte Carlo) In R

November 24, 2013
By
Bayesian Linear Regression Analysis (with non-informative priors but without Monte Carlo) In R

Continuing the previous post concerning linear regression analysis with non-informative priors in R, I will show how to derive numerical summaries for the regression parameters without Monte Carlo integration. The theoretical background for this post is contained in Chapter 14 of Bayesian Data Analysis which should be consulted for more information. The Residual Standard Deviation The

Read more »

Binomial regression model

November 18, 2013
By
Binomial regression model

Most of the time, when we introduce binomial models, such as the logistic or probit models, we discuss only Bernoulli variables, . This year (actually also the year before), I discuss extensions to multinomial regressions, where  is a function on some simplex. The multinomial logistic model was mention here. The idea is to consider, for instance with three possible classes the following...

Read more »

Bayesian linear regression analysis without tears (R)

November 17, 2013
By
Bayesian linear regression analysis without tears (R)

Bayesian methods are sure to get some publicity after Vale Johnson’s PNAS paper regarding the use of Bayesian approaches to recalibrate p-value cutoffs from 0.05 to 0.005. Though the paper itself is bound to get some heat (see the discussion in Andrew Gelman’s blog and Matt Briggs’s fun-to-read deconstruction), the controversy might stimulate people to explore

Read more »

Linear Regression with R : step by step implementation part-2

November 16, 2013
By
Linear Regression with R : step by step implementation part-2

Welcome to the second part! In previous part, we understood Linear regression, cost function and gradient descent. In this part we will implement whole process in R step by step using example data set. I will use the data set provided in the machine learning class assignment. We will implement linear regression with one variable The post Linear...

Read more »

Linear Regression with R : step by step implementation part-1

November 16, 2013
By
Linear Regression with R : step by step implementation part-1

Welcome to the first part of my series blog post. In this post, I will discuss about how to implement linear regression step by step in R by understanding the concept of regression. I will try to explain the concept of linear regression in very short manner and try to convert mathematical formulas in to codes(hope you The post Linear...

Read more »

Nonlinear Gmm with R – Example with a logistic regression

November 7, 2013
By

In this post, I will explain how you can use the R gmm package to estimate a non-linear model, and more specifically a logit model. For my research, I have to estimate Euler equations using the Generalized Method of Moments. I contacted Pierre Chaussé, the creator of the gmm library for help, since I was having...

Read more »