# 1243 search results for "regression"

## machine learning [book review, part 2]

October 21, 2013
By

The chapter (Chap. 3) on Bayesian updating or learning (a most appropriate term) for discrete data is well-done in Machine Learning, a probabilistic perspective if a bit stretched (which is easy with 1000 pages left!). I like the remark (Section 3.5.3) about the log-sum-exp trick. While lengthy, the chapter (Chap. 4) on Gaussian models has

## How Do You Write Your Model Definitions?

October 20, 2013
By

I’m often irritated by that when a statistical method is explained, such as linear regression, it is often characterized by how it can be calculated rather than by what model is assumed and fitted. A typical example of this is that linear regression is often described as a method that uses ordinary least squares to calculate the best...

## Introduction to Feature selection for bioinformaticians using R, correlation matrix filters, PCA & backward selection

October 17, 2013
By

Bioinformatics is becoming more and more a Data Mining field. Every passing day, Genomics and Proteomics yield bucketloads of multivariate data (genes, proteins, DNA, identified peptides, structures), and every one of these biological data units are described by a number of features: length, physicochemical properties, scores, etc. Careful consideration of which features to select when trying...

## A Bayesian Model for a Function Increasing by Chi-Squared Jumps (in Stan)

October 16, 2013
By

(This article was first published on David Chudzicki's Blog, and kindly contributed to R-bloggers) This post will describe a way I came up with of fitting a function that's constrained to be increasing, using Stan. If you want practical help, standard statistical approaches, or expert research, this isn't the place for you (look up “isotonic regression” or “Bayesian isotonic...

## That’s Smooth

October 10, 2013
By

I had someone ask me the other day how to take a scatterplot and draw something other than a straight line through the graph using Excel.  Yes, it can be done in Excel and it’s really quite simple, but there are some limitations when using the stock Excel dialog screens. So it is probably in

## Please, never use my codes without checking twice (at least)!

October 9, 2013
By

I wanted to get back on some interesting experience, following a discussion I had with Carlos after my class, this morning. Let me simplify the problem, and change also the dataset. Consider the following dataset > db = read.table("http://freakonometrics.free.fr/db2.txt",header=TRUE,sep=";") Let me change also one little thing (in the course, we use the age of people as explanatory variables, so...

## Some heuristics about spline smoothing

October 8, 2013
By
$\mathbb{E}(Y\vert X=x)=h(x)$

Let us continue our discussion on smoothing techniques in regression. Assume that . where is some unkown function, but assumed to be sufficently smooth. For instance, assume that  is continuous, that exists, and is continuous, that  exists and is also continuous, etc. If  is smooth enough, Taylor’s expansion can be used. Hence, for which can also be writen as for...

## Some heuristics about local regression and kernel smoothing

October 8, 2013
By
$\mathbb{E}(Y\vert X=x)=\beta_0+\beta_1 x$

In a standard linear model, we assume that . Alternatives can be considered, when the linear assumption is too strong. Polynomial regression A natural extension might be to assume some polynomial function, Again, in the standard linear model approach (with a conditional normal distribution using the GLM terminology), parameters can be obtained using least squares, where a regression of...

## Too crude to be true?

October 8, 2013
By

The key to programming is being lazy; it has actually been called a virtue by some. When I discovered the update() function it blew me away. Within short I had created a monster based upon this tiny function, allowing quick and easy output of regression tables that contain crude and adjusted estimates. In this post I’ll show...