Articles by matloff

The Notion of “Double Descent”

November 11, 2020 | matloff

I tend to be blase’ about breathless claims of “new” methods and concepts in statistics and machine learning. Most are “variations on a theme.” However, the notion of double descent, which has come into prominence in the last few years, is something I regard as genuinely new and very relevant, ...
[Read more...]

Efron Updates breiman’s “two cultures” essay

July 27, 2020 | matloff

The June 2020 issue of JASA features a highly insightful essay by Brad Efron, dean of the world’s statisticians. The article is accompanied by commentary by a number of statistical luminaries. Important, indeed central questions are raised. I would hope JASA runs more pieces of this nature. The essay may ... [Read more...]

New Book on Machine Learning

June 12, 2020 | matloff

I’m nearing completion of writing my new book, The Art of Machine Learning: Algorithms+Data+R, to be published by the whimsically named No Starch Press. I’m making a rough, partial draft available, and welcome corrections, suggestions and comments. I’ve been considering doing such a project for ... [Read more...]

FOCI: a new method for feature selection

May 18, 2020 | matloff

It’s been a while since I’ve posted here, not for lack of material but just having too long a TO DO list. I’ve added some important features to my regtools package, for instance, and hope to discuss them here soon. For the present post, though, I will ...
[Read more...]

“Clearing the Confusion” series

February 6, 2020 | matloff

In recent weeks, I’ve posted three tutorials with Clearing the Confusion titles, all in my regtools GitHub repo. Topics have been unbalanced classification data; k-fold cross validation; and scaling in PCA. Comments welcome! [Read more...]

R Journal July Issue

August 26, 2019 | matloff

As the current Editor-in-Chief of the R Journal, I must apologize for the delay in getting the July issue online, due to technical and other matters. In the meantime, though, please take a look at the many interesting articles slated for publication in this and upcoming issues. Various improvements in ... [Read more...]

New Version of regtools package

August 25, 2019 | matloff

My updated version of my regtools package, tools for parametric and nonparametric regression, is now on CRAN, https://cran.r-project.org/package=regtools It has a number of new functions and datasets. Type vignette(‘regtools’) for an overview. Advertisements [Read more...]

Prob/Stat for Data Sci: Math + R + Data

June 30, 2019 | matloff

My new book, Probability and Statistics for Data Science: Math + R + Data, pub. by the CRC Press, was released on June 24! This book arose from an open-source text I wrote and have been teaching from. The open source version will still be available, though rather different from the published one. ... [Read more...]

My Free Online Tutorial on R

June 23, 2019 | matloff

I’m continuing to add more lessons to my free online R tutorial, 17 of them so far, adding more from time to time. Aimed specifically at nonprogrammers, though those with C or Python background should find it helpful too. Comments and suggestions welcome! Advertisements [Read more...]

R vs. Python

June 13, 2019 | matloff

For some time, I’ve planned to write up a point-by-point comparison of R and Python. I’ve done so now! Comments welcome. Advertisements [Read more...]

r/finance, 1 year later

May 18, 2019 | matloff

The prominent conference R/Finance, held annually in Chicago, had a great program yesterday and today. As I wrote following last year’s conference, the organizers were criticized for including no women in its speaker lineup. The problem was that no women had submitted papers for consideration; no input, thus ... [Read more...]

Free online r course

May 4, 2019 | matloff

Recently a young relative mentioned that the campus R course she hoped to attend was full. What online alternatives did she have? So, I decided to start one of my own! https://github.com/matloff/fasteR  Designed for complete beginners. I now have six lessons up on the site. I ... [Read more...]

nice student project

March 24, 2019 | matloff

In all of my undergraduate classes, I require a term project, done in groups of 3-4 students. Though the topic is specified, it is largely open-ended, a level of “freedom” that many students are unaccustomed to. However, some adapt quite well. The topic this quarter was to choose a CRAN ... [Read more...]

R > Python: a Concrete Example

November 20, 2018 | matloff

I like both Python and R, and teach them both, but for data science R is the clear choice. When asked why, I always note (a) written by statisticians for statisticians, (b) built-in matrix type and matrix manipulations, (c) great graphics, both base and CRAN, (d) excellent parallelization facilities, etc. ...
[Read more...]

Example of Overfitting

November 16, 2018 | matloff

I occasionally see queries on various social media as to overfitting — what is it?, etc. I’ll post an example here. (I mentioned it at my talk the other night on our novel approach to missing values, but had a bug in the code. Here is the correct account.) The ... [Read more...]

Manifold Visualization: Second Example

October 1, 2018 | matloff

In last night’s post, I introduced prVis(), a new visualization tool which we have invented, available in our polyreg package. Recall that prVis() is intended as a simpler alternative to recent visualization tools like t-SNE and UMAP. Here I will post another example. The dataset is prgeng, included in ...
[Read more...]

Manifold Visualization: Polynomials to the Rescue

October 1, 2018 | matloff

Our arXiv paper and the associated R package polyreg caused a bit of a stir, both pro and con, when we first announced them here in June. The discussion even spread as far as Twitter, Reddit and Hacker News. We’ll be announcing a revised paper, and various new features ...
[Read more...]

What, No Parentheses?

August 25, 2018 | matloff

I’m about to show you an R trick. Various readers may find it cool, useful and interesting, or stupid, useless and an evil deed undermining the sanctity of R’s functional programming nature (“All bow”). But I hope many of you will find the material here rather intriguing if ... [Read more...]

Update on Polynomial Regression in Lieu of Neural Nets

July 1, 2018 | matloff

There was quite a reaction to our paper, “Polynomial Regression as an Alternative to Neural Nets” (by Cheng, Khomtchouk, Matloff and Mohanty), leading to discussions/debates on Twitter, Reddit, Hacker News and so on. Accordingly, we have posted a revised version of the paper. Some of the new features: Though ...
[Read more...]

Neural Networks Are Essentially Polynomial Regression

June 20, 2018 | matloff

You may be interested in my new arXiv paper, joint work with Xi Cheng, an undergraduate at UC Davis (now heading to Cornell for grad school); Bohdan Khomtchouk, a post doc in biology at Stanford; and Pete Mohanty,  a Science, Engineering & Education Fellow in statistics at Stanford. The paper is ... [Read more...]
1 2 3 5

Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)

Click here to close (This popup will not appear again)