Distributional regression forests on arXiv

April 9, 2018
By

[This article was first published on Achim Zeileis, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here)
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.

Distributional regression trees and forests provide flexible data-driven probabilistic forecasts by blending distributional models (for location, scale, shape, and beyond) with regression trees and random forests. Accompanied by the R package disttree.

Citation

Lisa Schlosser, Torsten Hothorn, Reto Stauffer, Achim Zeileis (2018).
“Distributional Regression Forests for Probabilistic Precipitation Forecasting in Complex Terrain.”
arXiv.org E-Print Archive arXiv:1804.02921 [stat.ME].
https://arxiv.org/abs/1804.02921

Abstract

To obtain a probabilistic model for a dependent variable based on some set of
explanatory variables, a distributional approach is often adopted where the parameters of
the distribution are linked to regressors. In many classical models this only captures the
location of the distribution but over the last decade there has been increasing interest
in distributional regression approaches modeling all parameters including location, scale,
and shape. Notably, so-called non-homogenous Gaussian regression (NGR) models both
mean and variance of a Gaussian response and is particularly popular in weather forecasting.
More generally, the GAMLSS framework allows to establish generalized additive
models for location, scale, and shape with smooth linear or nonlinear effects. However,
when variable selection is required and/or there are non-smooth dependencies or interactions
(especially unknown or of high-order), it is challenging to establish a good GAMLSS.
A natural alternative in these situations would be the application of regression trees or
random forests but, so far, no general distributional framework is available for these.
Therefore, a framework for distributional regression trees and forests is proposed that
blends regression trees and random forests with classical distributions from the GAMLSS
framework as well as their censored or truncated counterparts. To illustrate these novel
approaches in practice, they are employed to obtain probabilistic precipitation forecasts
at numerous sites in a mountainous region (Tyrol, Austria) based on a large number of
numerical weather prediction quantities. It is shown that the novel distributional
regression forests automatically select variables and interactions, performing on par or often
even better than GAMLSS specified either through prior meteorological knowledge or a
computationally more demanding boosting approach.

Software

R package disttree at
https://R-Forge.R-project.org/R/?group_id=261

Illustration

Distributional trees as part of the parametric and recursive partitioning modeling toolbox.

Modeling toolbox

Total precipitation predictions by a distributional forest at station Axams for July
24 in 2009, 2010, 2011 and 2012 learned on data from 1985-2008. Observations are
left-censored at 0.

Precipitation forecast Axams

Map of Tyrol coding the best-performing model for each station (type of symbol).
The color codes whether the distributional forest had higher (green) or lower (red) CRPS
compared to the best of the other three models. Station Axams is highlighted in bold.

Precipitation forecast Tyrol

To leave a comment for the author, please follow the link and comment on their blog: Achim Zeileis.

R-bloggers.com offers daily e-mail updates about R news and tutorials about learning R and many other topics. Click here if you're looking to post or find an R/data-science job.
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.



If you got this far, why not subscribe for updates from the site? Choose your flavor: e-mail, twitter, RSS, or facebook...

Comments are closed.

Search R-bloggers

Sponsors

Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)

Click here to close (This popup will not appear again)