Sometimes you just need the salient text from a web site, often as a first step towards natural language processing (NLP) or classification. There are many ways to achieve this, but XSLT (eXtensible Stylesheet Language) was purpose-built for slicing, dicing and transforming XML (and, hence, HTML) so, it can make ... [Read more...]

[Read more...]

[Read more...]

No matter where you live, your view of the world is biased and limited, which is the beauty of this magazine cover.As a marketer, of course, all my maps depict, not place, but consumption. For example, in an earlier post I asked, "What apps are on your... [Read more...]

Yesterday I spoke at Stat Bytes, our student-run statistical computing seminar. My goal was to introduce two principled frameworks for thinking about data visualization: human visual perception and the Grammar of Graphics. (We also covered some relevant R packages: RColorBrewer, … Continue reading → [Read more...]

 library(NewCo knowledge)function (X, FUN, ..., ) {FUN [Read more...]

RTutor: Credit Booms Gone Bust 2015-07-09 12:00:00 Currently, quite a few students here at Ulm University create RTutor problem sets based on economic articles as part of their Bachelor or Master thesis. RTutor is an R package that allows to develop interactive R problem sets, that can be solved in ... [Read more...]

[Read more...]

[Read more...]

“There is no such thing as information overload, only bad design” - Professor Emeritus of Political Science, Statistics, and Computer Science at Yale University Edward Tufte The number of organizations working on data-driven projects increased by 125% in the past year. 44% of companies tackle big data “all the time.” 82% of executives ... [Read more...]

Frequently I find I need to perform an analysis that requires querying some values in a database table based on a series of IDs that might vary depending on some input. As an example, assume we have the following: A table that contains historical stock prices for 2000 stocks for the ... [Read more...]

When we teach data science we emphasize the data scientist’s responsibility to transform available data from multiple systems of record into a wide or denormalized form. In such a “ready to analyze” form each individual example gets a row of data and every fact about the example is a ... [Read more...]

Morningstar is looking for an applied behavioral scientist, to help understand and overcome the behavioral obstacles that individuals face to financing their retirement. The post Job opening with Morningstar’s behavioral science team appeared first on Decision Science News. [Read more...]

Hot off the press, Norman Matloff's book, Parallel Computing for Data Science: With Examples in R, C++ and CUDA  (Chapman and Hall/ CRC Press, 2015) should appeal to a lot of the readers of this blog.The book's coverage is clear from the following chapter titles:1. Introduction to Parallel Processing in ... [Read more...]

by Andrie de Vries My experience of UseR!2015 drew to an end shortly after I gave a Kaleidoscope presentation discussing "The Network Structure of CRAN". My talk drew heavily on two previous blog posts, Finding the essential R packages using the pagerank algorithm and Finding clusters of CRAN packages using ... [Read more...]

[Read more...]

Via my feeds, I noticed a package announcement today for cricketR!, a new package for analysing cricket performance data. This got me wondering (again!) about what other sports related packages there might be out there, either in terms of functional thematic packages (to do with sport in general, or one ... [Read more...]

[Read more...]

In the last few months I have received queries about whether a “fish bioenergetics” model has been implemented in R.  Here is what I am aware of. Fish Bioenergtics 4.0 (an update of the Fish Bioenergetics program distributed by Wisconsin Sea … Continue reading → [Read more...]