Introduction In the first part of this series, we looked at how the sparklyr interface communicates with the Spark instance and what this means for performance with regards to arbitrarily defined R functions. We also examined how Apache Arrow can increase the performance of data transfers between the R session ...

Next week is my first installment of live training offered through O’Reilly Media’s online platform. I’m so excited to partner with this outstanding organization to deliver workshops on business analytics. My first two courses will offer a unique perspective on SQL and R. For each, I will ...

Exploring Data Exploring Features Transforming Target Feature Exploring Predictors Visually Checking Correlation Feature Engineering Fitting Model Splitting Data Fitting Model on Training Data Checking Model Performance Summary Inisght Let’s assume that we have been hired by a winery to build a predictive model to check the qulity of their ...

Web Scraping in R Web scraping needs no introduction among Data enthusiasts. It’s one of the most viable and most essential ways of collecting Data when the data itself isn’t available. Knowing web scraping comes very handy when you are in shortage of data or in need of ...

In this post, I will walk you through some examples that show off the major features of the ggforce package. The main goal is to share a few ideas about customizing visualizations that you may find useful in your everyday work. The ggforce package is an extension to ggplot2 developed ...

Nina Zumel had a really great article on how to prepare a nice Keras performance plot using R. I will use this example to show some of the advantages of cdata record transform specifications. The model performance data from Keras is in the following format: # R code library(wrapr) df

Time flies by and we are more people now here at STATWROX. But, did we change our behavior in using emojis or are we still the same? I am revisiting my analysis and will have a look! Der Beitrag Using emojis and .png as icons in your ggplot erschien zuerst ...

As digitalization progresses and data science interfaces continue to grow, new opportunities are constantly emerging to reach the personal analysis goals. Despite the „modernity“ of the industry, there is now a wealth of software for every need: From the design of the analysis infrastructure to the complete, decentralized evaluation through ...

I am happy to announce the release of ICC Bot, an app for computing interrater reliability scores using the intraclass correlation coefficient (ICC). A screenshot of ICC Bot, an interactive app for computing intraclass correlation coefficients. The ICC statistic appears in repeated measures or multilevel modeling literature as a way ...

I’ve never really worked much with Poisson data and wanted to get my hands dirty. I thought that for this project I might combine a Poisson data set with the simple Bayesian methods that I’ve explored before since it turns out the Poisson rate parameter lambda also has ...

Another low-key arithmetic problem as Le Monde current mathematical puzzle: Notice that there are 10 numbers less than, and prime with 11, 100 less than and prime with 101, 1000 less than, and prime with 1111? What is the smallest integer N such that the cardinal of the set of M