The forthcoming RStudio 1.2 release has a new “Jobs” feature for running and managing background R tasks. I did a series of threaded screencaps on Twitter but that doesn’t do the feature justice. So I threw together a quick ‘splainer on how to run and Python (despite RStudio not natively supporting Python) code in the... Continue reading →
Introduction In the previous articles of the R:case4base series we discussed and learned how to reshape data with base R to a form that is practical for our use and how to subset data to get the relevant parts of it with base R. In this one, we will look at aggregation techniques using base R’s stats::aggregate generic function, focusing on the method...
Eleventh post of our series on classification from scratch. Today, that should be the last one… unless I forgot something important. So today, we discuss boosting. An econometrician perspective I might start with a non-conventional introduction. But that’s actually how I understood what boosting was about. And I am quite sure it has to do with my background in...
For the fourth and last day of project recaps from this year’s unconf, here is an overview of the next five projects. In the spirit of exploration and experimentation at rOpenSci unconferences, these projects are not necessar...
If knowledge is power, then knowledge of data.table is something of a super power, at least in the realm of data manipulation in R. In this exercise set, we will use some of the more obscure functions from the data.table package. The solutions will use set(), inrange(), chmatch(), uniqueN(), tstrsplit(), rowid(), shift(), copy(), address(), setnames() Related exercise sets:Spatial Data...
Most people know KEGG pathway, but not everyone knows that it costs at least $2000 to subscribe its database. If you want to save the cost a bit, you can manually download the KEGG pathway KGML files and install in SPIA. Here I have a workaround to dow...
Microsoft R Open 3.5.0 is now available for download for Windows, Mac and Linux. This update includes the open-source R 3.5.0 engine, which is a major update with many new capabilities and improvements to R. In particular, it includes a major new framework for handling data in R, with some major behind-the-scenes performance and memory-use benefits (and with further...
Aimée Gott, Education Practice Lead For the last week we've been talking on the blog and Twitter about some of the functionality in Shiny and how you can learn it. But, if you haven't already made the leap and started using Shiny, why should you? What is the challenge to be solved? At Mango we define data science as the proactive...
Tenth post of our series on classification from scratch. Today, we’ll see the heuristics of the algorithm inside bagging techniques. Often, bagging is associated with trees, to generate forests. But actually, it is possible using bagging for any kind of model. Recall that bagging means “boostrap aggregation”. So, consider a model . Let denote the estimator of obtained from...
INTRODUCTION With flexdashboard, you can easily create interactive dashboards for R. What is amazing about it is that with R Markdown, you can publish a group of related data visualizations as a dashboard. Additionally, it supports a wide variety of components, including htmlwidgets; base, lattice, and grid graphics; tabular data; gauges and value boxes and Related exercise sets:Spatial Data...
Another maintenance release of our pinp package for snazzier one or two column vignettes is getting onto CRAN right now. Everybody's favourite Swiss Army Knife of text processing and document conversion, pandoc, decided in all its wisdow for version ...
Last week I gave one of the keynote addresses at R/Finance 2018 in Chicago. I considered it an honor and a pleasure to be there, both because of the stimulating intellectual exchange and the fine level of camaraderie and hospitality that prevailed. I mentioned at the start of my talk that the success of this … Continue reading Women...
Dr. Julia Silge is a data scientist at Stack Overflow. We talked about why R brings Julia joy, her path to a career in data science and what it was like to co-write a book for O’Reilly Media. This interview occurred on February 3, 2018 at the RStudio Conference in San Diego. KO: What is your name,...
![maximal spacing around order statistics [#2]](https://xianblog.files.wordpress.com/2018/06/riddler0106.jpeg?w=450&h=280)
The proposed solution of the riddle from the Riddler discussed here a few weeks ago is rather approximative, in that the distribution of when the n-sample is made of iid Normal variates is (a) replaced with the distribution of one arbitrary minimum and (b) the distribution of the minimum is based on an assumption of
A colleague asked if I would blog about how I crafted the grid of world tile grids in this post and I accepted the challenge. The technique isn’t too hard as it just builds on the initial work by Jon Schwabish and a handy file made by Maarten Lambrechts. The Premise For this particular use-case,... Continue reading →
In case you missed them, here are some articles from April of particular interest to R users. The R Consortium has announced a new round of grants for projects proposed by the R community. A look back at the ROpenSci unconference held in Seattle. Video of my European R Users Meeting talk, "Speeding up R with Parallel Programming in...
Version 0.9.5.0 of stringdist is accepted on CRAN (binaries for non-linux OSs will be available in a few days). The main new feature, with a huge thanks to our awesome new contributor Chris Muir, is that we made it easy … Continue reading →
Ava Yang, Data Scientist There are times when it costs more than it should to leverage javascript, database, html, models and algorithms in one language. Now maybe is time for connecting some dots, without stretching too much. If you have been developing shiny apps, consider letting it sit on one live database instead of manipulating data I/O by hand? If you use...
It is pretty rare to find something that represents linearity in the environmental system. The Y/X response may not be a straight line, but humped, asymptotic, sigmoidal or polynomial are possibly, truly non-linear. In this exercise, we will try to take a closer look at how polynomial regression works and practice with a study case. Related exercise sets:Spatial Data...
Back-calculating lengths of fish at previous ages from measurements made on calcified structures (scales, otoliths, etc.) is fairly common practice within some fisheries agencies and institutions. The FishBC software distributed by the Amer...
Eighth post of our series on classification from scratch. The latest one was on the SVM, and today, I want to get back on very old stuff, with here also a linear separation of the space, using Fisher’s linear discriminent analysis. Bayes (naive) classifier Consider the follwing naive classification ruleor(where is the density in the continuous case). In the...
For day 3 of project recaps from this year’s unconf, here is an overview of the next five projects. Stay tuned for the last recap tomorrow. In the spirit of exploration and experimentation at rOpenSci unconferences, these projects are not necessarily finished products or in scope for rOpenSci packages. Let’s dive into today’s 5 projects in focus! jobstatus Summary: jobstatus helps keep an...
In this post, we'll return to the Kaggle data containing information on Pitchfork music reviews. In a previous post, I used this dataset to cluster music genres. In the current post, I will use R and the tidytext package (and philosophy) to examine the text of the music reviews. Specifically, the goal of the analysis described in this post...
A guest post by @MaxMaPichler, MSc student in the Group for Theoretical Ecology / UR Artificial neural networks, especially deep neural networks and (deep) convolutions neural networks, have become increasingly popular in recent years, dominating most machine learning competitions since the early 2010’s (for reviews about DNN and (D)CNNs see LeCun, Bengio, & Hinton, 2015). In ecology,…
A new update of my sjstats-package just arrived at CRAN. This blog post demontrates those functions of the sjstats-package that deal especially with Bayesian models. The update contains some new and some revised functions to compute summary statistics of Bayesian models, which are now described in more detail. hdi() rope() mcse() n_eff() tidy_stan() equi_test() mediation() … Weiterlesen R functions...
Seventh post of our series on classification from scratch. The latest one was on the neural nets, and today, we will discuss SVM, support vector machines. A formal introduction Here takes values in . Our model will be Thus, the space is divided by a (linear) border The distance from point to is If the space is linearly separable,...
If you’ve been on a New York City subway platform since January 2018, you should have noticed a countdown clock that displayed an estimate of when the next train would arrive. Although there’s no official record of when trains actually stopped at each station, the countdown clock data can be used to approximate. Over the past 5 months, I’ve...
It’s happening – and this time in Swabia. eoda is bringing you the popular trainings for R to the South of Germany. Over more than 1500 satisfied participants have trained their practical data science skills with R trainings by eoda. Offering an Introduction to R and an Introduction to Data Mining with R, professional training … „R trainings &...
In the exercises below, we will work with Time Series analysis and see how R can make your life easier when working with Time Series. doing Time Series Analysis.This will be a series of Exercises and I urge you to take it in series Please install the package and load the library before starting Answers Related exercise sets:Spatial Data...
