A large number of small data sets are available in the FSA and FSAdata packages. These data sets may be useful for demonstrating typical fisheries science analyses in an undergraduate or early graduate fisheries science and management course or if one is self-teaching how to perform these analyses. Indeed, several ... [Read more...]

Introduction Big Data help us to analyze unstructred data (aka "text" ), with many techniques, in this post it is presented one: Cosine Similarity. There are also other analysts work, who scraped data from twitter who spot some airplane complai... [Read more...]

Dag Lohmann gave an exhaustive (not "-ing"!) presentation on Katrisk modeling of water damage at  The Berkeley R Language Beginner Study Group last night in The Ark. A bit beyond "beginner", Dag! :-) Thanks for the snips of your shiny. Nice graphs. [Read more...]

Open source software has caused a quiet revolution in computing since the creation of the GPL license by Richard Stallman back in 1989. Yet it has been slow to gain ascendency in many areas, including Civil Engineering. This short post discusses this issue in the context of the uptake of QGIS ... [Read more...]

Applied statistical theory is a new series that will cover the basic methodology and framework behind various statistical procedures. As analysts, we need to know enough about what we’re doing to be dangerous and explain approaches to others. It’s not enough to say “I used X because the ... [Read more...]

By Andrie de Vries Earlier this month Rich Calaway, programme manager at Microsoft and maintainer of the foreach package, published some updates to the foreach suite of packages, including: foreach iterators doMC doParallel doSNOW Most of the changes were cosmetic, or to conform to CRAN policy. However, the last two ... [Read more...]

[Read more...]

The course “Data Mining with R”, which takes place from 9th to 10th November 2015 in Kassel, Germany, teaches the most important methods to expose correlations in data and inherent patterns. The wide set of methods can be used for almost every application area. From customer segmentation to timely recognition of ... [Read more...]

[Read more...]

[Read more...]

After summer holidays we are back with two talks: 6pm-6:30 – Adolfo Álvarez PhD ,,5 lessons I have learned at Analyx”. 7pm-7:30 – Piotr Migdał, PhD ,,Jupyter – the environment for learning and doing data analysis’’. See you tomorrow (22/10/2015) at 6 pm, Department of Mathematics, Warsaw University of Technology, Koszykowa 75 room 329. You … Czytaj dalej Warsaw ... [Read more...]

In my previous post, I introduced the concept of smoothing using Fourier basis functions and I applied them onto temperature data. It is important to note the that a similar kind of analysis can be replicated using B-splines (see this page). In this post, I extend the concept to an ... [Read more...]

In my last post I described how I built a shiny application called “DFaceR” that used Chernoff Faces to plot multidimensional data. To improve application response time during plotting, I needed to split large datasets into more manageable “pag... [Read more...]

In my last post I described how I built a shiny application called “DFaceR” that used Chernoff Faces to plot multidimensional data. To improve application response time during plotting, I needed to split large datasets into more manageable “pages” to be plotted. Rather than take the path of least resistance ... [Read more...]

SummaryThis is a simple python script that can measure python program running time in fine levels. It’s simpler than a full profiler, easier to use than other currently available similar scripts. [Read more...]

[Read more...]

Previously in this series Understanding the beta distribution (using baseball statistics) Understanding empirical Bayes estimation (using baseball statistics) In my last post, I explained the method of empirical Bayes estimation, a way to calculate useful proportions out of many pairs of success/total counts (e.g. 0/1, 3/10, 235/1000). I used the example ... [Read more...]

[Read more...]

[Read more...]